Big Data Developer/ Architect Resume
NY
SUMMARY:
- Seasoned Software Professional with 19+ years’ experience leading/delivering complex projects, managing design, development & tools teams with strong technical expertise in various technologies most recent hands on experience (3+) on Big Data projects.
- Strong Understanding of Hadoop principles - HDFS storage and MapReduce processing framework
- Hands on Experience leading application design for Retail, Banking & Telecom clients in most Hadoop Ecosystems including data ingestion using Sqoop and Flume, data processing using Hive Query Language Hive-HBase data integration, using Pig interpretive language for MapReduce jobs, Oozie workflow engine, Zookeeper.
- Hands on Experience with Hadoop cluster administration including planning, distributed mode cluster installation, configuration and management in order to handle projects with large variety of customer data in Terabytes
- Experienced working with Cloudera & Horton works distribution platforms
- Experienced with multiple Virtual Machine Setup using Oracle Virtual box virtualization layer.
- Knowledge on Cloudera Impala Search for Massive Parellel Processing (MPP) SQL query engine.
- Worked on prototype projects using MongoDB queries in Cloudera Hadoop environment & Cassandra as part of internal project to evaluate NoSQL database performance
- Experience with real time and embedded systems programming using object oriented concepts in C++ and core Java
- Experienced with Agile Software development methodology.
TECHNICAL SKILLS:
Big Data Ecosystems: Hadoop framework, Cloudera and Horton works Hadoop Platforms, Map Reduce processing using Java, Hive and Pig, Data ingestions using Sqoop, & Flume, Workflow engine Oozie, Zookeeper management, Understanding of Solr, Impala, BI tool Pentaho
NoSQL Databases: HBase, MongoDB, Cassandra
Leadership/Proj Mgmt. Skills: Project Planning, Scope planning, Time management, Problem identification and resolution, Risk and resource management, Quality control, Conflict resolution, Reporting to key stakeholders
Project Mgmt. Tools: MS Project, Excel, Visio, Word, Power point, Crystal reports, MS SharePoint
Testing tools: Clear case, Mercury Quality Center
Software methodologies: Waterfall, Agile, Iterative
Business Modeling tools: Rational Rose, Visio, Excel, Smart draw, Power point
Protocols and standards: TCP/IP, SIP, MGCP, H.248/Megaco, SS7, ISUP, IS41, X.25, Ethernet, DSL IS41, LTE, GSM-MAP, TDMA/CDMA, MPLS, SONET/SDH, DWDM
Languages/ Databases: C++, Core Java, SQL, VB, C, Ingres, Foxpro, Oracle, DB2, MS Access, Python
O/S: UNIX (Linux, Ubuntu, CentOS), Solaris, Windows, Mac OSRTOS: SOS, CROS
PROFESSIONAL EXPERIENCE:
Confidential, NY
Big Data Developer/ Architect
Responsibilities:
- Interfaced with marketing & IT teams to gather business requirements and understand project scope.
- Evaluated hardware memory/storage requirements for Hadoop cluster setup and present the architecture.
- Setup Hadoop cluster initially with six nodes (incrementally increased to sixtimes after presenting proof of concept
- Using Sqoop and Flume imported structured & unstructured data and web server logs into HDFS.
- Processed data by running MapReduce jobs using Hive to generate reports on sales, shopping patterns based on location.
- Presented the findings to marketing teams and reevaluated the findings with new data after discounts personalization.
- Moved the data from Hive tables into HBase collections.
- Developed Oozie workflow to schedule & orchestrate the data ingestion process and to run a Hive scripts.
- Responsible for cluster maintenance, troubleshooting, internal & external user documentation.
- Evaluated data volumes and suggest incremental architecture changes proportional to data growth.
- Commissioned and decommissioned Data nodes when there are issues.
- Trained the client’s IT team on Hadoop.
- Acted as technical liaison with Cloudera support for platform related issues.
Environment: Cloudera Manager 4.8.2 (CDH4), HBase, Hive, Solaris, Sqoop, Oozie, Ubuntu 12.04
Confidential
Big Data Dev/Architect
Responsibilities:
- Upgraded existing environment from CDH3 to CDH4 using Cloudera Manager 4.7.2.
- Created a multi-node cluster for distributed processing.
- Setup Flume agents to import data into Hadoop HDFS.
- Generated reports using Hive, HBase & Pig queries based on business requirements.
- Communicated with product marketing team on a regular basis and gather requirements.
- Ran Map Reduce jobs using Hive & Pig queries to generate reports based on business requirements.
- Monitored and maintained Hadoop cluster.
Environment: Cloudera Manager 4.7.2, Linux, OLAP, Hive, MongoDB, HBase, Pig, Oozie, Flume
Confidential, New Jersey
Lead Consultant
Responsibilities:
- Gathered requirements from product marketing & business analysts.
- Installed, setup and maintain Hadoop Cluster using CDH3 version with 3 nodes.
- Moved semi-structured and structured data sets using Flume & Sqoop into HDFS
- Used Hive queries run reports to identify dropped calls based on location.
- Worked with BI team for further analytics on Pentaho platform.
Environment: Ubuntu, Hive, CM 4.8.2, HBase, Flume, OLAP, Sqoop, MongoDB
Confidential, Plano, Texas
Solution Delivery Manager
Responsibilities:
- Working with cross-functional teams from business, product verification, and system engineering, managed design and product verification teams on several voice and packet core projects
- Initiated project planning meetings with customers and product line marketing teams to firm up design estimates. Developed RFPs for third party collaboration efforts. Developed customer, sales and functional, design and test documentation
- Responsible for project architecture and design
- Led pre-sales support teams, managed development of Sales tools, authored white papers, and helped with contract negotiations with large carrier customers including Confidential &T, Confidential, Confidential among others.
- Created internal and external project plans using Microsoft project for multiple projects.
- Provided weekly status reports and monthly pipeline reports to senior management
- Managed resources effectively among teams located in different geographic locations.
- Identified and escalated problems and drove risk mitigation strategies
- Initiated release over release product improvement strategies for continuous product improvement
- Established KPIs for measuring and tracking performance levels, improving support processes, and streamlining the delivery of critical customer care.
- Helped reduce the cost of delivery and increased customer satisfaction levels by creating a mixed offshore-onsite delivery model
- Performed mid-year and yearly assessment of team members
Confidential, San Jose, CA
Technical Project Manager
Responsibilities:
- Managed members of tools, development and product verification teams
- Responsible for project planning of all voice core projects. Translated business needs into design and technical requirements. Managed interoperability trials in Confidential among third party products
- Worked on RFPs, vendor analysis and management, contract negotiation and management, finalizing customer requirements, providing statements of work, supported the marketing/business development groups in writing business proposals
- Performed primary market research, conducted competitive analysis and produced various technical marketing reports and white papers on VoIP networks/architecture.
- Provided half-yearly and year end feedback for team members