Lead Hadoop Developer Resume
SUMMARY:
- Over 8 years of professional IT experience in requirement gathering, design, development, testing, implementation and maintenance
- Over 3 years of experience in solution, design and development of projects in Hadoop platform
- Experience in development of Big Data projects using Hadoop MapReduce, Hive, Impala, Sqoop, Spark and other open source tools/technologies
- In depth and extensive knowledge of Hadoop architecture and its components
- Very good understanding in partitioning of HIVE tables
- Experience in writing HiveQL queries to store processed data into Hive tables for analysis
- Experience in developing Spark - Scala programs for batch processing using core spark and spark sql libraries
- Experience in using Hadoop compressed file format, parquet
- Experience in importing and exporting data using Sqoop from HDFS file system to Relational Database Systems and vice-versa
- Strong working experience in Commercial Insurance domain
- Experience in developing applications using Visual Basic, Java, COBOL-CICS Mainframe stored procedures and Visual Basic for Applications such as MS Office Word and Excel
- Hands on experience using ETL tool, Informatica Power Center
- Working Experience as Technical Business Analyst
- Experience in Agile (SCRUM) & Waterfall development methodologies
- Strong in initiative and change orientation. Love to work and always go the extra mile
- Strong experience working in a globally distributed team environment
- Analytical thinker that consistently resolves on-going issues or defects, often called upon to consult on problems as well a fast learner
- Proven ability to work independently and also as part of a team, in some instances leading the team on technical front
- Experience in complete software engineering process starting from requirement gathering
TECHNICAL SKILLS:
Hadoop: Hadoop MapReduce, Hive, Sqoop, Spark, Impala, Parquet
Languages: COBOL, Core Java, Visual Basic 6.0, VB.Net, Scala
Tools & Technologies: Visual Studio 2006/2010, Eclipse, Mainframe CICS, FileAid, WinSQL, Endevor, Informatica Power Centre, MS Visio, IntelliJ IDEA
Database: Oracle, DB2, MS Access
PROFESSIONAL EXPERIENCE:
Confidential
Lead Hadoop Developer
Technologies: Hadoop YARN, HDFS, Core Spark & Spark SQL, Scala, Sqoop, Impala, IntelliJ IDEA
Responsibilities:
- Design, Estimation and Scheduling of the modules
- Responsible for Hadoop development environment setup
- Technically lead the development activities and responsible for delivery of modules
- Coding Spark Scala Jobs, Scripts & Sqoop Imports
Confidential
Hadoop Developer
Technologies: Hadoop YARN, HDFS, Spark, Scala, Impala, IntelliJ IDEA
Responsibilities:
- Responsible for Planning, effort and scheduling of the modules
- Responsible for setting up the Hadoop environment as this is the very first Hadoop project in the customer area
- Design, Coding, unit testing and handling release management for the modules
- Working closely with other dependent teams to get work done on time to meet the project deadlines
- Responsible for writing scripts and Tivoli job scheduling
- Responsible for release documentation and transition of work done
Confidential
Hadoop Developer
Technologies: Hadoop YARN, HDFS, MapReduce with Java, Hive, Sqoop, MRUnit, SVN, LINUX, Cloudera Distribution of Hadoop, Eclipse
Responsibilities:
- Working alongside lead developer and project manager for planning, effort and scheduling
- Responsible for ramping up new associates added to the team
- Working closely with business associates for business rules which helps with the design
- Participation in design phase of the project
- Responsible for development and unit testing of MapReduce programs
Confidential
Hadoop Developer
Technologies: Hadoop YARN, HDFS, MapReduce with Java, Hive, Sqoop, Oracle, DB2, MRUnit, SVN, LINUX, Cloudera Distribution of Hadoop, Eclipse
Responsibilities:
- Responsible for Development and Unit Testing of MapReduce programs
- Developing suit of Unit Test Cases for Mapper, Reducer and Driver classes using MR Testing library
- Responsible for writing scripts to load data into HDFS from the vendor provided source
- Creating Hive schemas and Hive UDFs
- Working closely with Hadoop Admin for cluster set up
Confidential
Development Lead/Analyst
Technologies: Visual Basic, Mainframe (COBOL, CICS), DB2, Oracle, Visual Studio, Visual Basic for Applications (MS Office Word and Excel), SVN, Informatica Power Center 9.1, MS Visio
Responsibilities:
- Participating in JAD sessions for requirements gathering along with Business Analysts
- Responsible for High Level Design and integration with other vendor applications
- Responsible for Detail Design, Development and Unit Testing and leading the offshore team for the same
- Ensuring the Quality and Standard of the code
- Driving the meetings with other vendors for project dependencies and responsible for team progress reporting on daily SCRUM
- Single Point of Contact for IT and UAT phase and Warranty support post deployment
Confidential
Development Lead
Technologies: Visual Basic, MS Outlook, Windows Server, FileNet Image Service, Visual Studio, DB2, SVN, MS Access
Responsibilities:
- Assisting Project Manager in Module Planning, effort and schedule estimation
- Setting up the development environments and fixing issues in test and prod environments
- Coding, unit testing and handling other release management and responsible for code review of modules
- Plan and keep track of the work done and meet the project deadline
- Working with BA for clarification and unblocking issues
Confidential
Application Developer
Technologies: Visual Basic, VB.Net, Visual Studio, SVN, DB2, Visual Basic for Applications (MS Office Word and Excel)
Responsibilities:
- Participated in the detail design of end-to-end modules
- Coding, unit testing and handling other release management and responsible for code review for some modules
- Coordinating with onsite lead & Client for clarification and unblocking issues
- Participation in CIT and assisting IT testing team with clarifications and fixing defects
Confidential
Application Developer/Maintenance
Technologies: Visual Basic, Java, Visual Studio, Mainframe (COBOL, CICS), DB2, SVN, MS Access, Eclipse, Visual Basic for Applications (MS Office Word and Excel), BMC Remedy, Oracle, MS Access, Endevor, FileAid
Responsibilities:
- Development and Unit test of enhancement requests and work with Onshore Lead for delivery
- Responsible for Preparing technical documents
- Involved in production tickets/ defects resolution in compliance to Service Level Agreements
- Participating in root cause analysis, sharing best practices and presenting findings with possible work around to counter the issues
- Responsible for ramping up new team members