Hadoop Consultant Resume
Los Angeles, CA
SUMMARY:
- An IT professional with 13 years’ experience involving in all aspects of SDLC including design, analysis, architecture, execution, planning, performance management, process development, production support and deployment for Financial, retail and Utility companies.
- Experience with Software Development Processes & Models: Agile, Scrum & Waterfall.
- Strong analytical skills with ability to quickly understand client’s business needs.
- Hands on experience in installing, configuring CloudEra's Apache Hadoop ecosystem components like Flume, Oozie, Hive, Sqoop, Pig, Zoo Keeper
TECHNICAL SKILLS:
Big Data Technologies: HDFS, Pig, Hive, Impala, HBase, Flume, Sqoop, Oozie, MapReduce, Zookeeper, Spark
Operating Systems: Windows, Linux, Unix, Mvs/Esa,Os/2
Languages: Core Java, C, VS - Cobol-II, C, JCL, SQL
Database/Tool: DB2, MS SQL Server, Platinum, Explain, IMS (Knowledge),Toad
Scripting: VB Script
Version Control: MS VSS,Clear case, Change Man
Tools: Informatica ETL, Eclipse
PROFESSIONAL EXPERIENCE:
Confidential, Los Angeles, CA
Hadoop Consultant
Responsibilities:
- Design and Implement historical and incremental data ingestion from multiple external systems
- Design physical data models for structuring raw data in HDFS.
- Worked with Java/Scala and XML developers and systems engineers
- Design map/reduce logic and HIVE queries for generating aggregated metrics.
- Design and Develop data migration logic for exporting data from HDFS/HIVE to Vertica using WebHDFS
- Design and Develop complex workflow in Oozie for recurrant job execution
Confidential, Los Angeles, CA
Hadoop Consultant
Responsibilities:
- Proof of concept for Web log analytics on Hadoop to the customers.
- Work with business users, to ensure technology is implemented to meet the expectations of demanding business data mining community.
- Maintain all system configuration documentation by collecting, storing, and updating the documentation.
- Worked with Java/Scala and XML developers and systems engineers
- ImplementedHadoop, Flume, PIG, HIVE, Sqoop.
- Implemented and configured flume to stream the log data from various data sources.
- Experience in writing Pig Latin scripts to parse the log files using the Regex.
- Created Hive external tables for loading the parse data using partitions.
- Analyzing the data using Hive QL and Pig Latin scripts.
- Developed an internal portal using Scala
- Writing MapReduce Jobs to cleanse and parse data in HDFS obtained from various data sources and migrated to MPP databases such as Teradata.
- Provide ad hoc reports for data extraction and aggregation.
- Created and maintained Technical documentation for launching HADOOP Clusters and for executing Pig Scripts and Hive queries
Environment: Hadoop, Pig, Hive, Flume, Core Java and eclipse
Confidential, Denver, CO
Sr. Programmer Analyst
Responsibilities:
- Reviewing function specs/design document with the client
- Documenting the changes required.
- Implement the changes, preparation of test data and testing.
- Analysis of change request/Issue reported by the users.
- Analyze the existing functionality for customer, account level offers
- Add the new household level offers/orders functionality to the existing system.
- Design and development of Utilities.
- Creation of test scripts and unit/integration tests for the new as well as existing functionality.
- Support User Acceptance test
Environment: MainframeSkills and tools: VS-Cobol-II, JCL, DB2, TSO, CICS, SDF2, XPEDITOR, START TOOLTri Tune, Relational Tools, BMC Catalog, TOAD, Changeman, MQ
Confidential, Denver, CO
Project Lead
Environment: MainframeSkills and tools: VS-Cobol-II, JCL, DB2, TSO, CICS, SDF2, XPEDITOR, START TOOLTri Tune, Relational Tools, BMC Catalog, TOAD, Changeman, MQ
Responsibilities:
- Reviewing function specs/design document with the client
- Documenting the changes required.
- Implement the changes, preparation of test data and testing.
- Analysis of change request/Issue reported by the users.
- Analyze the existing functionality for customer, account level offers
- Add the new household level offers/orders functionality to the existing system.
- Design and development of Utilities.
- Creation of test scripts and unit/integration tests for the new as well as existing functionality.
- Support User Acceptance test
Confidential, Denver, CO
Project Lead
Responsibilities:
- Preparing External Design doc with business requirement.
- Reviewing function specs/design document with the client
- Documenting the changes required.
- Co ordination with offshore team during implementation.
- Implement the changes, preparation of test data and testing.
- Analysis of change request/Issue reported by the users.
- Analyze the existing functionality for customer, account level offers
- Add the new household level offers/orders functionality to the existing system.
- Design and development of Utilities.
- Creation of test scripts and unit/integration tests for the new as well as existing functionality.
Environment: Mainframe Skills and tools: VS-Cobol-II, JCL, DB2, TSO, CICS, SDF2, XPEDITOR, START TOOLTri Tune, Relational Tools, BMC Catalog, TOAD, Changeman, MQ
Confidential, San Francisco, CA
Project Lead
Responsibilities:
- Reviewing function specs/design document with the client
- Documenting the changes required.
- Implement the changes, preparation of test data and testing.
- Analysis of change request/Issue reported by the users.
- Analyze the existing functionality for customer, account level offers
- Add the new household level offers/orders functionality to the existing system.
- Design and development of Utilities.
- Creation of test scripts and unit/integration tests for the new as well as existing functionality.
Environment: MainframenSkills and tools: VS-Cobol-II, JCL, DB2, TSO, CICS, SDF2, XPEDITOR, START TOOLTri Tune, Relational Tools, BMC Catalog, TOAD, Changeman, MQ
Confidential, San Francisco, CA
Project Lead
Responsibilities:
- Reviewing function specs/design document with the client
- Documenting the changes required.
- Implement the changes, preparation of test data and testing.
- Analysis of change request/Issue reported by the users.
- Analyze the existing functionality for customer, account level offers
- Add the new household level offers/orders functionality to the existing system.
- Design and development of Utilities.
- Creation of test scripts and unit/integration tests for the new as well as existing functionality.
Environment: MainframenSkills and tools: VS-Cobol-II, JCL, DB2, TSO, CICS, SDF2, XPEDITOR, START TOOLTri Tune, Relational Tools, BMC Catalog, TOAD, Changeman, MQ
Confidential, San Francisco, CA
Sr. Programmer / Module Lead
Responsibilities:
- Reviewing function specs/design document with the client
- Documenting the changes required and communicates to PL.
- Implement the changes, preparation of test data and testing.
- Analysis of change request/Issue reported by the users
Environment: MainframenSkills and tools: VS-Cobol-II, JCL, DB2, TSO, CICS, SDF2, XPEDITOR, START TOOLTri Tune, Relational Tools, BMC Catalog, TOAD, Changeman, MQ
Confidential, San Francisco, CA
Sr. Programmer / Module Lead
Responsibilities:
- Played key role in designing and implementing Batch programs
- Interacting with Business analyst to clarify issues/doubts
- Implement the changes, preparation of test data and testing.
Environment: MainframenSkills and tools: VS-Cobol-II, JCL, DB2, TSO, CICS, SDF2, XPEDITOR, START TOOLTri Tune, Relational Tools, BMC Catalog, TOAD, Changeman, MQ
Confidential, San Francisco, CA
Responsibilities:
- Played key role in designing and implementing Batch and Online programs.
- Preparing function spec based on the given Technical specs for 3 drive programs and 2 APIs.
- Developed and tested 2 batch processes and worked with another developer in developing few online processes. The development included coding and testing of all required JCLs, PROCs, Control Cards, Copybooks and APIs.
- Reviewing function specs developed by other team members.
- Reviewed code of critical batch and 4 online programs of other developers.
- Painting CICS maps using GTB.
- Preparing, test cases, test date and reviewing test scripts.
- Reviewing/testing code developed by team.
- Bug fixing.
Confidential
Responsibilities:
- Analyzing the function spec and programs to develop new programs
- Testing the 12 programs and helping other team members to test their programs.
- Co-coordinating with QA team to get programs certified.
- Reviewing the code written by team.
- Resolve issues/problems faced by the team.
- Issue fixing.
Confidential
Responsibilities:
- Customer privacy s. It provides the following functionality.