Sr. Big Data Developer Resume

SUMMARY

I have 15 years of progressive experience in Consulting, designing and development of Data Warehousing and ETL projects using Big Data, IBM DataStage, Teradata and Oracle technologies in Banking and Telecom domain having worked in multiple geographies like Canada, UK and India.
Expertise in working on complex ETL systems using DataStage V11.5, 8.5 and 7.5. Exposure to other ETL tools like Informatica and Talend.
Experience with Teradata Tools and Utilities like FastLoad, Multiload and BTEQ
Strong experience in Big Data technologies - HDFS, Yarn, Spark, Hive and Scala.
Knowledge of different data modeling techniques such as star and snowflake schema.
Exposure to NoSQL database like Hbase, Cassandra and Python.
Well versed with performance tuning of DataStage, Hive and Spark.
Extensive work experience in Unix shell scripting. Conversant in mainframe JCL, Endeavor, Zeke, ISPF and OnDemand.
Established ETL framework in IBM DataStage and Unix.
Strong experience in creating project documents like High Level Design, Technical Designs, ETL standards, Coding Checklist, Deployment Plans, Support Guides and User Manuals
Worked on diverse types of SDLC models such as Agile and Waterfall.
Experience in effort estimation and resource planning.
Experience in working with End users and Business analysts to gather requirements.
Strong business knowledge of Banking and Telecommunication domain.
Teradata12 Certified Technical specialist
Excellent interpersonal communication skills.

TECHNICAL SKILLS

PROFESSIONAL EXPERIENCE

Sr. Big Data Developer

Confidential

Responsibilities:

Requirement gathering and analysis.
Designing and solutioning in Big Data.
Worked extensively on performance testing of Hive and Yarn.
Used different performance enhancement techniques in hive such as partitioning and bloom filter.
Code development in Hive and Unix shell scripting for loading Terabytes of data on daily basis.
Created POC using Cassandra, Hbase and Hive for feasibility testing to help choose the right technology.

Sr. Big Data Developer

Confidential

Responsibilities:

Developed code in Hive, Scala on Spark. Used Eclipse as IDE
Co-ordinate with business for requirement gathering and clarifications to extract required data from source and load it to datamart.
Discussions with client architects to provide design options.
Creation of design documents and implementation plans.
Worked extensively on Unix shell scripting and scheduling to load data from different resources.
Supporting UAT, Code deployment to production.

Sr DataStage Developer

Confidential

Responsibilities:

Co-ordinated with business for requirement gathering via discussions, workshops, walkthrough meetings and prototyping.
Worked closely with data modelers, BA and DBA to enhance and stabilize the data models.
Extensively worked with hierarchical stage of DataStage to parse XML and Json files.
Use DataStage to load data into Netezza. worked with various Sequences, Transformer, filter, Pivot and aggregator etc.
Interacting with various SBI client stakeholders for data requirements.
Preparation of ETL coding standards, review checklists and generic framework
Analyzing ETL mapping documents and come up with High Level design to pass on to developers
DataStage job build, review, SIT/UAT deployment and support
Preparing Production Implementation plan and presenting in CAB meetings
Effort estimation, Resource allocation and management, Creation of Work Breakdown Structure
Daily status reporting and Project monitoring report.
Worked with Data modeler and provided input during the evolution of the data models.
Worked closely with reporting and analytics team to understand their requirement and provide data accordingly.

Senior DataStage Developer

Confidential

Responsibilities:

Active participation in requirement gathering.
Creation of DataStage jobs and Sequences using various stages to extract data from heterogeneous sources and load them into Teradata.
Worked with complex flat files to load data into Teradata.
Developed code for loading data into Teradata using Multiload, FastLoad and BTEQ.
Developed jobs using Td connector, Complex flat file, transformer, join and sort stages etc.
DataStage parallel job/ Shared container creation, re-use of existing components
Developed DataStage jobs to cater the complex business requirement and data validations.
Creating Teradata SQLs, JCLs for running DataStage jobs for data file movement and archival.
Supporting QA and UAT activities.
Raising Activity Record in HPSM 9 system for code implementation in production
Creation of Work Breakdown Structure for the team, leaves and overall team management
Creation of design documents, walkthrough with leads and getting approvals
Daily team status collection and weekly project status reporting
Performance assessment of Team members.
Created deployment and scheduling plan of hundreds of jobs by creating appropriate dependency.

Senior DataStage Developer

Confidential

Responsibilities:

Worked as an Individual contributor.
Creation/Modification of DataStage jobs and sequences using various stages.
Co-ordinate with business for requirement gathering.
In depth Impact analysis of Mainframe and DataStage code.
Carefully crafted the deployment plans so as not to impact existing functionalities.
Preparation and modification of Low Level Design documents.
Creation/Modification of JCLs
Supporting QA and UAT activities
Raising Activity Record in HPSM 9 system for code implementation in production

DataStage Developer

Confidential

Responsibilities:

Co-ordinated an offshore team of 3 from Bradford for development.
Assigning daily work to offshore team and conducting stand up meetings to monitor progress.
Interaction with client for requirement gathering.
Analysis, design, build and testing of the artifacts.
Development of Parallel Jobs and sequences in DataStage using various stages like Transformer, complex flat file, XML stage, looping etc.
Worked extensively on sequences so as to create dependencies on jobs, passing parameters to the jobs from external parameter file and looping.
Writing Unix Shell scripts.
DataStage Administrative tasks such as creating configuration file, creation of database connections and migration of code across Dev, Test environments, unlocking and releasing jobs. Resolution of production issues within SLA.
Analyzed production issues and implemented permanent fixes thereby saving significant amount of effort and cost. Created issue repository for support team.
Creation of weekly production support status report.

Oracle DBA

Confidential

Responsibilities:

Development, System test and UAT schema and database creation.
Writing scripts for deployment of Oracle PL/SQL components, Tables and Indexes in production.
Hands on experience on performance tuning.
Code promotion between different environments.