Senior Data Stage Developer Resume
Kansas City, MO
SUMMARY
- Extensive ETL tool experience using Confidential Infosphere/Websphere Datastage, Ascential Datastage and SSIS. Worked on Datastage client tools like Datastage Designer, Datastage Director and Datastage Administrator.
- Good Knowledge about the principles of DW like Data marts, OLTP, OLAP, Dimensional Modeling, fact tables, dimension tables and star/snowflake schema modeling.
- Excellent in using highly scalable parallel processing infrastructure using parallel jobs with multi - node configuration files.
- Experienced in scheduling sequence, parallel and server jobs using DataStage Director, UNIX scripts and scheduling tools.
- Designed and developed parallel jobs, server and sequence jobs using Datastage Designer.
- Experience in using different types of stages like Transformer, Aggregator, Merge, Join, Lookup, Sort, Remove duplicate, Funnel, Filter, Pivot, Shared containers for developing jobs.
- Worked and extracted data from various data sources such as Oracle, MS-SQL Server, MS- Access, Teradata, DB2, XML and Flat files.
- Knowledge in using PL/SQL to write stored procedures, functions, and triggers.
- Extensive experience in Unit Testing, Functional Testing, System Testing, Integration Testing, Regression Testing, User Acceptance Testing and Performance Testing.
- Created local and shared containers to facilitate ease and reuse of jobs.
- Proven track record in addressing production issues like performance tuning, enhancement, data, environment and memory issues.
- Imported the required Metadata from heterogeneous sources at the project level.
- Knowledge in using Erwin as leading Data modeling tool for logical (LDM) and physical data model (PDM).
- Knowledge in Reporting Tool such as Cognos.
- Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
- Experience in Production Support, extensively worked on production support issues.
- Good Knowledge on Business Intelligence Development studio.
- Extensively used BI Integration Services to design ETL process and BI Analysis Services to create cubes.
- Quick learner and adaptive to new and challenging technological environments.
- Project Management experience with excellent problem-solving, organization and leadership skills.
- Worked on SSIS and SSRS.
TECHNICAL SKILLS
ETL Tools: IBM InfoSphere / WebSphere Datastage 8.5/8.1/ 7.5.2/7.1 (Administrator, Manager, Designer, Director, Orchestrate, Information Analyzer, Quality Stage)
Operating Systems: IBM AIX 4.3 and Windows NT 4.0/2000/2003/ xp windows 7.
Languages: PL/SQL, C/C++, UNIX (AIX, HP-UX) Shell scripting, Java.
Database: Oracle 11g/10g/9i/8i/, SQL Server 2000/2005/2008 , Teradata, UDB/DB2 on AIX.
Other: Cyber fusion, SQL Assistant, Pattern Action Language (PAL), Perl scripting, Autosys, SAP MDM 5.5/7.1, Management console, DataStageTrouble shooting, Data Issue resolution, batch monitoring, skill set.
PROFESSIONAL EXPERIENCE
Confidential, Kansas City, MO
Senior Data Stage Developer
Responsibilities:
- The Project goal is to load the Members related data for various Applications into the DB2 Enterprise Data Warehouse and MS SQL Server. This involved in pulling data from various source systems like Flat Files, Oracle, DB2 and Sybase and loading the target Identity Access Management Database Tables.
- The main purpose of the project was to build integrated reporting of health and care management including integrated, web-based, on demand reporting capabilities for employers as well as internal consulting staff thereby improving customer access to clinical and financial data to help.
- Worked with Provider, Claims, . Member Risk, Products, Audit and
- Capitation modules under the HIPAA.
- Worked on more than 8 waves among 24 and involved in migration from server jobs to parallel, Involved in designing the simple to complex Data Stage jobs.
- Involved in building the base fact tables, aggregate fact tables, dimension tables, Data mart tables, change requests and defect issues related to the Data Warehouse project.
- Involved in the technical development delivery strategy packages that include technical design, development and testing phase.
- Effectively used DataStage Manager to Import/Export projects from development server to production server and implemented Slowly Changing Dimension techniques.
- Coordinated K tables with dba for each wave in devl, test, prod and monitored common routines list and priority, providing specifications.
- Created and executed SQL queries for validating transformation rules used in source to target mappings. Worked on SQL/PLSQL queries for extraction of data.
- Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on an ad hoc or scheduled basis.
- Developed Job Sequences, job activities, execute commands, user variable activity and implemented logics for job sequence loops, recovery and restart.
- Performed the unit testing using MS Access and extensively used Daptiv for defects management.
- Identified performance bottlenecks and suggested improvements.
Confidential, Jersey City, NJ
Data Stage Developer
Responsibilities:
- Involved in the Analysis of the functional side of the project by interacting with functional experts to design and write technical specifications.
- Data base design & data model - Logical & Physical design.
- Worked on the Architecture of ETL process.
- Created Data stage jobs (ETL Process) for populating the data into the Data warehouse constantly from different source systems like ODS, flat files, scheduled the same using Data Stage Sequencer for SI testing.
- Extracted data from sources like Oracle and Flat Files.
- Preparing development timing plans & reporting to senior management about the supplier progress system & ensuring their engineering support for onsite integration & production launch.
- Developed technical infrastructure designs, data mappings, flows and report dissemination mechanisms by architecting Data Warehouses and Marts.
- Collaborated in Extraction of OLAP data from SSAS using SSIS
- Worked on Data Stage 8.x parallel version.
- Designed and developed parallel jobs, server and sequence jobs using Datastage Designer.
- Experience in using different types of stages like Transformer, Aggregator, Merge, Join, Lookup, Sort, Remove duplicate, Funnel, Filter, Pivot, Shared containers for developing jobs.
- Developed various bulkload and update procedures and processes using SQL * Loader and PL/SQL.
- Working in a team with other associate product & component developers.
- Involved in Unit Testing and Integration Testing to test jobs and also the flow.
- Worked on changed requests as per clients and projects technical specification needs.
- Awareness about the functional/business aspects for the components.
- Automated process of job monitoring which helped in minimizing the manual intervention & documenting them perfectly.
- Provide support for monthly/weekly batches in production run.
- Involved in the Documentation of the ETL phase of the project.
- Developed the reusable components, best practices that were later on used in other Data warehouse.
- Documenting business process, lesson learnt & best practices for the project.
Confidential, Marietta, GA
Data Stage Developer
Responsibilities:
- Extensively used DataStage for extracting, transforming and loading databases from sources including Oracle, DB2 and Flat files.
- Collaborated with EDW team in, High Level design documents for extract, transform, validate and load ETL process data dictionaries, Metadata descriptions, file layouts and flow diagrams.
- Collaborated with EDW team in, Low Level design document for mapping the files from source to target and implementing business logic.
- Generation of Surrogate Keys for the dimensions and fact tables for indexing and faster access of data in Data Warehouse.
- Tuned transformations and jobs for Performance Enhancement.
- Extracted data from flat files and then transformed according to the requirement and Loaded into target tables using various stages like sequential file, Look up, Aggregator, Transformer, Join, Remove Duplicates, Change capture data, Sort, Column generators, Funnel and Oracle Enterprise.
- Created Batches (DS job controls) and Sequences to control set of jobs.
- Extensively used DataStage Change Data Capture for DB2 and Oracle files and employed change capture stage in parallel jobs.
- Executed Pre and Post session commands on Source and Target database using Shell scripting.
- Collaborated in design testing using HP Quality Center.
- Extensively worked on Job Sequences to Control the Execution of the job flow using various Activities & Triggers (Conditional and Unconditional) like Job Activity, Wait for file, Email Notification, Sequencer, Exception handler activity and Execute Command.
- Collaborated in Extraction of OLAP data from SSAS using SSIS.
- Extensively usedSAP R/3 and SAP BW packs
- Collaborated with BI and BO teams to find how reports are affected by a change to the corporate data model.
- Collaborated with BO teams in designing dashboards and scorecards for Analysis and Tracking of key business metrics and goals.
- Utilized Parallelism through different partition methods to optimize performance in a large database environment.
- Designed and developed parallel jobs, server and sequence jobs using Datastage Designer.
- Developed DS jobs to populate the data into staging and Data Mart.
- Executed jobs through sequencer for better performance and easy maintenance.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements.
- Developed UNIX shell scripts to automate file manipulation and data loading procedures.
- Scheduled the jobs using AutoSys, Tivoli and Corntab.
- Collaborated in developing Java Custom Objects to derive the data using Java API.
- Responsible for daily verification that all scripts, downloads, and file copies were executed as planned, troubleshooting any steps that failed, and providing both immediate and long-term problem resolution.
- Provided technical assistance and support to IT analysts and business community.
Confidential, Detroit, MI
Data Stage Developer/ Consultant
Responsibilities:
- Designed the ETL jobs using Confidential Infosphere DataStage 8.5 to Extract, Transform and load the data into staging, ODS and EDW.
- Designed and developed the ETL jobs using Parallel Edition, which distributed the incoming data concurrently across all the processors, to achieve the best performance.
- Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture ( Confidential ), Modify, Row Generator and Aggregator.
- Responsible for generation of DDL statements, which are executed, for database creation.
- Responsible for preparing Physical/logical data models.
- Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
- Created and managed database objects including tables, indexes and procedures.
- Handled Performance Tuning of Jobs to ensure faster Data Loads.
- Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
- Performed the Integration and System testing on the ETL jobs.
- Responsible for preparing ad hoc jobs.
- Translated business rules and functionality requirements into ETL derivations.
- Scheduled jobs using Autosys scheduler utility based on the requirements and monitored the production processes closely for any possible errors.
- Migrated projects from development to QA to Production environments.
- Assisted operation support team for transactional data loads in developing SQL & UNIX scripts.
- Imported the required Metadata from heterogeneous sources at the process level.
- Created Job Parameters and Environment variables to run the same job for different sources and targets.
- Used Multi-job-compiler during deployment of projects.
- Created Batches (DS job controls) and Sequences to control set of jobs.
- Used the Director to schedule running the job, testing and debugging its components, and monitoring.
- Created Shared Containers for Re-using the Business functionality.
- Collaborated with BO team to design Crystal reporting and reports for enterprise reporting applications.
- Worked with Developers to troubleshoot and resolve issues in job logic as well as performance.
Confidential, St. Louis, MO
Data stage developer
Responsibilities:
- Involved in the Analysis of the functional side of the project by interacting with functional experts to design and write technical specifications.
- Data base design & data model - Logical & Physical design.
- Worked on the Architecture of ETL process.
- Created Data stage jobs (ETL Process) for populating the data into the Data warehouse constantly from different source systems like ODS, flat files, scheduled the same using Data Stage Sequencer for SI testing.
- Obtaining productive gains during vehicle life to meet aggressive cost reduction target.
- Extracted data from sources like Oracle and Flat Files.
- Preparing development timing plans & reporting to senior management about the supplier progress system & ensuring their engineering support for onsite integration & production launch.
- Working in a team with other associate product & component developers.
- Involved in Unit Testing and Integration Testing to test jobs and also the flow.
- Worked on changed requests as per clients and projects technical specification needs.
- Awareness about the functional/business aspects for the components.
- Automated process of job monitoring which helped in minimizing the manual intervention & documenting them perfectly.
- Provide support for monthly/weekly batches in production run.
- Involved in the Documentation of the ETL phase of the project.
- Developed the reusable components, best practices that were later on used in other Data warehouse.
- Documenting business process, lesson learnt & best practices for the project
Confidential
Data stage developer
Responsibilities:
- Followed all the CMM Quality process.
- Data Analysis, to study the data base data that is required for the different source system.
- Data model review with the client, because the model was given by the client.
- Erwin was used to create the Logical and physical data model
- Involved in understanding the scope of application, which was already implemented, and for new development.
- Involved in the Architecture review.
- Involved in the high level design (ETL design Plan) & low level design (Mapping Docs).
- Used Data Stage designer to create mappings to load various dimensions that include Products, Product Categories, Coverage Type, Coverage Level, and Risk Level Dimensions.
- Involved in Creating Jobs, Hash files, sort, and transformer, Lookups, Run, and Monitor Using the Data Stage director.
- Used XML Input stage for the extracting the data and XML transformer to load the data to the staging area.
- Used Version Control to backup the source code.
- Quality Stage was used to standardize/integrate the data from different sources.
- Reviewing the Report design and improving the query for the performance.
- Used the Broadcast agent to broadcast the report.
- Used Control M for scheduling the jobs.
- Unit testing of the Jobs developed.
- Use Quality stage to Standardize match and correct the data.
- Coordinating with all onsite technical professionals and Project Manager.
Confidential
Data Warehouse Consultant
Responsibilities:
- Analyzed, conceptualized/designed the database that serves the purpose of proving critical business metrics.
- Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy, translates business rules and functionality requirements into ETL procedures using Informatica - PowerMart.
- Worked with ERwin tool in Data Modeling (both Physical and Logical Design).
- Developed and documented data Mappings/Transformations, Audit procedures andInformatica sessions.
- Assisted in the design and Maintenance of the Metadata environment.
- Developed and tested all the backend programs, Informatica mappings and update processes.
- Effectively managed the migration of the transformations/mappings from development to Production.
- Developed various bulkload and update procedures and processes using SQL * Loader and PL/SQL.
- Involved in the error checking and testing of the ETL procedures and programs of Informatica session log.