Etl Developer Resume
New York City, NY
SUMMARY
- 7 plus years of experience in design, development, implementation and production support of business applications with Data Warehouse and Client - Server Applications on Windows and UNIX platforms using ETL tool IBM Information Server (Data Stage) 8.1, 8.7 and 9.1 versions.
- Extensively used Data Stage Client tools - Data Stage Designer, Data Stage Director, and Data Stage Administrator.
- Extensively used ETL methodology for Data Extraction, Transformation & Loading of ODS & EDW using Data Stage parallel jobs.
- Involved in various phases of SDLC and worked in both Waterfall and Agile processes of Software projects.
- Involved in design and development of Star and Snow-flake schemas and jobs between sources and operational staging targets by identifying suitable Fact and Dimension tables for different schemas.
- Good Knowledge in Data Warehousing Concepts with emphasis on ETL including Requirement Analysis, Design, Data Analysis, Development, Data Migration, Testing, Implementation, Deployment and Support.
- Good understanding on Conceptual, Logical and Physical Data Models.
- Created mapping documents for understanding of derivations and business rules to be used in ETL process from source to target.
- Experience in using various parallel processing stages like Lookup, Join, Merge, Aggregator, Sort, Remove duplicates, Funnel, Transformer, CDC etc by applying various partition techniques.
- Hands on experience in writing UNIX shell scripts to automate file manipulation and triggering DS jobs.
- Good knowledge on SQL DDL and DML commands. Experience in writing SQL queries using Joins, Indexes, Views, Triggers.
- Experience in testing the applications following STLC by using Quality Center in HP ALM.
- Highly motivated individual with excellent communication skills, analytical and problem solving skills.
- Very good team player with willing to adapt and take up new challenges.
TECHNICAL SKILLS
ETL Tool: Data Stage 8.1, 8.7 and 9.1 (Designer, Director, Administrator)
Business Analysis: Business Requirements Gathering, Functional Requirements gathering, Process Flow Diagrams, Data Flow Diagrams, Requirements Analysis, Data Analysis
Dimensional Data Modeling/ Tools: ERWIN 4.5/4.0, Oracle Designer, Visio, Star Schema Modeling, Snowflake schema Modeling, Physical and Logical Data Modeling, FACT and DIMENSION tables
Reporting Tools: Cognos 7.0/6.0, Business Objects 5.1, SQL * Plus, OBIEE
Databases: Oracle 10g/9i/8i, IBM DB2 8.0/7.0, MS SQL server 2008/2005, Netezza 6.0, Teradata V2R5/V2R4/V2R3, MS Access
Operating Systems: Win 2000, Win XP. MS-Dos, UNIX, LINUX
Programming languages: SQL, PL/SQL, UNIX/LINUX Shell Scripting, JAVA
Scheduling Tools: Autosys, Control M
Other Tools: HP ALM, Visual Basic, TOAD, SQL Developer, Share Point, Test Director
PROFESSIONAL EXPERIENCE
Confidential, Charlotte, NC
Data stage Developer
Responsibilities:
- Involved in Business meetings to understand the business requirement specifications. Gathering the requirements by working with Business users and different IT groups.
- Participated in the review and approval of the technical document used to design and build the ETL modules in Data Stage Designer.
- Analyzed, designed, developed, implemented and maintained moderate to complex initial load and incremental load jobs to provide data to staging, ODS, dimensions and facts.
- Developed and implemented strategies for Slowly Changing Dimensions 1 & 2, and Surrogate Key generation for incremental data loading.
- Worked on Data stage client tools - Designer, Director and Administrator. Used Data Stage Designer to develop processes for extracting, cleansing, transforming, integrating and loading data into Data warehouse.
- Designed and developed jobs in IBM Web sphere Enterprise Edition 8.1 using different stages like Transformer, Aggregator, Lookup, Merge, Join, Remove Duplicate, Funnel, Sort, Change Data Capture, Sequential File, Complex Flat file, Surrogate Key and ODBC.
- Created Stage variables and Constraints in Transformer to filter source data.
- Created custom Routines in Data Stage to use within the jobs. Few of them are Converting date formats, replacing a null value with a default.
- Used extensively Reject Link, Job Parameters, and Stage Variables, parameter sets in developing jobs.
- Used various partitioning Techniques in various stages to gain best performance on jobs.
- Developed Sequence jobs to process jobs in Sequence. Used different stages like Job Activity, Email Notification, and wait for File activities to control and execute Data Stage Parallel jobs.
- Used Data stage Director for job logs, error messages.
- Written SQL procedures to facilitate coding.
- Developed Unix Shell Scripts to improve the performance of the jobs and also used these scripts to automate the Data Load processes to the target Data warehouse.
- Developed Analysis documents, Test Plan and Test results for all the development jobs, issues and logged them into the Share point.
- Analyzing data issues in the load and providing the solution for the issues, discussing with the data owners and creating DS jobs to correct the data.
- Developed Reject processing in all the jobs and balancing the data between Source and Target and sending mails accordingly.
- Involved in Migration and implementation of data stage code from development to Test and Production Environment.
- Performed exception handling by reporting erroneous data back to source.
Environment: IBM Web sphere Datastage 9.1 (Designer, Director and Administrator), Oracle 11g, DB2, SQL, Linux, and Autosys, Share point and Toad.
Confidential, Charlotte, NC
Data stage Developer
Responsibilities:
- Gathering the requirements by working with Business users and different IT groups.
- Analyzed, designed, developed, implemented and maintained moderate to complex initial load and incremental load jobs to provide data to 3NF.
- Worked on Datastage client tools - Designer, Director and Administrator.
- Created jobs and sequences to extract subscriber, device, division, advertisement, advertiser, adzone, and geography, program tuning data, ad tuning data and video on demand data with applying various business rules.
- Developed jobs in Designer using different stages like Transformer, Aggregator, Lookup, Merge, Join, Remove Duplicate, Funnel, Sort, Change Data Capture, Sequential File, Complex Flat file and ODBC.
- Generated Surrogate Key while loading data into data warehouse.
- Used merge statements for tuning jobs.
- Hands on experience in writing SQL procedures as needed.
- Developed Unix Scripts to run multiple Data Stage jobs in sequence, parallel and to control the dependencies at every stage.
- Created custom Routines in Data Stage to use within the jobs. Few of them are Converting date formats, replacing a null value with a default.
- Used extensively Reject Link, Job Parameters, Stage Variables, parameter sets in developing jobs.
- Created Data analysis reports for business.
- Analyzing data issues in the load and providing the solution for the issues, discussing with the data owners and creating DS jobs to correct the data.
- Developed Analysis documents, Test Plan and Test results for all the development jobs and Data issues and logged them into HP ALM.
- Developed Reject processing in all the jobs and balancing the data between Source and Target and sending mails accordingly.
Environment: IBM Web sphere Datastage 8.7 (Designer, Director and Administrator), Oracle 10g, Linux, HP-Unix, and Korn Shell scripts, Netezza 5.1/6.0, HP ALM and Toad.
Confidential, New York City, NY
ETL Developer
Responsibilities:
- Gathering the requirements by working with Business users and different IT groups.
- Analyzed, designed, developed, implemented and maintained moderate to complex initial load and incremental load jobs to provide data to ODS.
- Worked on Data stage client tools - Designer, Director and Administrator.
- Created jobs and sequences to extract allowances, benefits, brokers, claims, members, providers and employee group data with applying various business rules.
- Extensively used the Change Data Capture stage.
- Developed jobs in IBM Web sphere Enterprise Edition 8.1 using different stages like Transformer, Aggregator, Lookup, Merge, Join, Remove Duplicate, Funnel, Sort, Change Data Capture, Sequential File, Complex Flat file, ODBC and DB2.
- Developed Unix Scripts to run multiple Data Stage jobs in sequence, parallel and to control the dependencies at every stage.
- Created custom Routines in Data Stage to use within the jobs.
- Used extensively Reject Link, Job Parameters, Stage Variables, parameter sets in developing jobs.
- Analyzing data issues in the load and providing the solution for the issues, discussing with the data owners and creating DS jobs to correct the data.
- Developed Reject processing in all the jobs and balancing the data between Source and Target and sending mails accordingly.
Environment: IBM Web sphere Data stage 8.1 (Designer, Director and Administrator), Oracle 11.1, HP-UX B.11.31, Shell scripts, Mainframes, Toad, Java
Confidential, Auburn Hills, MI
Jr. Data stage Developer
Responsibilities:
- Involved in understanding the scope of application, present schema, data model and defining relationship within and between groups of data.
- Participated in design and development of Star and Snow-flake schema database and jobs between sources and operational staging targets by identifying suitable Fact and Dimensional tables for the schema.
- Extensively used Data stage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into the Data Warehouse database.
- Worked extensively on different types of stages like Aggregator, Merge, Join, Funnel, Lookup, Remove Duplicates, Transformer, Copy, Filter and Modify etc.
- Generated Surrogate Keys for composite attributes while loading the data into Data Warehouse.
- Created user defined transforms and routines for handling special cases.
- Extensively used SQL and PL/SQL coding in Data stage jobs for processing data.
- Developed batches and sequencers in designer to run and control set of jobs.
- Used the Data stage Director and its run-time engine to schedule running the job, testing and debugging its components, and monitoring the resulting executable versions.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements.
- Created test cycles, automated tests, test cases with help of test director.
- Handled all the defects through Test Director database.
- Developed UNIX shell scripts to automate file manipulation and data loading procedures
Environment: Data stage 8.1 (Designer, Director and Administrator) Director, SQL, PL/SQL, Business Objects 6.5 (Supervisor, Designer, BO reporter, BCA), ERwin 4.1, Oracle 10g, DB2 UDB, Mainframes, Teradata V2R5, Test Director, WinSQL, Win 2000.
Confidential, Richardson, TX
Jr. Quality Analyst
Responsibilities:
- Worked with Business clients to understand business requirements in order to transform business requirements into effective technology solutions.
- Worked closely with Sr. Architects and Developers to develop standards to ensure the development of re-usable objects.
- Involved in Analysis, Development, Testing and implementation of various ETL jobs.
- Prepared test cases, tested the data and obtained user sign-off before moving the Data Stage jobs into system test and to Production.
- Coordinated and communicated tasks with peers.
- Ensure that the development is performed as per the functional requirements.
Environment: Data Stage 8.1, Unix, SQL, Toad.