Etl Developer Resume
Chicago Etl Designer Developer, NY
SUMMARY
- Over 6 years of experience in IT industry as a Datastage designer using IBM Web sphere DataStage 8.x/7.x/6.x in Insurance, Health Care, Finance and Retail Industries.
- Excellent experience in designing and developing jobs using DataStage Designer, DataStage Manager, and DataStage Director on Server Engine.
- Experienced in using highly scalable parallel processing infrastructure using Datastage Enterprise Edition (PX).
- Proficient in using Parallel Extender, developing Parallel jobs using Stages, which includes Aggregator, Join, Transformer, Sort, Merge, Filter and Lookup.
- Used datastage RTI stages like XML Input/Output
- Used Data Stage Manager for importing metadata from repository, new job categories and creating new data elements.
- Proficient in working with Oracle, Access, SQL Server, and DB2 Databases.
- Extensive experience working with Oracle 9i/10g
- Extensive experience working with Data Marts and Data Warehouses.
- Strong experience working with Datastage plug - in stages like Oracle OCI stage, Oracle bulk loader stages in IBM Datastage 8.x/7.x/6.x.
- Expert at studying the data dependencies using metadata of DataStage and preparing job sequences for the existing jobs to facilitate scheduling of multiple jobs.
- Worked on DataStage production job scheduling process using the Autosys datastage scheduler.
- Strong in writing UNIX shell scripts for Data validations, Data cleansing etc.
- Worked on all the stages of Software Development Life Cycle of datawarehouse
- Worked with PL/SQL concepts like Stored Procedures, Packages..
- Skilled in writing technical specification documents, translating user requirements to technical specifications.
- Highly organized, detail-oriented professional with strong Technical and Communication skills.
TECHNICAL SKILLS
ETL Tools: IBM InfoSphere Information Server 8.x, IBM WebSphere DataStage 8.x ( Designer, Director) with Quality Stage, Ascential Datastage 7.x/6.x (Manager, Designer, Director)
Data Modeling Tools: Microsoft Visio, Erwin 4.0
Databases and Related Tools: Oracle 9i/10g, DB2 9.0/8.0, SQL Server 2008/2005/2000 , Sql Developer, Developer 2000, Oracle Forms 6i/9i/10g, SQL Loader, TOAD
Operating Systems: UNIX, Linux, Windows 9x/NT/ Win2000
Scheduling Tool: Autosys
Languages: SQL, PL/SQL, C, Visual Basic, UNIX Shell Scripting (Bash Shell), HTML, XML
Packages: MS-Access, MS Excel, MS Word, HP Quality Centre, IBM Lotus Notes
PROFESSIONAL EXPERIENCE:
Confidential, Chicago
ETL Developer
Responsibilities:
- Primarily worked on the project of code from PaymentNet 3 environment to PaymentNet4 environment
- Worked in the area of credit card processing, providing processed data to clients in the form of Flat files
- Understood the Functional Documents and developed new Datastage jobs
- Extracted data from Oracle Database and loaded into Flat Files
- Used Data Stage Enterprise Edition/Parallel Extender stages namely Oracle Enterprise stage, Datasets, Sort, Lookup, Join, Peek, Row Generator stages, Remove Duplicates, Transformer, Aggregator, Funnel, Sequencer Stages like Job Activity Stage, Executed Command Stage, Nested Condition Stage, User Variables Activity Stage, Terminate Activity Stage.
- Unit - tested the newly developed jobs, and documented the test cases and test results in HP Quality Centre
- Wrote Unix scripts for running the Datastage jobs
- Undertook Change and Enhancements request
- Tuned DataStage jobs to enhance their performance.
- Used the DataStage Director to schedule running the solution, testing debugging and monitoring the resulting executable versions.
- Co-ordinated the deployments of code across UAT, Test and production environments with the deployment teams.
- Involved in triaging of defects of the deployed code across UAT, Test and production environments with the deployment teams.
- Wrote Release notes, Deployment documents
Confidential, Chicago
ETL Designer/Developer
Responsibilities:
- Primarily worked on the One Confidential Project aimed at integrating services across various countries onto a single platform.
- Worked in the area of Credit Processing Transaction and ACH transaction.
- Understood functional documents of existing systems and applications and defined the functional, mapping documents for the new functional requirements.
- Documented Test Cases in the HP Quality Centre
- Understood the design of existing datastage jobs and came up with a method of modifying the existing design to reflect the requirement of deleting some intermediate tables
- Extracted data from Flat Files, DB2 and loaded into the target DB2 Database.
- Developed new datastage jobs and unit - tested the newly developed jobs, and documented the test cases and test results in HP Quality Centre
- Used Data Stage Enterprise Edition/Parallel Extender stages namely DB2 Enterprise stage, Datasets, Sort, Lookup, Peek, Row Generator stages, Remove Duplicates, Filter, External Filter, Aggregator, Funnel.
- Used datastage RTI stages like XML Input/Output
- Undertook Change and Enhancements request
- Tuned DataStage jobs to enhance their performance.
- Used the DataStage Director to schedule running the solution, testing debugging and monitoring the resulting executable versions.
- Wrote Release notes, Deployment documents and scheduled the jobs
Confidential, NY
Lead ETL Designer/Developer
Responsibilities:
- Primarily worked on the conversion of the existing jobs in DataStage Version 7.5.1 to DataStage Version 8.0 and in corporation of data from new business acquisitions into the DWH.
- Understood functional documents for new business source systems and applications and their integration into the existing DWH.
- Defined the Mapping and Test Case documents.
- Extracted the source data from Oracle tables, MS SQL Server, sequential files and excel sheets.
- Designed DataStage ETL jobs for extracting data from heterogeneous source systems, transform and finally load into the Teradata data marts.
- Migrated existing jobs to DS Version 8.0 and did schedule multiple runs of sequences to verify the ETL processes.
- Identified source systems connectivity, related tables and fields and ensure data suitably for mapping.
- Extensively analyzed the Data Sources in identifying data anomalies, patterns, value ranges. Wrote SQL scripts for accomplishing the same.
- Loaded data using EE Stages.
- Used Data Stage Enterprise Edition/Parallel Extender stages namely Datasets, Sort, Lookup, Peek, Row Generator stages, Remove Duplicates, Filter, External Filter, Aggregator, Funnel, Modify, Column Export in accomplishing the ETL Coding.
- Wrote Extensive Unix scripts for running the Datastage jobs, used awk utility for validating data.
- Developed Error Logging and Auditing strategies for the ETL jobs.
- Co-ordinated the deployments of code across test and production environments with the deployment teams.
- Undertook Change and Enhancements request
- Tuned DataStage jobs to enhance their performance.
- Used the DataStage Director to schedule running the solution, testing debugging and monitoring the resulting executable versions.
- Wrote Release notes, Deployment documents and scheduled the jobs
- Wrote DDL scripts for creating, altering tables.
- Extensive usage of AQT for analyzing data, writing SQL scripts/functions, performing DDL operations.
Confidential, Fort Worth, Texas
DataStage Designer/Developer
Responsibilities:
- Worked with the end business users to comprehend their requirements in order to design and develop interactive reports that meet business expectations.
- Involved in developing the Technical specification documents from the Functional specification documents or the mapping documents.
- Involved in mapping multiple data sources to a single target database by analyzing the business requirements that are specified in the functional documents.
- Designed the Target Schema definition and Extraction, Transformation and Loading (ETL) using DataStage.
- Designed and developed common modules for error checking (e.g. to check if the reject records output file is empty and to check if there are duplicate natural keys in a given table).
- Designed Mappings between sources to operational staging targets, using Star Schema.
- Upgraded and migrated ETL DataStage Environments from DataStage Server Edition 7.5.2 to IBM DataStage 8.1.
- Extract data from sources such as Teradata, XML files etc., transformed and loaded data into DB2 data marts.
- Designed and developed PL/SQL Procedures, functions to create Summary tables.
- Used the DataStage Director to schedule running the solution, testing and debugging components, and monitoring the resulting executable versions.
- Worked with DataStage Manager for importing metadata from repository, new job Categories
Confidential, Foothill Ranch, CA
ETL Designer/ DataStage Designer
Responsibilities:
- Worked at Confidential to cater to the Decision Support Systems of the various business segments.
- Used the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating and loading data into the Data Warehouse.
- Imported metadata from repository, created routines.
- Scheduled, tested and debugged jobs.
- Wrote the Design documents and specifications in accordance with Confidential ’s design frameworks and best practices.
- Identified source systems, their connectivity, related tables and fields and ensured data suitably for mapping.
- Developed several shell scripts for scheduling the jobs.
- Created hash tables used for referential integrity while transforming the data representing valid information.
- Enabled proper selection of the hash table design parameters for faster table look-up.
- Created job sequences to execute a set of jobs.
- Set various parameters in DataStage Administrator for performance tuning.
- Used DataStage Designer to develop various jobs.
- Utilized shared containers for code reusability and for implementing the predefined business logic.
- Created and scheduled the job sequences by checking job dependencies.
- Wrote SQL queries using joins, sub queries and correlated sub queries.
- Wrote PL/SQL stored procedures, functions to implement business rules into the application.
- Developed shell scripts to invoke back end SQL and PL/SQL programs.
- Performed Unit Testing to check the validity of the data at each stage.
Confidential, Long Island City, NY
DataStage Designer/Developer
Responsibilities:
- Involved in understanding business processes and coordinated with business analysts to get specific user requirements to build Data Marts.
- Modeled the Star Schema Data Marts by identifying the facts and dimensions using ERwin Data modeling tool. Created policy, premium and claim data marts.
- Designed and developed the DataStage server as well as parallel jobs for extracting, cleansing, transforming, integrating and loading data using DataStage Designer.
- Developed DataStage Jobs to load the data into Teradata tables using Fast load utility.
- Worked with DataStage Director to schedule, monitor and analyze performance of individual stages and run DataStage jobs.
- Imported and exported repositories across projects using DataStage Manager.
- Set various environment variables and parameters in DataStage Administrator and also used them in managing the projects.
- Used several stages like Sequential file, Hash file, Aggregator, Funnel, Change Capture, Change Apply, Transformer, Merge, Join and Lookup during the development process of the DataStage jobs.
- Involved in the preparation of ETL documentation by following the business rule, procedures and naming conventions.
- Used shared containers for reusability and reducing job complexity.
- Responsible for unit, system and integration testing.
- Developed test scripts, test plan and test data. Participated in UAT (User Acceptance Testing).
- Analyzed data with discrepancies through Error files and Log files for further data processing and cleansing.
- Used UNIX commands like awk, sed, tr, cat.