Sr. Etl Datastage Developer Resume
Hoffman Estates, IL
SUMMARY
- Over 6 years of Data Warehousing experience in teh areas of ETL Design and Development.
- Involved in complete Software development life - cycle of various projects, including Requirements gathering, System Designing, Data modeling, ETL design, Development, Production Enhancements, Support and Maintenance.
- Extensive ETL tool experience in designing and developing jobs using IBM Infosphere/Websphere DataStage and Ascential DataStage. Proficient wif DataStage tools like DataStage Designer, DataStage Director and DataStage Administrator.
- Familiar in using highly scalable parallel processing infrastructure using parallel jobs and multiple node configuration files.
- Extensively developed parallel jobs using various processing category stages like Aggregator, Sort, Remove Duplicate, Transformer, Filter, Change Data Capture (CDC), Join, Lookup, Merge, Funnel etc.
- Experience in designing, developing and supporting ETL jobs using Talend wif different stages in like tMap, tJoin etc
- Experience in troubleshooting of jobs and addressing production issues like data issues, performance tuning and enhancements.
- Strong understanding of teh principals of Data Warehousing, using fact tables, dimension tables and star/snowflake schema modeling and implementing SCD’s (Slowly Changing Dimensions)
- Worked extensively wif Dimensional modeling, Data migration, Data cleansing, ETL Processes for data warehouses.
- Knowledge in using Erwin as leading Data modeling tool for logical (LDM) and physical data model (PDM).
- Technical and analytical skills wif clear understanding of design goals of ER modeling for OLTP and dimension modeling for OLAP.
- Extensive knowledge in dealing wif various databases like Oracle 10g/9i/8i, DB2, SQL Server, Teradata, and MS Access.
- Experience in scheduling server and parallel jobs using DataStage Director, UNIX scripts and scheduling tools like Autosys.
- Experience in writing Stored Procedures, Functions and Triggers using PL/SQL.
- Experience in using Clearcase tool for migration of source code and performing version control.
- Knowledge in reporting tools such as Cognos and Microstrategy
- Excellent Interpersonal and communication skills wif an ability to work TEMPeffectively in a team or individually, remain highly focused and self-assured in fast-paced and high-pressure environments.
TECHNICAL SKILLS
ETL Tools: IBM Infosphere DataStage 8.5, IBM Websphere DataStage 8.0.1 (Designer, Director, Administrator), Ascential DataStage 7.5.2 (Designer, Director, Administrator, Manager), Talend open studio v.5.2.2
Databases: Oracle 10g/9i/8i, IBM DB2/UDB, Teradata, SQL Server 2003/2005/2008.
Data Warehousing: Star & Snow-Flake schema Modeling, Fact and Dimensions, Physical and Logical Data Modeling, ERwin.
Tools: Autosys, Clearcase, SQl Plus, SQL*Loader, TOAD
Operating systems: Windows 7x/NT/XP, UNIX, LINUX, Solaris, MS-DOS
Languages/Scripting: C, C++, SQl, PL/SQL, UNIX Shell scripting, HTML
PROFESSIONAL EXPERIENCE
Confidential, Hoffman Estates, IL
Sr. ETL Datastage Developer
Responsibilities:
- Participated in requirements gathering by attending user review meetings.
- Participated in Logical Design, Physical Design model meetings tounderstand teh data flow, frequency of data loads.
- Involved in creating Source to Target mapping document for all teh ETL jobs.
- Analyzing teh source systems and developing Functional Specifications and converting them into Technical Specifications.
- Created Visio Diagrams for teh data process flow.
- Designed and developed slowly changing dimension jobs using Type - II logic.
- Used Change Capture, Join, Merge, Lookup, Funnel and Filter and Remove Duplicates Stage, Transformer Aggregator Stage, Copy stage during ETL development using IBM Infosphere Datastage 8.5
- Scheduled jobs using Sequencers and Autosys job scheduler.
- Created unit test plans and test scenarios. Involved in Unit, Integration and Functional Testing.
- Extensively developed and deployed UNIX Shell scripts as wrappers that provide values to DataStage jobs during runtime.
- Involved in teh Performance Tuning of teh DataStage jobs.
- Migrated projects through DSX executable files from development to QA and production environments.
- Provided technical support to other developers and coordinated escalation of issues.
- Worked on Datastage to Talend Migration project using various stages like tmap, tjoin, thash etc
Environment: IBM Infoshphere DataStage 8.1, SQL Server, DB2, Oracle 10g, Oracle exadata X3-8, TOAD 8.6, SQL assistant, Autosys, Microsoft Visio, Talend open studio
Confidential, Conshohocken, PA
Sr.ETL Datastage Developer
Responsibilities:
- Designed teh ETL jobs using IBM WebSphere Information Server 8.1 to Extract, Transform and load teh data into Staging and then into Oracle Database.
- Extensively used teh designer to develop various parallel jobs to extract, transform, integrate and load teh data into Corporate Data Warehouse (CDW).
- Designed and developed teh ETL jobs using Parallel Edition which distributed teh incoming data concurrently across all teh processors, to achieve teh best performance.
- Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture(CDC), Modify, Row Generator and Aggregator.
- Scheduled jobs using DataStage Job Sequences and AutoSys job scheduler utility based on teh control flow and monitored teh production jobs closely for any possible errors.
- Worked wif Shared Containers for Re-using teh Business functionality.
- Extensively developed and deployed UNIX Shell scripts that provide parameter values to DataStage jobs during runtime.
- Created Parameter Sets and Value Files to run teh same job for different schemas.
- Worked wif Slowly Changing dimension stage for implementing Type-II logic.
- Used Datastage Director to monitor jobs, run and validating its components.
- Involved in teh Performance Tuning of teh DataStage jobs using different methodologies like Configurations of teh environment variable file, designing and editing configurations, increasing teh reading as well as teh writing speed while fetching or loading data to files or databases.
- Migrated projects through DSX executable files from Development to Testing environment and Production environments
- Assisted operation support team for transactional data loads in developing SQL & Unix scripts
- Involved in Unit testing and Integration testing of DataStage jobs.
Environment: IBM InfoSphere DataStage 8.1, IBM AIX 5.2, Oracle 10g, Flat files, Autosys, TOAD, SQL loader.
Confidential, Wayne, NJ
Data Stage Developer
Responsibilities:
- Designed and developed various new processes, Fixed teh existing process wif new business requirements, and meetings wif users for Input.
- Designed and developed jobs for extracting, transforming, integrating, and loading data into data mart using DataStage Designer
- Developed, executed, monitored and validated teh ETL DataStage jobs in teh DataStage designer and Director Components.
- Worked wif DataStage Director to schedule, monitor, analyze performance of individual stages and run DataStage jobs.
- Worked on Teradata database, used Teradata Enterprise stage and Teradata Multiload stage.
- Involved in writing scripts for loading data to target data warehouse for Bteq, fastload, and multiload.
- Extensively used Change Data Capture, Transformer, Modify, copy, Join, Funnel, Aggregator, Lookup Stages and development stages to develop teh parallel jobs.
- Generated Surrogate Keys for composite attributes while loading teh data into Data Warehouse using Key Management functions.
- Developed user defined Routines and Transformations for implementing Complex business logic.
- Developed Job Sequencer and batches and have edited teh job control to have jobs run in sequence
- Imported Metadata from Oracle database. Imported metadata definitions into teh repository. Exported and imported DataStage components.
- Involved in teh preparation of ETL documentation by following teh business rule, procedures and naming conventions
- Performed Troubleshooting and Tuning of DataStage Jobs for better query performance.
- Reviewing teh developed jobs based on teh build review checklists.
- Responsible for Unit, System and Integration testing. Developed Test scripts, Test plan and Test Data.
Environment: IBM Infosphere DataStage 8.1(Parallel Extender, Quality Stage), PVCS Version Controller, Citrix, Mercury Test Director, Control-M Scheduling, Oracle, Teradata and UNIX.
Confidential, Newark, NJ
DataStage Developer
Responsibilities:
- Attended teh user review meetings.to gather requirements and documented them.
- Designed and created DataStage Server jobs to load data from sequential files, Flat Files and MS Access.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Prepared Data Volume estimates.
- Defined teh data definitions, and created teh target tables in teh database.
- Wrote routines to schedule batch jobs to obtain data overnight from various locations.
- Mapped teh source and target databases by studying teh specifications and analyzing teh required transforms.
- Analyzed teh performance of teh jobs and enhanced teh performance using teh standard techniques.
- Used teh DataStage Director and its run-time engine to schedule running teh solution, testing and debugging its components, and monitoring teh resulting executable versions.
- Used DataStage to transform teh data to multiple stages, and prepared documentation.
- Created ETL execution scripts for automating jobs.
- Documented teh purpose of mapping so as to facilitate teh personnel to understand teh process and in corporate teh changes as and when necessary.
Environment: Ascential DataStage (Designer, Director, Manager), Windows NT 4.0, UNIX, Oracle 8i, PL/SQL, Dbase3 Files, DOS and UNIX Sequential Files, MS Access