Datastage Developer Resume
New Britain, CT
SUMMARY
- Over Seven years of professional experience in various software tools including 6 years of experience in Extraction, Transformation and Loading (ETL) processes using IBM WebSphere DataStage 8.1/8.0.1/7.5/7.1/7.0/6.0 , IBM Information Server Tools QualityStage.
- Experience in designing Server and Parallel jobs including Batches and Job Sequencers.
- Proficiency in using Unix Shell Scripting, VMS, AutoSys and scheduling jobs in UNIX and Windows platforms.
- Experience in analyzing Star Schema, Snow Flake Schema and Dimensional Data Modeling and implementing Slowly Changing Dimensions.
- Experience in integration of various data sources like Oracle, TeraData, Informix, IBM DB2 UDBD.
- Well versed in implementation of Triggers, Stored Procedures, and Functions in SQL Server, Oracle and PL/SQL.
- Experience in working with OLTP and OLAP Systems.
- Experience in designing jobs using Parallel Extender Partitioning and Pipelining techniques.
- Proven track record in troubleshooting of DataStage Jobs and address production issues such as performance tuning and enhancement.
- Highly motivated team player with ability to lead, manage and work in all environments to meet deadlines.
- Excellent in communication, project management and presentation skills.
TECHNICAL SKILLS
- IBM WebSphere DataStage 8.x/7.x (Manager
- Designer
- Director
- Administrator)
- IBM WebSphere QualityStage
- Datamart
- OLAP
- OLTP
- Star & Snowflake Schema
- Fact & Dimension Tables
- Physical & Logical Data Modeling
- Oracle 10g/9i
- My SQL
- SQL Server 2005/2000/7.0/6.5
- DB2
- Teradata
- MS - Access
- HP-UX
- IBM AIX zOS
- Red Hat Linux
- Windows 98/2000/2003/ XP
- Windows NT 4.0
- Mac OS X
- SQL
- PL/SQL
- RDBMS
- Joins
- Indexes
- Views
- Functions
- Triggers
- SQL Developer
- Rapid SQL
- DB2 Connect
- SQL *Plus
- SQL*Loader
PROFESSIONAL EXPERIENCE
Confidential, New Britain, CT
Datastage Developer
Responsibilities:
- Interacted with business users in gathering project requirements and analyzed mapping documents.
- Worked with data architects and DBA’s in modifying the existing data model to accommodate new changes as required by the project.
- Worked with IBM Information Server, DataStage 8.1
- Developed server and parallel jobs using IBM Information server WebSphere DataStage.
- Extracted data from various sources like Oracle, DB2, SQL Server and Flat Files, applied required transformation rules and loading the data into Data warehouse
- Developed server jobs using various stages like Transformer, Aggregator, Hash File, Sort, Sequential, ODBC, Dynamic RDBMS and DB2 plug-in.
- Using Link Partitioner and Link collector to achieve high performance tuning in server jobs.
- Developed server and parallel jobs using various stages like transformer, aggregator, sort, merge, join, copy, peek stages.
- Achieved high performance tuning for parallel jobs using pipelining and partitioning methods, configuration files and environmental variables.
- Created Job sequencers to execute the jobs sequentially and used Autosys to schedule the jobs.
Environment: IBM Information Server 8.0.1/8.1 (WebSphere DataStage), Ascential DataStage 7.5(Designer, Manager, Director, Administrator), Parallel Extender, Oracle 10g, IBM DB2 UDB 8.2/8.0, SQL SERVER 2000, Windows XP, AIX 5.3/5.1, Putty
Confidential, Kansas City, MO
Datastage Developer
Responsibilities:
- Interacted with business users in gathering project requirements and analyzed mapping documents.
- Worked with data architects and DBA’s in modifying the existing data model to accommodate new changes as required by the project.
- Worked with IBM Information Server tools such as QualityStage and DataStage.
- Developed server and parallel jobs using IBM Information Server WebSphere DataStage.
- Extracted data from various sources like Oracle, DB2, SQL Server and Flat Files, applied required transformation rules and loading the data into Data warehouse
- Developed server jobs using various stages like Transformer, Aggregator, OCI, Hash File, Sort, Sequential, ODBC, DRS and DB2 plug-in.
- Developed server jobs using various stages like transformer, aggregator, sort, merge, join, change capture, change apply, peek stages.
- Created user defined routines, functions, before/after subroutines to implement some of the complex transformations.
- The jobs were run in batches.
Environment: Ascential DataStage 7.5(Designer, Manager, Director, Administrator), Parallel Extender, Oracle 10g, IBM DB2 UDB 8.2/8.0, SQL SERVER 2000, Windows XP, AIX 5.3/5.1, Putty
Confidential, Bentonville, AR
Datastage Developer
Responsibilities:
- Interacted with business users in gathering project requirements and created mapping documents.
- Worked with data architects and DBA’s in modifying the existing data model to accommodate new changes as required by the project.
- Worked with IBM Information Server tools such as QualityStage and DataStage
- Developed server and parallel jobs using IBM Information server Websphere DataStage.
- Extracted data from various sources like Oracle, DB2, SQL Server and Flat Files, applied required transformation rules and loading the data into Data warehouse
- Developed server jobs using various stages like Transformer, Aggregator, OCI, Hash File, Sort, Sequential, ODBC, DRS and DB2 plug-in.
- Using Link Partitioner, Link collector and hash file modulus to achieve high performance tuning in server jobs.
- Developed parallel jobs using various stages like transformer, aggregator, sort, merge, join, change capture, change apply, peek stages.
- Achieved high performance tuning for parallel jobs using pipelining and partitioning methods, configuration files and environmental variables.
- Created user defined routines, functions, before/after subroutines to implement some of the complex transformations.
- Created Job sequencers to execute the jobs sequentially.
- Developed Unix Shell Scripts to validate sequential files, file manipulation, sort scripts and data loading procedures and execute the DataStage jobs.
- Used DataStage Director to monitor the progress of jobs.
- Used AutoSys Scheduling tool to Schedule the jobs and collect the Job Statistics.
- Involved in system testing, integration testing and performance testing using Test Director by interacting with QA team.
Environment: IBM Information Server 8.0.1/8.1 (WebSphere DataStage), Erwin 4.1, Oracle 10g, IBM DB2 UDB 8.2/8.0, SQL SERVER 2000, Unix, AIX 5.3/5.1, Putty
Confidential, Bluebell, PA
Datastage Developer
Responsibilities:
- Interacted with business users in gathering project requirements and created mapping documents.
- Worked with data architects and DBA’s in modifying the existing data model to accommodate new changes as required by the project.
- Developed server and parallel jobs using IBM Information server Websphere Datastage.
- Extracted data from various sources like Oracle, DB2, SQL Server and Flat Files, applied required transformation rules and loading the data into Data warehouse
- Developed server jobs using various stages like Transformer, Aggregator, OCI, Hash File, Sort, Sequential, ODBC, DRS and DB2 plug-in.
- Using Link Partitioner, Link collector and hash file modulus to achieve high performance tuning in server jobs.
- Developed parallel jobs using various stages like transformer, aggregator, sort, merge, join, change capture, change apply, peek stages.
- Created user defined routines, functions, before/after subroutines to implement some of the complex transformations.
- Created Job sequencers to execute the jobs sequentially.
- Experience in working on developing oracle PL/SQL to write stored procedures, oracle functions, packages and triggers.
- Developed Unix Shell Scripts to validate sequential files, file manipulation, sort scripts and data loading procedures and execute the DataStage jobs.
- Used DataStage Director to monitor the progress of jobs.
- Used AutoSys Scheduling tool to Schedule the jobs and collect the Job Statistics.
- Involved in system testing, integration testing and performance testing using Test Director by interacting with QA team.
Environment: IBM Information Server 8.0.1 (WebSphere DataStage), Erwin 4.1, Oracle 10g, IBM DB2 UDB 8.2/8.0, SQL SERVER 2000, Unix, AIX 5.3/5.1, Putty
Confidential, Columbus, OH
Senior DataStage Developer
Responsibilities:
- Developed jobs Using Parallel Extender for Extraction, Transformation and Loading (ETL) the data into the data warehouse.
- Designed the Jobs using the DB2 enterprise stage, Look Up Stage, Merge Stage, Join Stage, Data Sets, Sequential Stage, Row Generator Stage, Transformer Stage and Modify Stage.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Used the DataStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts.
- Defined the data definitions and created the target tables in the database.
- Mapped the source and target databases by studying the specifications and analyzing the required transforms.
- Using ODBC stage Extracted the data from SQL Server and loaded in to DB2 Tables.
- Created Complex SQL Queries and Used in the Jobs.
- Used the inter process stage to connect passive stages as well as active stages to enhance performance
- Used various partition strategies in link partitioner on server jobs
- Used the surrogate key stage to generate surrogate keys on parallel jobs
Environment: Ascential DataStage 7.5(Designer, Manager, Director, Administrator), Parallel Extender, Oracle 10g, IBM DB2 UDB 8.2/8.0, SQL SERVER 2000, Windows XP, AIX 5.3/5.1, Putty
Confidential, NYC
Senior DataStage Developer
Responsibilities:
- Worked in Various Stages of Data warehousing life cycle development database logical and physical design, ETL process, performance tuning on Windows NT, UNIX operating systems.
- Used DataStage Manager, Designer, Administrator, and Director for creating and implementing DataStage jobs.
- Created jobs in DataStage to extract data from heterogeneous data sources like Sybase, Oracle 9i, text files and MS SQL Server.
- Designed jobs using dataset, sequential file set stages in parallel extender jobs.
- Extensively used built-in transforms and created user defined subroutines to implement some of the complex logic to meet the business requirements.
- Utilized DataStage manager to import table definitions from various databases, import and export the jobs between development, testing and production environments and DataStage Director to monitor the jobs.
- Extensively used Data Stage Director for debugging, Validate, Run and monitor the jobs.
- Created stored procedures to perform specific task which is used in the Meta data driven approach.
- Involved in Unit testing of the designed jobs, integration testing and production process.
- Worked on Shell Scripts, which intern will call the Data Stage jobs with all paths to Source and targets and even with connection information.
Environment: Ascential DataStage 7.5(Designer, Manager, Director, Administrator) Parallel Extender, Oracle 10g, TOAD 9.0, IBM DB2 UDB 8.2/8.0, Windows XP, Unix AIX 5.3/5.1
Confidential, Philadelphia, PA
DataWarehousing Developer
Responsibilities:
- Involved in design & Development of procedures and packages to retrieve and load the data into Data Warehousing system.
- Designed jobs between sources and targets using star schema.
- Extensively Used the DataStage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into the data warehouse database.
- Developed user defined Routines and Transformations.
- Used DataStage Manager for importing and exporting metadata into repository
- Created SQL loader scripts to load the data into staging environment.
- Created PL/SQL procedures, views to process the data from staging environment and load it into the production environment.
- Created Shared Containers and Local Containers and used them in Server jobs and local jobs accordingly
- Generated Surrogate Keys for composite attributes while loading the data into data mart using Key Management functions.
- Created UNIX scripts using the sort, cut, head, tail, grep commands to work with the source sequential files.
- Generated automated reports using SQL and PL/SQL for users to verify the data load process.
- Used Autosys Scheduling tool for scheduling the DataStage jobs.
- Involved in performance tuning of the ETL process and performed the data warehouse testing
Environment: Ascential DataStage 6.0(Designer, Manager, Director, Administrator), ERwin 3.5.2, CAST SQL Builder, Oracle 9i, DB2 UDB 7.2/7.0, AutoSys 3.4, Windows 2000, AIX 4.3/5.1
Confidential, Edison, NJ
Oracle Analyst/ Programmer
Responsibilities:
- Involved in creation of Tables using storage parameters and clusters.
- Coded many generic routines (as functions), which could be called from other procedures.
- Created tables, indexes and views.
- Translated the Requirements into data models.
- Created relationships for all the tables.
- Developed complex Forms and Reports using Oracle tools.
- Wrote stored procedures, functions and database triggers using PL/SQL.
Environment: Oracle 7.x/8.0, Forms 4.x/8.0, Reports 2.x/3.0, PL/SQL, SQL, MS Office, Windows XP