SUMMARY

• Over 8 years of expertise in software design, development and deployment of large and complex software applications. Experience in Data Requirement Analysis, Design, Development of ETL process using IBM DataStage 11.X, 8.X/7.x (WebSphere, Ascential DataStage) . Expert in all the stages of Software Development Life Cycle (SDLC).
• Experience in Data Warehousing applications, responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse.
• Experience in using various stages like Join, Merge, Lookup, Remove Duplicates, Sort, Filter, Funnel, Dataset, Change Data Capture, Slowly Changing Dimensions, Switch, Modify, and Aggregator in datastage designing.
• Experience in design and development of parallel jobs using Parallel Extender for splitting bulk data into subsets and to dynamically distribute to all available nodes to achieve best Job performance, Involved in maintaining logical and physical models.
• Developed efficient mappings for data extraction/transformation/loading (ETL) from different sources to a target data warehouse.
• Excellent Experience in Designing, Developing, Documenting, Testing of ETL jobs and mappings in Server and Parallel jobs using Data Stage to populate tables in Data Warehouse and Data marts.
• Experience in new enhancements in the IBM Websphere DataStage - Multiple Job Compile, Surrogate key generator Stage, Job Report, Message handler options.
• Worked on DataStage production job scheduling process using the Scheduling tools and data stage scheduler.
• Excellent knowledge in Extraction, Cleansing and Modification of data from/to various Data Sources like Flat Files, Sequential files, Comma Delimited files (.csv), XML and Databases like Oracle, ODBC, DB2, Teradata etc .
• Extensive experience in writing UNIX shell scripts for data manipulation and transformation.
• Worked on DataStage client tools like DS Designer, DS Director and DS Administrator, Parallel Extender/Orchestrate.
• Detailed knowledge in Data Warehousing concepts like Dimensional Modeling, Star Schema, Snowflake Schema and ETL.
• Used Both Pipeline Parallelism and Partition Parallelism for improving performance.
• Worked with SQL, SQL*PLUS, Oracle PL/SQL Stored Procedures, Triggers, SQL queries and loading data into Data Warehouse/Data Marts.
• Experience in using software configuration management tools like Rational Clear case/Borland star team for version control. Skilled in writing technical specification documents, translating user requirements to technical specification.

TECHNICAL SKILLS

ETL Tools: DataStage 11.X/8.X/7.X (Manager, Designer, Director, Administrator, Parallel Extender)

Programming Languages: PL/SQL, UNIX Shell Scripting, Core Java

Database: Oracle 11g/12c, DB2 9.7 LUW, Teradata 14, Greenplum

Operating System: Windows 7, Windows XP, Windows 2003/2000 Server, UNIX, Z/OS

Data Warehousing (BI): Data Marts, OLTP, OLAP, Normalization, Dimensional Modelling, Fact, Dimension, Star schema, Snowflake schema, Galaxy Schema, Slowly Changing Dimensions

Scheduling Tools: Autosys

SQL Editors/Other Tools: TOAD, DBArtisian, Sqldeveloper, SQL Assistant Putty, GoldenGate, IBM ClearCase, ClearQuest, Perforce, Putty, HP Quality Center,ALM, Sharepoint, Jira, ServiceNow

Reporting Tools: Qlikview, Cognos

PROFESSIONAL EXPERIENCE

Sr. DataStage Developer

Confidential, Fairfax, VA

Responsibilities:

• Used DataStage as an ETL tool to extract data from sources systems, loaded the data into the IBM DB2 database.
• Created jobs to read and write data into complex flat files, COBOL files, sequential files.
• Designed and Developed Data stage Jobs to Extract data from heterogeneous sources, Applied transform logics to extracted data and Loaded into Datamart.
• Created Datastage 8.5 jobs using different stages like Transformer, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter, Change Data Capture, Change Apply, Column Generator, Difference, Row Generator, Sequencer, Email Communication activity, Command activity, Sequential File, CFF stage, Dataset, Terminator activity.
• Used Data Stage Director and its run-time engine for job monitoring, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis.
• Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
• Created master jobs sequencers.
• Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through scheduler called VERTIS which runs based on ILOG JRules.
• Coordinated with team members and administer all onsite and offshore work packages.
• Performed performance tuning of the jobs by interpreting performance statistics of the jobs developed.
• Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.

Environment: IBM Web Sphere DataStage 8.5 Parallel Extender, IBM Infoshpere Information Sever Manager, Web Services, Clear case, Microsoft Visio, IBM AIX 4.2/4.1, SQL Server, IBM DB2, Vertis, ilOG JRules, Unix, Windows, HP ALM

Sr. DataStage Developer

Confidential, New York, NY

Responsibilities:

• Worked with the Business analysts and the DBA for requirements gathering, analysis, testing, and metrics and project coordination.
• Developed documents like Source to Target mapping for developing the ETL jobs.
• Populated Data Marts at different levels of granularity for the inside Customers using DataStage, SQL scripts and stored procedures (being executed from shell scripts driven by Control-M).
• Imported the required Metadata from heterogeneous sources at the project level.
• Used DataStage Netezza Enterprise stage to load data, utilizing the available processors to achieve job performance, configuration management of system resources in Orchestrate environment.
• Involved in the deployment of DataStage jobs from Development to Production environment.
• Developed Parallel jobs using Parallel stages like: Merge, Join, Lookup, Transformer (Parallel), and Oracle Enterprise Stage, Dataset, Funnel, Change Data Capture and Pivotal.
• Experienced in using advance datastage real time stages like Webservices, XML and used Regroup, parser, hjoin and sort steps in xml.
• Extensively used Lookup, Join, Merge stages for joining various information and also used Parallel Transformer, Column Generator, Funnel, Filter, Switch, Modify, Pivot, Row Generator.
• Used DataStage Designer to create the table definitions for the CSV and flat files, import the table definitions into the repository, import and export the projects, release and package the jobs.
• Performed debugging on these jobs using Peek stage by outputting the data to Job Log or a stage.
• Used DataStage Designer to create the table definitions for the CSV and flat files, import the table definitions into the repository, import and export the projects, release and package the jobs.
• Worked on programs for scheduling Data loading and transformations using DataStage from legacy system to Oracle 10g using SQL* Loader and PL/SQL.
• Designed and implemented slowly changing dimensions (SCD's) methodologies
• Wrote several complex SQL queries to extensively test the ETL process.
• Developed job sequences to execute a set of jobs with restart ability, check points and implemented proper failure actions. Scheduled various ETL Batch processes using AUTOSYS.
• Created xsds for file parsing for loading into destination.
• Participate in walk-through and provide approval of Test Plan and Test Cases, Participate in defect reviews.
• Created Control-M UNIX job to schedule the jobs to be run the given time and completion of the dependent jobs.
• Responsible for monitoring all the jobs that are running, scheduled, completed and failed. Troubleshooting the failed jobs is a primer in these situations.

Environment: IBM InfoSphere DataStage v11.3, DB2, Oracle 11g, Squirrel, SQL Server, Erwin, UNIX, Control-M, Soap UI

DataStage Developer

Confidential

Responsibilities:

• Involved in meetings with the users to gather and analyze the requirements.
• Worked closely with the Data analyst and business analyst during the design and development of ETL technical specification document.
• Used DataStage as an ETL to extract data from sources like flat files and DB2 and loaded to target DB2 UDB.
• Extensively used parallel stages like Aggregator, Sort, Column Generator, Join, Merge, Head and peek for development and de-bugging purposes.
• Developed jobs to standardize and improving error handling.
• Implemented Surrogate key by using Key Management functionality for newly inserted rows in Data warehouse which made data availability more convenient.
• Implemented Slowly Changing Dimensions (Type1 and Type2) using DataStage ETL jobs.
• Implemented Surrogate key by using Key Management functionality for newly inserted rows in Data warehouse which made data availability more conveniently.
• Developed Jobs to load Staging and ODS tables.
• Responsible for the design, development, coding, testing and debugging of application to meet the requirements of the users.
• Extensive experience in writing complex queries.
• Extensively used SQL tuning techniques to improve the performance.
• Working on improving performances of the jobs to meet strict time lines.
• Involved in unit, system and end-to-end testing of the design.
• Worked with Squirrel to interact with Oracle and used the tool for testing.
• Worked on call for production support.

Environment: IBM InfoSphere DataStage v11.3, DB2, Oracle 11g, Squirrel, SQL Server, Erwin, UNIX, Control-M, Soap UI