Datastage Consultant Resume
Baltimore, MD
PROFESSIONAL SUMMARY:
- IT professional, Over 7 years experience in System Analysis, Design and Development and extensive experience in IBM DataStage 8.x/ 7.x using components like Administrator, Manager, Designer, and Director.
- Had experience in the fields of data warehousing using IBM DataStage, Oracle, PL/SQL, DB2 UDB, SQL Server.
- Experience on almost all Datastage stages like Link Collector, Link Partitioner, Sort, Pivot, Merge, Aggregator, and Transformer. Parallel stages like Aggregator, Change Capture, Changeapply,Copy,Funnel,Filter,Look - up,Join,Merge,Modify,RemoveDuplicate,Surrogate Key, Switch, Transformer.
- Strong understanding of the principles of Data warehouse using Fact Tables, Dimension Tables, Star Schema modeling and Snowflake Schema modeling.
- Worked on Staging, Transformation, Preloading and loading of data from multiple sources into Data Warehouse.
- Staying up-to-date with ETL development standards and best practices, applying the concepts in job design and construction.
- Extensively worked on procedures for data movement in data warehousing using Datastage. This includes specification of data cleansing and design of staging area.
- Good experience in Extraction Transformation and Loading (ETL) processes using Datastage Quality Stage. Excellent experience in most of the RDBMS including Oracle, SQL Server.
- In depth knowledge in Data warehousing concepts with emphasis on ETL and full life cycle development including requirement analysis, design, development, testing and implementation.
- Experience in integration of various data sources like Oracle, DB2, SQL Server, MS Access and Flat files into the Staging Area. Extensively worked with materialized views and TOAD
- Excellent analytical, communication, and facilitation skills with the ability to gain consensus across multiple teams.
- Can learn and adapt quickly to the emerging new technologies/software
TECHNICAL SKILLS:
ETL Tools: IBM DataStage 8.x/ 7.5.3/7.5.2/7.5.1/7.0
Databases: Oracle10g/9i/8i/8.0/7.0, MS Access 7.0/97/2000, SQL Server
Tools: SQL*Loader, TOAD, XML, DHTML, HTML 4.0, MS Office
Programming: C, C++, Shell, SQL, PL/SQL, Visual Basic 5.0,Analysis & Design: Rational Rose, UML, Waterfall
Environment: Windows 2000/2003/7.0 , Win NT, Unix
PROFESSIONAL EXPERIENCE:
Confidential, Baltimore, MD
Datastage Consultant
Responsibilities:
- Developed jobs using DataStage in Designer to extract data from different operational Sources like Flat Files, CSV Files, Delimited Files and performed business operations on data like Cleansing, Transforming and load into Target DWH.
- Used Job Sequencers to run the jobs sequentially and reporting the Status of the Job through Email.
- Exported and imported the DataStage jobs between the production and the development servers.
- Basically involved in providing support to the built Applications and also involved in developing in new dimensions while enhancing the application.
- Loading the data into the Staging and moving the data from Staging to ODS.
- Involved in Business Requirement gathering sessions.
- Designing of the ETL jobs as per the client’s requirements.
- Integrate the data from the source system into the target database.
- Involved in S.I.T (System Integration and Testing) and U.A.T (User Acceptance Testing).
- Extensively used SQL coding for overriding the generated SQL in Datastage and also tested the data loaded into the data base.
- Check the output according to the specifications using Unit Test.
- Used Autosys scheduler to schedule the jobs.
- Supported the application after moving into Production and Troubleshooting.
Environment: IBM InfoSphere DataStage 8.1,Autosys, Oracle 10g, Win 2003/2000/NT and UNIX
Confidential, Hartford, CT
Datastage Developer
Responsibilities:
- Involved in requirement gathering, analysis and study of existing systems.
- Involved in preparing technical design/specifications for data Extraction, Transformation and loading.
- Extensively used DataStage Designer to develop various jobs to extract, cleanse, transform, integrate and create extract files as needed.
- Scheduled the jobs using Autosys Scheduler, which would trigger ETL jobs and invoke shell scripts to initiate file transfer between two servers.
- Created Technical specs document for the Datastage Jobs, Developed several test plans and Error logs were maintained.
- Performed administrator functions like creating projects, importing jobs to new projects, protecting project, unlocking the jobs and also installing DataStage plug-ins like pivot stage.
- Extensively used Parallel Stages like Row Generator, Column Generator, Head, and Peek for development and de-bugging purposes.
- Implementing performance-tuning techniques along various stages of the ETL process.
- Co-coordinating with client managers, business architects and data architects for various sign offs on data models, ETL design docs, testing docs, migrations and end user review specs.
Environment: IBM InfoSphere DataStage 8.1, Oracle 10g, Win XP, UNIX
Confidential, Warren, NJ
DataStage Developer
Responsibilities:
- As a DataStage Developer I created both Parallel and server jobs and also Sequence jobs.
- Executed complex SQL statements using joins, date functions, inline functions, and sub-queries to generate reports.
- Developed jobs using the stages like Sequential file, Dataset, Oracle connector, ODBC stage, Lookup, Join, Aggregator, Pivot, External Source, BW Open Hub Extractor, Essbase Connector, Link Partitioner/Collector, Column Generator, Copy, Transformer, Sort, Remove Duplicates, Funnel, FTP.
- Identified source systems, connectivity, related tables and fields and ensure that data is suitable for mapping.
- Involved in creating reusable components such as Parallel shared containers, transformations in Datastage.
- Created jobs in DataStage to extract from heterogeneous data sources like DB2, Sybase, Access, Flat files and text files to Oracle.
- Exported and imported the DataStage jobs between the production and the development servers.
- Worked with DataStage Manager to Import, Export DataStage Jobs from one environment to another.
- Scheduled and monitored the jobs in DataStage Director to load data into target database.
- Used server components (DataStage Repository, DataStage Server, and DataStage Package Installer).
- Evaluated the consistency and integrity of the model and repository. Created DataStage scripts for data transformation, conditioning, validation and loading.
- Developed, automated and scheduled load processes using UNIX shell scripting.
Environment: DataStage8.0(Designer, Manager, Director), Windows XP, Oracle 9i, SQL, TOAD, UNIX, MS Access, DB2.
Confidential, McLean, VA
Datastage Developer
Responsibilities:
- Data Warehouse is implemented using sequential files and DB2, Oracle Tables.
- Worked on XML Input and XML output stages, pulled data coming from XML files processed it loaded into Database.
- Transformations including aggregation and summation construct from operational data source to Data warehouse.
- Using the stages like Change-Capture, Modify, Look-up, Remove Duplicate, filter, Sort in modifying the jobs already developed to improve the performance and to meet the requirements.
- Extensively Used the IBM Information Server Designer to develop jobs to extract, transform and load data from various source systems into the Data Warehouse.
- Extracted and transferred source data from DB2 Database to Oracle database
- Extensively used DataStage Designer to develop various jobs to extract, cleanse, transform, integrate and create extract files as needed.
- Extensively used Sort, Merge, and Aggregator and Remove Duplicates stages.
- Sourced and cleansed data from all the XML and Flat files.
- Developed job sequencer for running and scheduling jobs.
- Developed UNIX shell scripts to automate the Data Load processes to the target Data warehouse.
- Preparing documentation for unit, regression, integration, and final end to end testing.
- Involved in the unit testing, regression testing, and integration testing for transition data.
Environment: DataStage 7.5 (Designer, Director, Manager), UNIX, TOAD, Oracle 9i, SQL Server.
Confidential
DataStage Consultant
Responsibilities:
- Analyzed and designed ETL processes.
- Involved in developing Data Marts for the user reporting requirements.
- Used DataStage for subjecting the data to multiple stages, thereby transforming it and prepared documentation. Used DataStage Manager to define Table definitions, Custom Routines and Custom Transformations.
- Created DataStage Server jobs to extract data from sequential files, flat files, MS Access and SQL Server 2000.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Used the DataStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different data marts.
- Defined Data Definitions, and created the target tables in the database.
- Used DataStage for subjecting the data to multiple stages, thereby transforming it and prepared documentation.
- Wrote routines to schedule batch jobs to obtain data overnight from various locations.
- Created job sequences and schedules for automation.
Environment: DataStage7.0(Designer, Director, Manager), UNIX, Windows NT 4.0, Oracle 9i, SQL Server2000, MS Access.
Confidential
ETL Developer
Responsibilities:
- Involved in creating entity relational and dimensional relational data models using Data modeling tool Erwin.
- Designing the Target Schema definition and Extraction, Transformation and Loading (ETL) using Datastage.
- Used the Datastage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Mapping Data Items from Source Systems to the Target System.
- Worked on programs for scheduling data loading and transformations using Datastage from legacy system to Oracle 9i using SQL* Loader and PL/SQL.
- Designing and Developing PL/SQL Procedures, functions, and packages to create Summary tables.
- Used the Datastage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
- Worked with Datastage Manager for importing metadata from jobs, new job Categories and creating new data elements.
Environment: Datastage 7.0 (Manager, Designer, Director), Oracle, SQL Server 2000, Windows NT 4.0, UNIX.