Senior Datastage Etl Developer resume
Irving, TX
SUMMARY:
- 7 plus years of IT Experience in the analysis, design, development, implementation and testing of client/server applications. 7 years of experience implementing IBM Websphere/Ascential Datastage as ETL tool in a Data warehouse environment.
- Extensively involved in the development of DataStage ETL process for extracting data from different data sources, data transformation and loading the data into data warehouse for data mart operations.
- Extensively worked on IBM Infosphere DataStage 11.5/9.1/8.7/8.1/8.0.1/7.5
- In depth experience in dealing with DataStage stages (join, ftp, merge, sort, aggregator, lookup, peek etc.)
- Worked and extracted data from various sources like Oracle 11i/10g/9i/8i, DB2, Netezza, Teradata, Sequential files, Flat files and XML files.
- Extensive experience in DataStage Parallel Jobs and Job Sequencers to run series of jobs in sequence.
- Strong knowledge in Software development life cycle.
- Strong Knowledge in IT infrastructure.
- Used Datastage Director to validate and run the Datastage jobs.
- Used built in transforms and created custom transforms in Datastage.
- Well versed with understanding/grasping complex table hierarchies and business models.
- In depth knowledge of Dimensional Data Modeling, Star Schema, Snowflake schema.
- Good Experience with Version Controls in DataStage.
- Involved in maintaining logical and physical models.
- Experienced in UNIX Shell scripting (Korn and Bash) as part of file manipulation and Scheduling.
- Demonstrated strong technical writing skills. Proven ability to quickly learn new technologies.
- Extensively worked on writing Jil Scripts to schedule DataStage jobs using Unix Scripts in Autosys.
- Good Experience on code collaborator for reviewing the datastage code.
- Experienced in SAP Packs in Datastage to extract and load data into SAP.
- Developed Test Scripts, Test Cases to perform Unit Testing, System Testing and Load Testing.
- Good experience in job migration to higher environments.
- Good Experience in Migrating the Code from Development to Testing, UAT and Production.
- Involved in Performance Tuning of ETL Jobs to make the jobs run faster and efficiently.
- Excellent communication skills, Good organizational skills, outgoing personality, Self - motivated,Hard working, ability to work independently or cooperatively in a team, eager to learn, ability to grasp quickly.
TECHNICAL SKILLS:
ETL Tool : Infosphere Datastage V 11.5/9.1/8.7/8.1/8.0.1/7.5 , Quality Stage 8.0.1, SAPBW 3.1
RDBMS : Oracle 11i/10g/9i/8i, SQL Server 2005,Netezza, Teradata, SQL Server 2008, IBM MDM, DB2UDB 9.1, SSIS, SSRS, SSAS.
Reporting Tools: Business Objects XI, SSRS
Programming: SQL, PL/SQL, SQL *LOADER, SQL*Plus, Korn Shell Scripting.
Analysis & Design: Agile, Waterfall
Operating Systems : UNIX (HP-UX, Sun Solaris), Linux, IBM - AIX, XP/2000/NT, Mainframe (MVS - OS/390)
PROFESSIONAL EXPERIENCE:
Confidential, Irving, TX
Senior DataStage ETL Developer
Responsibilities:- Worked closely with the Business team in gathering the functional requirements and working with the project manager to give a high level design and the cost associated with the project.
- Worked on creating Source to Target Mappings in Fast Track and ETL Design documents based on the functional requirements.
- Involved in the Design, Development and Production support.
- Involved in data Extraction, Cleaning, Transformation and Load from various sources to EDW using DataStage Designer.
- Created Environment variables in all environments for job
- Designed and Developed Job Control processes for Job work flow management.
- Extensively worked with FTPing of Flat files, both inbound and outbound.
- Developed DataStage jobs to re-write SSIS Code and also developed new Jobs to extract data from external files and tables.
- Designed DataStage jobs using the stages like ODBC, Transformer, Join, Merge, Lookup, Hierarchy, copy, row generator and Sort to load the source data into Target tables.
- Extensively used Change Data Capture Stage to perform Insert/updates and capturing history for DW Tables for Incremental loads.
- Developed DataStage Sequencers with proper job dependencies, job control and triggers using stages like User Activity Variables, Job Activity, Execute Command, Email Activity and Terminate.
- Migrated jobs to Test and Prod environments using export and import utilities of DataStage.
- Created detailed Implementation plan for Production migrations and deployments.
- Created re-usable DataStage jobs for common functionalities.
- Involved in setting up Database Connections to DataStage using odbc.ini file.
- Wrote SQL queries for data analysis, testing and validations.
- Involved in creating Unit Test plans and scripts for the interfaces developed.
- Worked on Unit Testing, Regression Testing and System Integration testing (SIT) of the ETL codes. Also supported the UAT cycle.
- Involved in creating master UNIX shell scripts to call DataStage jobs, move files around using FTP and various Unix commands, validate the record counts in the incoming external files.
- Worked on various IS and CRs coming from multiple teams.
- Used Team Foundation Server for Version Control of DataStage Jobs.
- Imported metadata into Metadata Asset Manager for Information Governance Catalog (IGC).
Environment: Information Server 11.5 (Datastage), Unix, Netezza 7.2, DB2 AS400i, SQL Server 2008, TFS Visual Studio 2012, Redhat - LINUX
Confidential, Boston, MA
Senior DataStage ETL Consultant
Responsibilities:- Gathered the business requirements for the Dimensions and fact tables (Course, Applicant, and Inquiry Prospect) and developed the Datastage jobs to meet the requirements.
- Designed and developed ETL solutions based on business user requirements.
- Loaded the Dimension tables and fact tables using the source data and mapping document.
- Implemented Type I and Type II Slowly Changing Dimension.
- Used various stages like aggregator, pivot, modify, sort, dataset, filter, funnel, join, lookup to meet the transformation requirements.
- Worked on Teradata Stored Procedures to generate automated testing SQLs.
- Involved in Data Modeling of facts and dimension tables based on the requirements.
- Used XML Stages to parse the XML Data and loaded it into Relational database.
- Extremely worked on Serena Enterprise Release Management tool in Data stage for version control.
- Extensively worked in the performance tuning of the DataStage jobs, ETL Procedures and processes.
- Involved in unit, regression, performance and integration testing of DataStage jobs.
- Worked on the technical document for various jobs, unit test documents with various scenarios and Acceptance level of test case results.
- Extensive experience in migrating jobs to different projects and from Unix to windows platform and from windows to windows.
- Trained the junior developers on better Datastage job design and performance improvement.
- Experienced in writing the Unix wrapper scripts to call the datastage jobs.
- Good Experience in writing the Jil Scripts to call datastage wrapper scripts in it for scheduling Autosys Jobs.
- Developed job sequences to run jobs in parallel and in series taking into consideration the interdependencies.
- Worked in Shared Containers for the reusability of the process in other jobs.
- Was involved in full integration test of all jobs within each sequence before migrating the jobs and Sequencers from the Development environment to the QA environment, and from the QA environment to the Production environment.
- Performed code reviews of the developed jobs and fixed the identified defects in the jobs.
Environment: Information Server 11.5 (Datastage), Oracle 10g/11g, Toad 9.7, MS VISIO, UNIX, Teradata, Serena Dimensions
Confidential, Freeport, Maine
Senior Data stage Consultant
Responsibilities:- Involved with business analysts to understand the business requirement specifications and Implemented the ETL jobs using Datastage.
- Developed jobs in IBM InfoSphere Parallel Extender PX using different stages like Transformer,Aggregator, Lookup, SCD, Join, Merge, Modify, Remove Duplicate, Sort, Peek, Change capture, Filter, Copy, Sequential File, Data Set, etc.
- Extensively used Datastage Director for monitoring and debugging of jobs and sequences.
- Extensively used SAP Packs like abap extract, idoc load connector, bapi stages.
- Extensively used Autosys Scheduler Tool to schedule Datastage jobs.
- Worked on SQL for extracting the data from the DCMS Database and EDW Database.
- Worked on MQ Editor to check the Queue messages and insert the messages in the queue.
- Tuned Datastage jobs to obtain better performance.
- Good Experience in SAP Solution Manager to look up the Mapping documents for interface and conversion objects.
- Unit Test Datastage Jobs in development including creating the appropriate test data.
- Developed UNIX Shell Scripting to automate file manipulation, data loading procedures, Data Conversion and scheduling jobs.
- Worked on shared containers to re-use the code across the project.
- Extensively worked on Parameter sets to reuse the parameters in various jobs in the project.
- Responsible for creating technical design and unit test documents for promoting the code to Integration testing.
- Extensively worked on code collaborator for the code reviews after development.
- Involved in Integration and Performance testing in QA Environment.
- Maintain versions of code by using Clear Case.
Environment: IBM Infosphere Data Stage 9.1, code collaborator, Autosys, UNIX, Clear case, MQ Editor, Toad, SAP
Confidential, Parsippany, New Jersey
Senior Data Stage ETL Consultant
Responsibilities:- Designed Data Stage ETL jobs for extracting data from various source systems, transform it and create XML Files.
- Developed Unix Scripts to ftp the files for Outbound and Inbound from ETL to RDM and Vice Versa.
- Involved in development phase meetings for Business Analysis and Requirements document reviews.
- Extensively worked on Dataset, Sequential File, Join, Merge, Look Up, Change Capture, Filter, Aggregator, Funnel, Column Generator, Peek, Remove Duplicates, Copy and Modify stages.
- Was involved in full integration test of all jobs within each sequence before migrating the sequences to the test project from dev. project.
- Responsible for the detailed design documentation. Responsible for specifications document that describe the functionality and design of each subject area.
- Used Serena Dimensions Version Control and segregated the latest versions of updated jobs, sequences and Unix scripts.
- Good experience in migrating jobs to different projects to higher environments in Unix and windows platform.
- Worked with Autosys team to schedule the DS jobs using scripts on the Production Server.
- Created different Config apt file for different jobs and used them as and when needed for different jobs by using job parameters.
- Developed Error Logging and Auditing strategies for the ETL jobs.
- Co-ordinated the deployments of code across test and production environments with the deployment teams.
- Created shared containers to use in multiple jobs.
- Written Unix Shell scripts to execute DataStage jobs on Unix Production servers.
- Involved in Performance tuning of the ETL process and performed the data warehouse testing.
- Worked on setting up the SSH keys between different servers to moves the files through sftp.
- Created Autosys jil Scripts to call shell scripts with different parameters based on scenarios, which internally call Datastage jobs.
- Worked on HP Quality Center for opening the Defects, tracking those and specifying the purpose of the defect.
Environment: IBM Infosphere Data Stage 9.1, IBM Info Sphere Master data management, Cobol, JCL, Autosys, UNIX, HP Quality Center 10 and Serena Dimensions, Toad.
Confidential, King of Prussia, PA
Datastage Developer
Responsibilities:- Thorough Impact Analysis is done and then created detailed design, source to target mappings.
- Modified the Data Model based on the requirements and worked with DBA’s to implement.
- Designed and developed ETL processes using Datastage designer to load data from the xml files, to staging database and from staging to the target Data Warehouse database.
- Used Datastage stages namely, Sequential file, Transformer, Aggregate, Sort, Datasets, Join, Lookup, Change Data Capture, Funnel, Merge, Peek, Row Generator stages in accomplishing the ETL Coding.
- Developed job sequencer with proper job dependencies, job control stages, triggers.
- Involved in performance tuning and optimization of Datastage mappings.
- Scheduled the jobs in Autosys Dev. and Prod environments.
- Documented ETL test plans, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
- Participated in Daily Stand ups and provided demo at the end of each iteration.
- Involved in the meetings with the production support team for any hard fixes at the product level.
Environment: IBM DataStage 8.0 (Designer, Director, Admin), Oracle 11g, DB2, Unix, Autosys,Business Objects Reporting.
Confidential
Datastage Developer
Responsibilities:- Developed the source to target process and mapping documentation.
- Analyzed the existing ETL process and came up with an ETL design document that listed the jobs to load, the logic to load and the frequency of load of all the tables.
- Imported data from various transactional data sources residing on SQL Server, DB2 and Flat files and loaded into Oracle database.
- Developed DataStage jobs based on business requirements using various stages like Lookup File, Lookup Stage; Join Stage, Merge Stage and Sort Stage.
- Extensively worked on Data Acquisition and Data Integration of the source data.
- Implemented various process checks, data checks and mail notifications to ensure the quality of the data that is loaded into the data warehouse.
- Created indexes and partitions in the database to improve the performance of ETL jobs.
- Involved in writing shell scripts for reading parameters from files and invoking DataStage jobs.
- Created jobs in ControlM Job Management Scheduler to run the jobs in sequence without manual intervention.
- Created statistical reports using Business Objects.
Environment: IBM Web Sphere DataStage 7.5(Designer, Director, Manager), IBM DB2 Database, SQL Server, Oracle, DB2, and UNIX.
Confidential
Software Programmer
Responsibilities:- Member of the development team in building up the database in Oracle
- Created Data Structures. i.e. Tables & views and applying the referential integrity using SQL.
- Designed and developed the data entry screens.
- Wrote Database Triggers, Procedure & Functions using PL/SQL.
- Used knowledge of advanced PL/SQL concepts like arrays, tables, cursors, built-in and user defined object types, exception handling and database packages
- Utilized SQL*Plus for SQL coding of DDL statements for creation of the required database objects and DML queries for data retrieval
- Involved in loading large amounts of data using utilities such as SQL Loader
- Developed forms using forms 6i.
- Tested and debugged the modules along with the other modules to implement the business logic.
Environment: Oracle 8i, Oracle Forms 6i, Oracle Reports 6i, PL/SQL and Windows98.