Sr. Etl Datastage Developer Resume
Tampa, FL
SUMMARY
- 7+ years of IT experience in Design, Development and Implementation of Data Warehouse and integrating vast array of data sources using IBM InfoSphere Information Server 8.1, IBM DataStage Enterprise and DataStage 8.7/8.5/8.1/7.5 Client - Server environment.
- Hands on experience in creating Indexed Views, complex Stored Procedures, Triggers to assist efficient data manipulation and data consistency.
- Strong Experience and knowledge of Relational Database Management Systems (RDBMS) concept in several databases like SQL Server 2008/2005, Oracle 12c/11i/10g/9i, Teradata 12.0 and DB2 with UDB.
- Proficient in creating data mappings and data dictionaries and understanding business data relationships.
- Expertise in working with different versions of DataStage - DataStage Standard (Server Jobs and sequence jobs), DataStage Enterprise (Server jobs, sequence jobs and parallel jobs) offering parallel processing features and DataStage Enterprise MVS allowing jobs to be developed on a Unix or Windows server and transferred to the mainframe to be compiled and run.
- Extensively Worked on DataStage client tools like DS Designer, DS Director, DS Manager and DS Administrator.
- Experienced in various phases of IT projects Software Development Life Cycle (SDLC) such as analysis,
- Experienced with code deployments, version controlling and production support (on - call).
- Strong skills in data mapping for the Slowly Changing Dimensions - SCD1and SCD2 Implemented the complex business rules by creating reusable transformations and Mappings / Mapplets.
- Experienced in UNIX Shell Script, using K-shell for the automation of processes, file manipulation, file(s) transfer between servers and scheduling the DataStage jobs
- Experienced in converting PL/SQL codes into DataStage ETL codes.
- Strong understanding of data warehouse concepts like Star Schema, Snowflake modeling, Fact and Dimensions tables, Physical and logical data modeling.
- Designed DataStage Jobs to extract data from XML files using XML input stage, Used XML Transformer Stage to cleanse and transform the data to load it into the Data Mart.
- Interacted with Developers, Business analysts, DBAs, Deployment and Released planning team
- Effective leadership skills with good written, verbal communication and presentation skills. Self-motivated with result oriented approach. Committed collaborator and team leader.
TECHNICAL SKILLS
ETL Tools: IBM InfoSphere DataStage 8.7/8.5/8.1/7.5.2 (Designer, Director, Parallel Extender)
RDBMS: DB2, Teradata V12, Oracle 8i/9i/10g
Languages: SQL, PLSQL, UNIX Shell, C, C++, HTML, XML, COBOL, JCL
Other tools & utilities: COGNOS 8.4, OBIEE 10g/11g, Autosys, SQL Assistant 12.0, Erwin 4.0
Operating Systems: UNIX, Windows 2000/2003/XP/VISTA/7/8
PROFESSIONAL EXPERIENCE
Confidential - Tampa, FL
Sr. ETL DataStage Developer
Responsibilities:
- Used DataStage 8.7 as an ETL tool to extract data from source systems, loaded the data into the DB2 database
- Designed and developed DataStage jobs to extract data from multiple sources, applied transformation logic to extracted data, and loaded the data into Data Warehouse Databases.
- Created PX Jobs using different stages such as, Aggregator, Change Data Capture, Copy, Filter, Funnel, Join, Lookup Merge, Remove Duplicates, Sample, Surrogate Key, Sort, Column Generator, Row Generator, and Peek.
- Used some UNIX scripts to archive the files to permanent folder and also to run the DS job.
- Worked in deployment of DS jobs from one environment to other and also in Bug fixing.
- Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
- Worked in performance tuning of the job at both DB2 and DataStage level by creating index, partitioning and triggers.
- Created Parameter Sets and Worked in creating of user defined environment variables, environment variables that improves the job execution.
- Involved in complete phase till the job is deployed to production where we have taken care in UAT, SIT phases in bug fixing.
- Created job sequences which includes different stage notification activity, Execute Command activity, Sequencer, UserVariables Activity.
- Maintained Data Warehouse by loading dimensions and facts as part of the overall project.
Environment: IBM Information Server DataStage 8.7, Oracle 12.1, PL/SQL,UNIX
Confidential, Lakeville, MN
ETL Developer/Support
Responsibilities:
- Extensively use IBM Information server Designer 8.7/8.5 to develop various jobs to extract, cleanse, transform, integrate and load data into tables and target tables and interface files.
- Extract data from various sources performed Data transformations and loaded into the target interface files and tables.
- Unit test and document all the results.
- Develop jobs for extracting, cleansing, transforming, integrating and loading data into data warehouse.
- Prepare technical design/specifications for Data Extraction, Data Transformation, Data Cleansing and Data Loading.
- Develop jobs to load History data from legacy data merits to Enterprise Data Warehouse.
- Develop numerous transformations to populate Data warehouse tables.
- Develop Parallel Jobs for parallel processing to reduce the complexities and to speed up processing.
- Design and developed Aggregator, Lookup, Joins, and Merge transformations according to business rules.
- Implement Surrogate key functionality for newly inserted rows in Data warehouse which made data availability more convenient.
- Work on different Databases Oracle, SQL Server and RDBMS.
- Develop jobs to handle Type 1 and Type 2 Slowly Changing Dimension Loads from Type1/Type2 data sources- Member and provider Master using Lookup/Transformer or Join Stages.
- Optimize job performance with various partitioning techniques in the parallel processing environment.
- Support through the successful execution of all the jobs in Production.
Environment: IBM Information Server (DataStage) 8.7/8.5, Oracle 12.1, UNIX, SQL, PL/SQL, Toad, UNIX Shell Scripting.
Confidential - Milwaukee, WI
Sr. ETL DataStage Developer
Responsibilities:
- Involved in complete Data Warehouse Life Cycle from requirements gathering to end user support.
- Provided day-to-day and month-end production support for various applications like Business Intelligence Center, and Management Data Warehouse by monitoring servers.
- Involved in Designing, Testing and Supporting DataStage jobs.
- Developed Parallel jobs using various stages like Join, Merge, Lookup, Surrogate key, Scd, Funnel, Sort, Transformer, Copy, Remove Duplicate, Filter, Pivot and Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems.
- Accomplished various development requests through mainframe utilities, CICS Conversation
- Meet the clients on a weekly basis to provide better services and maintain the SLAs.
- Used Control-M to schedule jobs by defining the required parameters and monitor the flow of jobs.
- Automated the process of generating daily and monthly status reports for the processing jobs.
- Drop indexes, remove duplicates, rebuilt indexes and rerun the jobs failed due to incorrect source data.
- Involved in the process of two client bank mergers by taking care of the customer account numbers, Bank numbers, and their respective applications.
Environment: IBM Info sphere DataStage 8.5/8.1, SunOS 5.8, Control-M 6.4.01, PL/SQL Developer 7.1, Teradata12, Erwin, Autosys, Toad, and Case Management System.
Confidential - Milwaukee, WI
DataStage Developer
Responsibilities:
- Performed Unit test/Link Test on various integration.
- Worked extensively on Data warehousing, used DataStage an ETL tool to design mappings to move Data from Source to Oracle database-using Stages.
- Interacted with Business/Domain expert to gather ETL requirements & analysis of various data sources, Flat files and oracle.
- Interacted with DBA team to convert Logical Data Model into the Physical Data Model and participated in the data modeling processes using Erwin as the modeler.
- Involved in design and development of parallel jobs using DataStage designer.
- Designed and Developed of DataStage ETL jobs using various stages like Aggregator, Join,
- Transformer, Sort, Merge, Filter and Lookup, Sequence, Modify, Peek etc. stages to load Daily and Historical data into star schema data model.
- Developed UNIX shell scripts to automate file manipulation and data loading procedures.
- Wrote PL/SQL and TSQL Stored procedures for processing business logic in the database.
- Tuning of SQL queries for better performance.
- Involved in Data Extraction, Transformation and Loading (ETL process) from Source to target systems using DataStage PX.
- Successfully Integrated data across multiple source with high volumes of data.
- Deployed the solutions that maximize the consistency and usability of data.
- Performed Tuning of existing ETL Jobs and Automation of ETL processes using DataStage Job
- Sequencer, Job Control routines and Transform functions.
Environment: IBM Info Sphere Information Server V8.5 Suite DataStage, Oracle 10g, Oracle PL/SQL, UNIX Shell Scripting, Erwin.
Confidential - Lisle, IL
DataStage Developer
Responsibilities:
- Worked extensively on Data warehousing, extensively used DataStage to design jobs per the mappings to move data from Source to Target database-using various stages.
- Interacted with Business/Domain expert to gather ETL requirements & analysis of various data
- Sources, Flat files, Oracle, SQL server.
- Interacted with DBA team to convert Logical Data Model into the Physical Data Model.
- Designed and Developed of DataStage ETL jobs using various stages like Aggregator, Join,
- Transformer, Sort, Merge, Filter and Lookup, Sequence, Modify, Peek etc. stages to load Daily and Historical data into star schema data model.
- Broadly involved in Data Extraction, Transformation and Loading (ETL process) from Source to target systems using DataStage PX.
- Successfully Integrated data across multiple source with high volumes of data.
- Performed Tuning of existing ETL Jobs and Automation of ETL processes using DataStage Job
- Sequencer, Job Control routines and Transform functions.
- Migration of Entire ETL jobs/script//Shell Scripts/DSN connection to production environment.
- Involved in Design and developing the DataStage code along with Unit Testing and performancetuning.
- Designed ETL jobs to identify and remove duplicate rows using remove duplicate stage.
- Extensively worked with surrogate key generator to generate warehouse keys before loading data into warehouse
- Wrote UNIX shell script according to the business requirements.
- Created & Deployed SSIS (SQL Server Integration Services) Projects, Schemas and Configured Report Server to generate reports through SSRS SQL Server 2005.
- Supported to stakeholders in Regression testing.
- Followed all the processes as per agile methodology.
- Involved in high level standup meetings with the client and team.
- Documentation on Job designing and code review demos to the client.
Environment: IBM Info Sphere Information Server V8.5 Suite DataStage, Teradata 12, SQL Server 2005/08, PL/SQL, DB2, Oracle, UNIX Shell Scripting, Windows XP, Erwin.
Confidential, Columbus, OH
DataStage Consultant
Responsibilities:
- Worked extensively with Parallel Stages like Copy, Join Merge, Lookup, Row Generator, Column Generator, Modify, Funnel, Filter, Switch, Aggregator, Remove Duplicates and Transformer Stages
- Gathered requirements and wrote specifications for ETL Job modules.
- Worked as SME in providing support to the team in designing the flow of complex jobs.
- Provided technical support to the team and I also handled escalations.
- Worked on production support by selecting and transforming the correct source data.
- Data Warehouse implemented using sequential files from various Source Systems.
- Worked closely with DBA and BA to better understand the business requirement.
- Developed Mapping for Data Warehouse and Data Mart objects.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Designed and Developed ETL jobs using DataStage tool to load data warehouse and Data Mart.
- Performed tuning of ETL jobs.
- Performed data manipulation using BASIC functions and DataStage transforms.
- Imported relational metadata information for project.
- Developed DataStage Routines for job Auditing and for extracting job parameters from files.
- Created master controlling sequencer jobs using the DataStage Job Sequencer.
- Created and use DataStage Shared Containers, Local Containers for DS jobs and retrieving Error log information.
- Designed, build, and managed complex data integration and load process
- Developed PL/SQL scripts to perform activities at database level.
Environment: IBM DataStage 7.5, Oracle 9i/10g, DB2 UDB, Mainframe, PL/SQL Development.