Etl Data Stage Senior Developer Resume
NC
SUMMARY
- Having 9+ years of experience Data Warehousing and Business Intelligence applications using IBM Info Sphere Data Stage 11.3/9.1/8.5/8.7/8.1 Server/Parallel environments.
- Experience in Data Warehousing applications, responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse.
- Experience in design and development of parallel jobs using Parallel Extender for splitting bulk data into subsets and to dynamically distribute to all available nodes to achieve best Job performance, Involved in maintaining logical and physical models.
- Worked extensively on different types of stages like ODBC, Dataset File, Aggregator, Transformer, Merge, Join, Lookup, Sort, Pivot, Shared Containers (Server, Parallel) etc. for developing jobs
- Worked on data extraction, Transaction and loading data from various sources like Oracle, DB2, Teradata, Netezza and Flat files using Data Stage .
- Excellent knowledge in Extraction, Cleansing and Modification of data from/to various Data Sources like Flat Files, Sequential files, Comma Delimited files (.csv), XML and Databases like Hadoop, Oracle, ODBC, DB2, Teradata etc.
- Created jobs, Reusable Components (Shared Containers) and job Sequences.
- Used debugging/dev stages to effectively debug the jobs in the development environment.
- Experience in integration of various data sources like Teradata, SQL Server, Oracle, DB2, Netezza and Flat Files.
- Having experience on to deal with Unstructured Data & XML files.
- Extensive experience in migrating the jobs from lower version to higher version of Data stage.
- Having complete domain and development knowledge of Data Warehousing Life Cycle. Experience in Design, Development, and Maintenance & Support of Enterprise applications using DWH technologies with Software Development Life Cycle.
- Possess strong hands - on experience and functional knowledge in Information management stream that includes Data warehousing/Business intelligence.
- Experience in creating Mapping documents with business transformations from source to target by coordinating with Business analysts and getting signoff on various Documents from Business team.
- Experience in Prepare the Business Requirement Documents (BRD), Functional Specification Documents (FSD) and Design Specification Documents.
- Expertise in unit testing, system integration testing, implementation, maintenance and performance tuning.
- Experience in the Post production support of the application developed and provided 24x7 supports for the production issues and resolved critical issues within the SLA.
- Experienced in scheduling Sequence and parallel jobs using Data Stage Director, Autosys.
- Used Agile Methodology in various projects. Implemented Agile with scrum and Sprints using Kanban software. Conducted weekly staff meetings and daily stand-ups to monitor the progress of the projects
- Worked with SQL, SQL*PLUS, Oracle PL/SQL Stored Procedures, Triggers, SQL queries and loading data into Data Warehouse/Data Marts.
- Excellent experience in Relational database (RDBMS), Oracle 11g/10g/9i/8i, Microsoft SQL Server, Teradata Load, Teradata MultiLoad, TOAD, DB2 and Netezza.
- Experience in SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS)
- Worked on SAP BANK analyzer, used to store facility for both source data and results data in order to provide the basis for consistent calculations and measurement of financial objects.
- Working knowledge in UNIX environment and have exposure in UNIX commands.
- Excellent knowledge in data warehousing in retail, banking, domain.
TECHNICAL SKILLS
DWH Technologies: IBM Web Sphere Data stage 8.0/8.1/8.7/9.1/11.3 , Quality Stage, Informatica PowerCenter9.x/8.x/7.x
Databases: OO Oracle 11g/10g/9i/8i, DB2, Teradata, Netezza, MS SQL Server 2008/2005
Programming Languages: C, Sql, PL/Sql
Operating Systems: Windows 95/98/NT/2000/XP, Unix, Linux
Other Tools: Toad, HP Quality Center, Microsoft office, Putty, Kanban, Teradata SQL Assistant,, Remedy, HP Service Manager
Scheduling: Autosys
PROFESSIONAL EXPERIENCE
Confidential, NC
ETL Data Stage Senior Developer
Environment: IBM Data Stage 11.3, LINUX, TOAD, TERADATA, DB2, SAP Bank Analyzer. Oracle 11g,, HP QC, Autosys, Agile Kanban .
Responsibilities:
- Involved in the requirement definition and analysis in support of Data Warehousing efforts.
- Developed ETL mappings, Transformations and Loading using Data Stage 11.3.
- Created data stage jobs to validate the data file with control file. Involved in Performance Tuning.
- Extensively used various stages of Data Stage such as Lookup, Join, Merge, Complex Flat File, Sequential Flat file, Datasets, Sort, Change Data Capture, Remove Duplicate, Copy, Oracle, Transformers, Surrogate Key generator, Peek, Column Generator.
- Extensively involved in analyzing source system data structures and mapping the structures to target data warehouse schemas.
- Extensively worked on import/export of Data Stage Components (Jobs, Routines, DS Transforms, and Table Definitions etc.) between Data Stage Projects, multiple jobs compile utility with use of Data Stage Manager.
- Extensively involved in Extraction, Transformations and Loading (ETL) of the data from Different servers
- Create routines to validate if zero records are not unloaded from the source.
- Created sequencers using the loop activity, file watcher, nested condition.
- Following Agile methodology - Kanban process
- View of Business & functional and validating the same.
- Created various project related docs such as ELLD, URR, Test Cases.
- Automated the entire ETL flow using Autosys and TWS scheduling tools.
- Developed a very complex data validation and error handling jobs.
- Created Jobs to classify the data into subject areas as source jobs.
- Created Jobs to load the data into NDW from various subject areas as Target jobs.
- Used Various Standard and created custom routines to use in DataStage jobs.
- Extensively worked with Data Stage Shared Containers for Re-using the Business functionality.
- Extensively wrote user-defined SQL coding for overriding for auto generated SQL query in DataStage.
- Written batch Job Controls for automation of execution of DataStage Jobs.
- Defined Stage variables for data validations and data filtering process.
- Worked on performance tuning to address very critical and challenging issues.
Confidential, MD
ETL - Senior Developer/ Production support
Environment: Informatica Power center 8.6.1,Windows XP, Unix, SQL, PL/SQL,TOAD, Oracle 11g, TERADATA.
Responsibilities:
- Involved in creating Detail design documentation to describe program development, logic, coding, testing, changes and corrections.
- Extensively involved in writing ETL Specifications for Development and conversion projects.
- Created shortcuts for reusable source/target definitions, Reusable Transformations, mapplets in Shared folder.
- Involved in requirement definition and analysis in support of Data Warehouse.
- Worked extensively on different types of transformations like Source qualifier, expression, Aggregator, Router, filter, update strategy, lookup, sorter, Normalizer, sequence generator, etc.
- Worked with XSD and XML files generation through ETL process.
- Defined and worked with mapping parameters and variables.
- Designed and developed transformation rules (business rules) to generate consolidated (fact/summary) data using Informatica ETL tool.
- Performed the performance evaluation of the ETL for full load cycle.
- Checked Sessions and error logs to troubleshoot problems and also used debugger for complex.
- Worked on Parameterize of all variables, connections at all levels in UNIX.
- Created test cases for unit testing and functional testing.
- Coordinated with testing team to make testing team understand Business and transformation rules being used throughout ETL process.
Confidential, Milwaukee
ETL - Senior Developer
Environment: Informatica 9.1,UNIX, TOAD, Oracle 11g, Autosys, SQL server 2005, SQL,Flat files
Responsibilities:
- Prepared technical design/specifications for data Extraction, Transformation and Loading.
- Worked on Informatica Utilities Source Analyzer, warehouse Designer, Mapping Designer, Mapplet Designer and Transformation Developer.
- Analyzing the sources, transforming data, mapping the data and loading the data into targets using Informatica Power Center Designer.
- Created reusable transformations to load data from operational data source to Data Warehouse and involved in capacity planning and storage of data.
- Used various transformations like Stored Procedure, Connected and Unconnected lookups, Update Strategy, Filter transformation, Joiner transformations to implement complex business logic.
- Used Informatica Workflow Manager to create workflows, database connections, sessions and batches to run the mappings.
- Used Variables and Parameters in the mappings to pass the values between mappings and sessions.
- Created Stored Procedures, Functions, Packages and Triggers using PL/SQL.
- Implemented restart strategy and error handling techniques to recover failed sessions.
- Did performance tuning to improve Data Extraction, Data process and Load time.
- Wrote complex SQL Queries involving multiple tables with joins.
- Implemented best practices as per the standards while designing technical documents and developing Informatica ETL process.
Confidential
Environment: IBM Data Stage 11.3, Linux, TOAD, TERADATA, DB2, SAP Bank Analyzer. Oracle 11g. Autosys.
Responsibilities:
- Involved in the requirement definition and analysis in support of Data Warehousing efforts.
- Created ELLD documents and other reference documents for migration of the code to the new environment
- Worked on Migrating the Code to the new development Box.
- Involved in moving all the scripts from UNIX to Linux and changing the required attributes.
- Involving in assisting and testing the functioning of the new SAP packs in 11.3.
- Moved the required data from existing production environments to new staging to run and test the jobs
- Involved in testing through all the faces UT, SIT, UAT1, UAT 2.
- Involved in Performance Tuning.
- Extensively worked on import/export of Data Stage Components (Jobs, Routines, DS Transforms, and Table Definitions etc.) between Data Stage Projects, multiple jobs compile utility with use of Data Stage Manager.
- Checking for Data Integrity, Referential Integrity in the process of loading various source data to Target
- Created various project related docs such as ELLD, URR, Test Cases.
- Involved in Review of Unit Test Cases.
- Involved & actively participated in Deployments.
Confidential
Environment: IBM Data Stage 9.1, UNIX, TOAD, TERADATA, DB2, SAP Bank Analyzer. Oracle 11g .
Responsibilities:
- Involved in the requirement definition and analysis in support of Data Warehousing efforts.
- Developed ETL mappings, Transformations and Loading using Data Stage 9.1.
- Extensively used ETL to load data from Flat files, Mainframes, various databases like ORACLE, TERADATA & DB2.
- Involved in Performance Tuning.
- Extensively used various stages of Data Stage such as Lookup, Join, Merge, Complex Flat File, Sequential Flat file, Datasets, Sort, Change Data Capture, Remove Duplicate, Copy, Oracle, Transformers, Surrogate Key generator, Peek, Column Generator.
- Extensively involved in analyzing source system data structures and mapping the structures to target data warehouse schemas.
- Extensively worked on import/export of Data Stage Components (Jobs, Routines, DS Transforms, and Table Definitions etc.) between Data Stage Projects, multiple jobs compile utility with use of Data Stage Manager.
- Extensively involved in Extraction, Transformations and Loading (ETL) of the data from SQL Server 2005, DB2 and loaded to SQL Server 2008 database.
- Checking for Data Integrity, Referential Integrity in the process of loading various source data to Target in
- View of Business & functional and validating the same.
- Created various project related docs such as ELLD, URR, Test Cases.
- Involved in Review of Unit Test Cases.
- Involved & actively participated in Deployments.
- Taking charge to in corporate the new Change Requests.
Confidential
Environment: IBM Data Stage 8.1, UNIX, TOAD, TERADATA, DB2, SAP Bank Analyzer,Hp Quality center, Autosys, Remedy
Responsibilities:
- Involved in the requirement definition and analysis in support of Data Warehousing efforts.
- Developed ETL mappings, Transformations and Loading using Data Stage 8.1.
- Extensively used ETL to load data from Flat files, Mainframes, various databases like ORACLE, TERADATA & DB2.
- Experienced working with SAP packs.
- Involved in Performance Tuning.
- Extensively used various stages of Data Stage such as Lookup, Join, Merge, Complex Flat File, Sequential Flat file, Datasets, Sort, Change Data Capture, Remove Duplicate, Copy, Oracle, Transformers, Surrogate Key generator, Peek, Column Generator.
- Extensively involved in analyzing source system data structures and mapping the structures to target data warehouse schemas.
- Extensively worked on import/export of Data Stage Components (Jobs, Routines, DS Transforms, and Table Definitions etc.) between Data Stage Projects, multiple jobs compile utility with use of Data Stage Manager.
- Extensively involved in Extraction, Transformations and Loading (ETL) of the data from SQL Server 2005, DB2 and loaded to SQL Server 2008 database.
- Checking for Data Integrity, Referential Integrity in the process of loading various source data to Target in
- View of Business & functional and validating the same.
- Created various project related docs such as ELLD, URR, Test Cases.
- Involved in Review of Unit Test Cases.
- Involved & actively participated in Deployments.
- Taking charge to in corporate the new Change Requests.
- Providing the day to day business application support
- Engaging the different teams to resolve the Production issues on priority basis
- Giving the Timely and accurate notifications to concerned teams as per the production process regarding the production data availability
- Troubleshooting the defects and involved in break-fixing the code
- Involved in creating the spread sheets with production runtimes and production jobs status
- Involved in ensuring the proper hand over between the onshore and offshore team regarding the production cycle
Confidential
Environment: IBM Data Stage 8.1, UNIX, TOAD, TERADATA, DB2, SAP Bank Analyzer,Hp Quality center, Autosys, Remedy
Responsibilities:
- Involved in the requirement definition and analysis in support of Data Warehousing efforts.
- Developed ETL mappings, Transformations and Loading using DataStage 8.1.
- Extensively used ETL to load data from Flat files, Mainframes, various databases like ORACLE, TERADATA & DB2.
- Experienced working with SAP packs.
- Involved in Performance Tuning.
- Extensively used various stages of DataStage such as Lookup, Join, Merge, Complex Flat File, Sequential Flat file, Datasets, Sort, Change Data Capture, Remove Duplicate, Copy, Oracle, Transformers, Surrogate Key generator, Peek, Column Generator.
- Extensively involved in analyzing source system data structures and mapping the structures to target data warehouse schemas.
- Extensively worked on import/export of DataStage Components (Jobs, Routines, DSTransforms, and Table Definitions etc.) between DataStage Projects, multiple jobs compile utility with use of Data Stage Manager.
- Extensively involved in Extraction, Transformations and Loading (ETL) of the data from SQL Server 2005, DB2 and loaded to SQL Server 2008 database.
- Checking for Data Integrity, Referential Integrity in the process of loading various source data to Target in
- View of Business & functional and validating the same.
- Created various project related docs such as ELLD, URR, Test Cases.
- Involved in Review of Unit Test Cases.
- Involved & actively participated in Deployments.
- Taking charge to in corporate the new Change Requests.
Confidential
Environment: Teradata, UNIX shell scripting, IBM Web sphere Data Stage 8.1, Win SCP, Putty
Responsibilities:
- Created parallel jobs using data Stage Designer to load data from source to target table.
- Preparing ETL specifications, Unit Test Cases and Migration Documents.
- Written Autosys JIL files to schedule the jobs.
- Excessively used complex stages like aggregator, Lookup. Change capture, joiner, Funnel, etc...
- Created sequential file sets and Data sets as per the requirements.
- Specified the partitioning methods as per the stages where ever required.
- Debugged the jobs and resolved the formatting and other data quality issues.
- Created various project related docs such as ELLD, URR, Test Cases.
- Involved in Review of Unit Test Cases.
- Involved & actively participated in Deployments.
- Taking charge to in corporate the new Change Requests