We provide IT Staff Augmentation Services!

Sr.etl Consultant Resume

0/5 (Submit Your Rating)

Philadelphia, PA

SUMMARY

  • 7+ years of IT experience with special emphasis on development, analysis and design of ETL methodologies in all the phases of the Data Warehousing life cycle with knowledge in ETL, Data Warehousing, OLAP & OLTP system technologies.
  • Experience using IBM Web Sphere/Ascential DataStage (Ver.8.x, 7.5x2/7.x)Server Edition, Enterprise Edition (Parallel Extender).
  • Excellent knowledge on data warehousing applications, directly responsible for the Extraction, Transformation and Loading of data from multiple sources into Data Warehouse.
  • Production job scheduling on UNIX through Control - M scheduling tool and also using DataStage.
  • Extensive background using Oracle development tool set (Including PL/SQL, SQL*Plus, SQL Loader, PL/SQL developer).
  • Involved in all the stages of Software Development Life Cycle.
  • Extensively used DataStage Client components like DataStageDesigner, Director, Manager and Administrator in Data Warehouse development.
  • Worked with Data Migration, Data Conversion in diverged environment like DB2 UDB, Oracle, SQL Server and complex files.
  • Proficiency in Design, Development, Implementation, Administration and Support of ETL processes for Data Marts and large scale Data Warehouses using DataStage PX 8.X ETL tool
  • Proven track record in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancement.
  • Experience in Parallel Extender (DS-PX) developing Parallel jobs using various stages including Aggregator, Join, Transformer, Sort, Merge, Filter and Lookup.
  • Demonstrated ability in dealing with different stages (Hash, Shared Containers, and Merge etc).
  • Strong understanding of the principles of DW using Fact Tables, Dimension Tables, Star and Snowflake schema modeling.
  • Experience in designing Data Marts and Data Warehouse using Star Schema and Snowflake Schema in implementing Decision Support Systems.
  • Good knowledge on OLAP tool like Business objects
  • Strong experience in UNIX Shell scripting (Korn, BASH, and CSH) as part of file manipulation, Scheduling and text processing.
  • Experienced in writing system specifications, translating user requirements to technical specifications.
  • Extensive experience in MS- SQL 2005, PL/SQL, SQL, Procedures and Oracle 9i.
  • Effective in cross-functional and global environments to manage multiple tasks & assignments concurrently.
  • Played significant role in various phases of project life cycle, such as requirements definition, functional & technical design, testing, Production Support and implementation.
  • Multilingual, highly organized, detail-oriented professional with strong technical skills.
  • Good aptitude for problem solving and logical analysis.
  • Highly motivated, team player with excellent interpersonal and communication skills, organized and quick learner.

TECHNICAL SKILLS

ETL Tools: IBM Web sphere /Ascential DataStage 8.x /7.5x2/7.x /6.x, Quality Stage

Data model: Erwin 4.2

Operating Systems: Windows XP, NT, Windows 95, MS-DOS, UNIX

Computer Languages: PL-SQL, C, C++, COBOL, Visual Basic 6.0, XML, JavaScriptVBScript, Unix Shell Scripts, Control-M & Perl Scripts.

Dimensional Data Modeling: Dimensional Data Modeling, Data Modeling, Star Join Schema Modeling, Snow-Flake Modeling, FACT and Dimensions Tables, Physical and Logical Data Modeling, ERWin 3.5.2/3.x, Oracle Designer.

RDBMS: MS-Sql 2005, ORACLE (8, 9i, 10g, 11i), SQL, Teradata and MS- Access.

PROFESSIONAL EXPERIENCE

Confidential, Chicago IL

Consultant

Responsibilities:

  • Provided live support to Production DataStage runs and client requirements.
  • Fulfilled High Priority tickets with SLA of 3 hrs to meet the needs of High Stake Clients.
  • Coordinated with data modeler and database administrator to understand the business process of the data warehouse model.
  • Involved in scheduling the DataStage jobs using Control-M.
  • Extracted the source data from different sources like Complex Fixed width Multiple record type flat files(from Mainframes) and Oracle Databases, cleanse the data, Applied business rules and loaded OLTP (SCD Type1) and Data Warehouse (SCD Type2) at the same time.
  • Worked on creating a common Data Quality job which performs Data type checks, Data Validation Checks and Parent Child relation checks on Source files that come from different vendors like EDS,TSYS, Visa and MasterCard.
  • Performance Tuned the jobs by applying best practice methods like using the appropriate stage while doing joins, eliminating unnecessary Sorting and re-partitioning and using lookup file sets instead of datasets etc.
  • Worked on creating Unix Shell Scripts to call the Datastage jobs from the Command line by export parameters needed during the runtime and scripts to modify and concatenate different source files in specific order.
  • Migrated data warehouse data from Oracle to Teradata.
  • Migrated jobs from DataStage 8.1 to DataStage 8.5 and enhanced jobs to utilize the new functionalities of 8.5.
  • Worked on new functionalities like State files option in Surrogate Key Generator, Parameter sets and ODBC Connector in Datastage 8.1 and Looping, Aggregations in Transformer, Query Optimizer in Datastage 8.5.
  • Also used New Query Optimizer functionality to load the data into Teradata Database.
  • Extensively worked on creating Shared Containers for re usability and code maintenance and Local Container to simplify the DataStage job.
  • Extensively worked on debugging the DataStage and SQL code and applied the required fixes based on the business rules and requirements.
  • Involved in creating complex SQL Queries for extracting the data from the database, Data Validations and Cleanup Scripts etc.
  • Worked on Creating Environment Variables, Parameter Sets, and modifying the APT Configuration file when required.
  • Also worked on creating Quality Stage jobs to cleanse and standardize the data based on business requirements.
  • Worked with DBA’s to address complex issues like identifying Deadlock, Memory issues, and PLSQL Packages, creating indexes, constraints and triggers
  • Involved in Source system analysis and Requirement Gathering meetings and created Design specification and Mapping Documents for ETL Process.
  • Involved in creating detailed design documents, Technical Design documents and Mapping documents and Test Cases for Datastage jobs.
  • Worked on Versioning the DataStage code and UNIX Scripts by checking in and checking out on regular bases using Clear Case by associating the isx with a ClearQuest Activity.

Environment: DataStage8.5, (Designer, Director, Administrator), SQL Server, Oracle 9i/8i, 3.2.2, IBM AIX 5.2, Universe Designer, Teradata 13.10, Oracle 11g, Oracle 11g-Release 2, SQL Server 2000/2005, UNIX Korn Shell scripting.

Confidential, Philadelphia PA

Sr.ETL Consultant

Responsibilities:

  • Designed,developed and monitored DataStage Parallel jobs using DataStage8.1(Enterprise Edition).
  • Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
  • DevelopedETL routines based on technical requirements.
  • Managed star schema/snowflake data warehousing projects for medium and large corporations in diverse industries.
  • Complicated jobs were developed to include changing business rules and perform quality checks on data received from external vendors.
  • Used the DataStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts.
  • Experience Analyzing, Sourcing and Parsing complex Flat files and XML.
  • Defined the data definitions and created the target tables in the database.
  • Wrote Korn Shell scripts to schedule batch jobs to obtain data overnight from various locations, through Scheduling tool called Control-M.
  • Mapped the source and target databases by studying the specifications and analyzing the required transforms.
  • Unit tested the mappings to check for the expected results.
  • Experiencein conducting data validation using SQL.
  • Architected and managed implementation of Oracle star schema/snowflake conformed data marts.
  • Involved in development of UNIX shell scripts for Batch jobs etc run.
  • UNIX Shell scripting (Korn, BASH, and CSH) as part of file manipulation, Scheduling and text processing.
  • Prepared test docs which involved preparation of test data, test case and unit testing of the jobs
  • Provided data modeling support for numerous strategic application development projects.
  • Created various classes and objects for Universe. Measure, Dimension and Detail objects were created to meet the needs of end user requirements so that every possible query can be achieved.
  • Involved in the designing and development of Universes, Classes and Objects.
  • Organized data in reports by using filters, sorting, ranking and highlighted data with alerts.

Environment: Ascential DataStage8.1, (Designer, Director, Manager, Parallel Extender), Windows Server 2003, UNIX Shell Scripts,XML,DOS, Oracle 9i,10g,SQL,SQL *Loader, Business Objects 6.5 PL/SQL, IBM DB2, MS Access, Control-M, Perl, IMS.

Confidential, San Francisco CA

DataStage Consultant

Responsibilities:

  • Data analysis, data mapping, extract, transformation and load
  • Involved in creating Conceptual design which gives the Source to target mappings with the business transformation rules.
  • Worked with functional staff to translate business requirements into appropriate logical and physical data structures
  • Developed source to target mappings with transformation rules.
  • Involved in defining the intermediate snap tables.
  • Created process flow diagrams.
  • Used various stages like pivot, sequential file, sort, merge, pivot, modify, aggregator etc.
  • Involved in production support on rotational basis.
  • Developed job sequence and implemented restart ability using various checkpoints
  • Extensively worked on DataStage Director, DataStage Manager.
  • Written Unix Shell Script for creating Header and Tailer for the output file.
  • Involved in Test case writing and code review.
  • Used DataStage version control to move the jobs from DEV to SYS to PROD.
  • Developed and deployed Control-M jobs.
  • Created parallel extender jobs to extract data from different source files, transform the data using stages like Transformer stage.
  • Mapped the source and target databases by studying the specifications and analyzing the required transforms.
  • Unit tested the mappings to check for the expected results.
  • Experiencein conducting data validation using SQL.
  • Involved in development of UNIX shell scripts for Batch jobs etc run.
  • Strong experience in UNIX Shell scripting (Korn, BASH, and CSH) as part of file manipulation, Scheduling and text processing.
  • Prepared test docs which involved preparation of test data, test case and unit testing of the jobs
  • Provided data modeling support for numerous strategic applications.

Environment: DataStage Enterprise Edition (8.1, Designer, Director, Manager, Parallel Extender), Windows Server 2003, SQL Server 7.0, Oracle 9i, SQL, PL/SQL, UNIX Shell Scripts, SQL*Loader, Erwin 4.1.

Confidential, Murray Hills NJ

DataStage Contractor

Responsibilities:

  • Extensively worked on Data Extraction, Data Integration, Transforms Loading and Analysis.
  • Created transforms using stage variables for jobs and code for batch jobs to run jobs in parallel.
  • Knowledge of configuration files and partition techniques for Parallel jobs.
  • Extensively used Parallel Stages like JOIN, LOOKUP, FUNNEL, and REMOVE DUPLICATES for development.
  • Used DataStage Manager for importing Metadata from repository, new job categories and importing table definitions from database tables.
  • Designed, Developed, Tested server and parallel jobs according to technical design documents.
  • Experienced in complete life cycle (Design, Development, Maintenance and Documentation) of Conversion Process.
  • Extracted data from legacy telecommunications systems using Monarch Software (report mining/data analysis software), delimited files, Excel files and ACCESS databases.
  • Developed server job routines for custom tasks to be handled in job sequencers
  • Used DataStage as an ETL tool to extract data from sources systems, aggregate the data and load into the Teradata database.
  • Developed UNIX shell scripts using Korn Shell for automating the initial load conversion process, which calls ETL jobs to load data to the database system.
  • Developed a Validation Processing system for entities like Merchants, Terminals in (and) Express.
  • Extensive knowledge on Oracle, 9i and 10g, with experience within very large scale database environment and mission critical large OLTP (Informix) and OLAP systems.
  • Performing import and export of data stage components, table definitions and routines using DataStage Manager.
  • Provided technical support by responding to inquiries regarding errors, problems, or questions in Production environment.
  • Provided IT Support to multiple environments like Production and UAT Environments.
  • Coordinated with CM team to deploy ETL code to production environments.
  • Worked with DBA team to improve the loading performance in conversion cycles by using proper indexes in the queries in ETL jobs.
  • Worked with SDE team to analyze the errors that came up during conversions and applied the business rules to ETL jobs as per the solutions provided by SDE team.
  • Written documentation to describe program development, logic, coding, testing, changes and corrections.

Environment: Ascential DataStage 8.1, (Designer, Director, Manager, Parallel Extender), Windows Server 2003, UNIX Shell Scripts, Oracle 9i, 10g, SQL, SQL*Loader, Business Objects 6.5, PL/SQL, IBM DB2, MS Access, Control-M, Perl, IMS.

Confidential, Ashburn VA

Sr. DataStage Developer

Responsibilities:

  • Extensively worked on Data Extraction, Data Integration, Transforms Loading and Analysis.
  • Created transforms using stage variables for jobs and code for batch jobs to run jobs in parallel.
  • Knowledge of configuration files and partition techniques for Parallel jobs.
  • Extensively used Parallel Stages like JOIN, LOOKUP, FUNNEL, and REMOVE DUPLICATES for development.
  • Used DataStage Manager for importing Metadata from repository, new job categories and importing table definitions from database tables.
  • Designed, Developed, Tested server and parallel jobs according to technical design documents.
  • Experienced in complete life cycle (Design, Development, Maintenance and Documentation) of Conversion Process.
  • Extracted data from legacy telecommunications systems using Monarch Software (report mining/data analysis software), delimited files, Excel files and ACCESS databases.
  • Developed server job routines for custom tasks to be handled in job sequencers
  • Used DataStage as an ETL tool to extract data from sources systems, aggregate the data and load into the Teradata database.
  • Developed UNIX shell scripts using Korn Shell for automating the initial load conversion process, which calls ETL jobs to load data to the database system.
  • Developed a Validation Processing system for entities like Merchants, Terminals in(and) Express.
  • Extensive knowledge on Oracle, 9i and 10g, with experience within very large scale database environment and mission critical large OLTP (Informix) and OLAP systems.
  • Performing import and export of data stage components, table definitions and routines using DataStage Manager.
  • Provided technical support by responding to inquiries regarding errors, problems, or questions in Production environment.
  • Provided IT Support to multiple environments like Production and UAT Environments.
  • Coordinated with CM team to deploy ETL code to production environments.
  • Worked with DBA team to improve the loading performance in conversion cycles by using proper indexes in the queries in ETL jobs.
  • Worked with SDE team to analyze the errors that came up during conversions and applied the business rules to ETL jobs as per the solutions provided by SDE team.
  • Written documentation to describe program development, logic, coding, testing, changes and corrections.

Environment: Ascential DataStage8.0, (Designer, Director, Manager, Parallel Extender), Windows Server 2003, UNIX Shell Scripts, Oracle 9i, 10g, SQL, SQL*Loader, Business Objects 6.5, PL/SQL, IBM DB2, MS Access, Control-M, Perl, IMS.

Confidential

Intern

Responsibilities:

  • Requirement specification document preparation
  • Involved in the development of parallel extender jobs using various stages
  • Preparation of design guidelines for DB2 Database, DataStage ETL and Unix.
  • Involved in Designed jobs and analyzing scope of application, defining relationship within groups of data.
  • Used the DataStageDesigner to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse.
  • Analysis of star schema and data model.
  • Identifying suitable dimensions and facts for schema.
  • Extensive experience in creating and loading data warehouse tables like dimensional, fact and aggregate tables using Ascential DataStage.
  • Developed Job Control routines and Transform functions for converting data from one format to other Format.
  • Writing Perl, UNIX Shell Scripts for processing/cleansing incoming text files.
  • Writing Oracle Stored Procedures, SQL scripts and calling at pre and post session.
  • Coordinating tasks and issues with Team Lead and Project Manager on daily basis.

Environment: Ascential DataStage7.5, 7.5x2, Universe Basic, Oracle 8i, SQL Server, SQL,, Business Objects 5.1, Web Intelligence, Shell Scripts, Erwin, Windows NT 4.0, AIX 4.x, Perl, PVCS, XML

We'd love your feedback!