We provide IT Staff Augmentation Services!

Etl Integration Lead Resume

0/5 (Submit Your Rating)

RI

SUMMARY

  • Over 7+ years of extensive experience in Information Technology with special emphasis on design, development, and administration of Database/Data Warehousing/Client - Server applications.
  • Experience in all the phases of the Data warehouse life cycle involving Data analysis, design, and development and testing using ETL, Data Modeling, Online Analytical Processing reporting tools.
  • Six years of Data warehousing ETL experience using tools like DataStage.
  • Extracted data from various sources such as Relational Sources (Oracle, SQL Server, and DB2) and File formats (flat files, .csv, and XML)
  • Experience in all Websphere Qualitystage stages like, Investigate, Standardization, Matching and Survive.
  • Worked on Data cleansing, matching user introduced data with database data, removing duplicates, and extraction of relations from source systems using QualityStage.
  • Experience in validating if data was compliant with organization standards and following business rules using QualityStage.
  • Experience in profiling the vendor supplied raw data using Information Analyzer.
  • Hands on experience in WebSphere Information Analyzer in a data profiling and data quality monitoring tool.
  • Experience in developing Scripts using UNIX Scripting.
  • Strong Database Knowledge of Oracle, Teradata V2R7/V2R5, Microsoft SQL Server 2008/2005.
  • Experience in InfoSphere Information Governance Cataloghelps users to understand the business meaning of their assets and provides search, browse, and query capabilities.
  • Experience in helping users to establish asset collections and run lineage reports to examine data flow between assets using InfoSphere Information Governance Catalogassets.
  • Extensively worked with Data stage Parallel Extender while working with high volume data sources and performed debugging, troubleshooting and administration activities.
  • Designed and developed complex jobs, from varied transformation logic using different stages like Transformer, Lookup, Filter, Aggregator, Join, Merge, Funnel, Sort, Change Capture and many more.
  • Proficient in interaction with the business users. Pioneered load strategies of loading staging area and data marts. Dealt with SCD Type1/Type2 loads.
  • ETL Performance Monitoring and Tuning to enhance the Analyze ETL workflows to identify performance bottlenecksby appropriately using the DataStage job stages and Partition methods.
  • Experience in atomization of complete ETL process using enterprise schedulers -Autosys, and Control-M.
  • Hands on experiencein analyzing and troubleshooting issues at functional and technical levels.
  • Good functional knowledge to interface with end-users and to identify the information needs and business requirements.
  • Pro-active, highly adaptable, work independently in a team environment.
  • Possess strong communication skills and believes in team work and cooperation.

TECHNICAL SKILLS

IBM Software: DataStage 5.x/6.x/7.x and Qualitystage 7.5.x, IBM Infosphere Information Server 8.x/9.x/11.3 ( Datastage, Quality Stage, Information Analyzer) IBM Infosphere Information Analyzer, IBM Infosphere Information Service Director, InfoSphere Information Governance Catalog/Assets/DashBorad, Metadata Workbench, Business Glossary.

Operating Systems: IBM AIX, Sun Solaris, Windows NT, 9x, 2000, 2003 server, XP, MS-DOS

Languages: Java, J2EE, C/C++,XML,XSL, SQL

Databases: Netezza, Oracle, Informix, SQL Server 2005, DB2, MS Access, Teradata Utilities T-Pump, Fast load, Multi Load, BTEQ.

Messaging/Web Servers: Websphere MQ Series, SOA

Data Modeling Tools: Erwin 4.1/3.5, Microsoft Visio

Applications and Tools: IBM Infosphere Information Server (Data stage, Quality Stage, Information Analyzer,Information Service Director),DB2,Enterprise Application Integration,MQ,Service Oriented Architecture, HP Quality Centre.

PROFESSIONAL EXPERIENCE

Confidential

ETL Integration Lead

Responsibilities:

  • Analysed, designed, developed, implemented and maintained Parallel jobs using IBM info sphere Data stage.
  • Involved in migrating datastage 9.1 to 11.3 version.
  • Generating DB scripts from Data modelling tool and Creation of physical tables in DB.
  • Worked SCDs to populate Type I and Type II slowly changing dimension tables from several operational source files
  • Created some routines (Before-After, Transform function) used across the project.
  • Experienced in PX file stages that include Complex Flat File stage, Dataset stage, Lookup File Stage, Sequential file stage.
  • Implemented Shared container for multiple jobs and Local containers for same job as per requirements.
  • Adept knowledge and experience in mapping source to target data using IBM Data Stage 8.x
  • Implemented multi-node declaration using configuration files (APT Config file) for performance enhancement.
  • Experienced in developing parallel jobs using various Development/debug stages (Peek stage, Head & Tail Stage, Row generator stage, Column generator stage, Sample Stage) and processing stages (Aggregator, Change Capture, Change Apply, Filter, Sort & Merge, Funnel, Remove Duplicate Stage)
  • Debug, test and fix the transformation logic applied in the parallel jobs
  • Involved in creating UNIX shell scripts for database connectivity and executing queries in parallel job execution.
  • Used the ETL Data Stage Director to schedule and running the jobs, testing and debugging its components & monitoring performance statistics.
  • Experienced in using SQL*Loader and import utility in TOAD to populate tables in the data warehouse.
  • Successfully implemented pipeline and partitioning parallelism techniques and ensured load balancing of data.
  • Deployed different partitioning methods like Hash by column, Round Robin, Entire, Modulus, and Range for bulk data loading and for performance boost.
  • Repartitioned job flow by determining DataStage PX best available resource consumption.
  • Created Universes and reports in Business object Designer.
  • Created, implemented, modified and maintained the business simple to complex reports using Business objects reporting module.

Environment: IBM Information Server v11.3, Oracle 11g, Flat files, JAMS Scheduling, UNIX, Erwin, TOAD, Oracle 10/11g, XML files.

Confidential

ETL Datawarehouse Integration Consultant

Responsibilities:

  • Collecting, collating and carrying out complex data analysis in support of management & customer requests. Also involved in reporting statistical findings to work colleagues and senior managers.
  • Co-ordinate with RAROC Business Users, Vendor for software upgrades, new releases, and Hot Fixes.
  • Develop new ETLs in DataStage for daily and monthly data loads from various data sources.
  • Setup, Maintain and Support VB.Net Web applications, SQL Databases (DBA Role) of DEV, UAT, TRAINING, PPOD and DR environments.
  • Support deployment and Release Management/Change Management Process.
  • Support 24 X 7 application and users support

Environment: IBM Information Server 9.1, (Designer, Manager, Director), Microsoft Visio, Windows XP, Unix Shell scripting, Oracle 11g, Excel Files.

Confidential

Sr. Datastage/Quality Stage developer-IA

Responsibilities:

  • Involved as primary on-site ETL Developer during the analysis, planning, design, development, and implementation stages of projects using IBM Web Sphere software (Quality Stage v8.1, Web Service, Information Analyzer, Profile Stage, WISD of IIS 8.0.1).
  • Prepared Data Mapping Documents and Design the ETL jobs based on the DMD with required Tables in the Dev Environment.
  • Active participation in decision making and QA meetings and regularly interacted with the Business Analysts &development team to gain a better understanding of the Business Process, Requirements & Design.
  • Used DataStage as an ETL tool to extract data from sources systems, loaded the data into the Netezza database.
  • Created data governance and privacy policies specifying contract implementation.
  • Implemented metadata standards, data governance and stewardship, master data management, ETL, ODS, data warehouse, data marts, reporting, dashboard, analytics, segmentation, and predictive modeling
  • Extensively worked with Join, Look up (Normal and Sparse) and Merge stages.
  • Extensively worked with sequential file, dataset, file set and look up file set stages.
  • Extensively used Parallel Stages like Row Generator, Column Generator, Head, and Peek for development and de-bugging purposes.
  • Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis.
  • Developed complex store procedures using input/output parameters, cursors, views, triggers and complex queries using temp tables and joins.
  • Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
  • Creation of jobs sequences.
  • Maintained Data Warehouse by loading dimensions and facts as part of project. Also worked for different enhancements in FACT tables.
  • Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through scheduling tool.
  • Coordinate with team members and administer all onsite and offshore work packages.
  • Analyze performance and monitor work with capacity planning.
  • Performed performance tuning of the jobs by interpreting performance statistics of the jobs developed.
  • Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
  • Participated in weekly status meetings.
  • Developed Test Plan that included the scope of the release, entrance and exit criteria and overall test strategy. Created detailed Test Cases and Test sets and executed them manually.

Environment: IBM Information Server 8.7/ 9.1, (Designer, Manager, Director), InfoSphere Information Governance Catalog/Assets/DashBorad, Information Analyzer, Microsoft Visio, Windows XP, Unix Shell scripting, Netezza 7.2, Aginity, Excel Files, XML files, ESP Scheduling.

Confidential

Sr. Data Integration Specialist

Responsibilities:

  • Interacted with End user community to understand the business requirements and in identifying data sources.
  • Analyzed the existing informational sources and methods to identify problem areas and make recommendations for improvement. This required a detailed understanding of the data sources and researching possible solutions.
  • Implemented dimensional model (logical and physical) in the existing architecture using Erwin.
  • Studied the PL/SQL code developed to relate the source and target mappings.
  • Basic UDW+ integration by bringing UDAR data into UDW+ in dimensionalized structures. Creation of basic dashboard to present giving and alumni data using mapping visualizations.
  • Capacity building within the UDARITS team to continue to refine and develop dashboard content upon project completion.
  • ETL development to bring existing UDAR data structures into UDW+ as basic data model with facts and dimensions, optimized to meet dashboard requirements.
  • Ability for UDARITS staff to refine/enhance dashboard content upon release.
  • Knowledge transfer to UDAR technical resources in order to maintain project deliverables and create additional dashboards.
  • Designed and developed ETL processes using DataStage designer to load data from Oracle, MS SQL, Flat Files (Fixed Width) and XML files to staging database and from staging to the target Data Warehouse database.
  • Used DataStage stages namely Hash file, Sequential file, Transformer, Aggregate, Sort, Datasets, Join, Lookup, Change Capture, Funnel, Peek, Row Generator stages in accomplishing the ETL Coding.
  • Developed job sequencer with proper job dependencies, job control stages, triggers.
  • Used QualityStage to ensure consistency, removing data anomalies and spelling errors of the source information before being delivered for further processing.
  • Involved in performance tuning and optimization of DataStage mappings using features like Pipeline and Partition Parallelism and data/index cache to manage very large volume of data.
  • Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
  • Verified the OBIEE Report by extracting data from the Staging Database using PL/SQL queries.

Environment: IBM Information Server 9.1, (Designer, Manager, Director), Microsoft Visio, Windows XP, Unix Shell scripting, TOAD 8.1, Oracle 10g, Excel Files, Autosys.

Confidential

Sr. ETL Datastage Developer

Responsibilities:

  • Identified business needs, evaluated business and technical alternatives, recommended solutions and participated in their implementation.
  • Requirement gathering and business analysis by attending requirement.
  • Used DataStage Designer to create the table definitions for the CSV and flat files, import the table definitions into the repository, import and export the projects, release and package the jobs.
  • Developed ETL processes to extract the source data and load it into the enterprise-wide data warehouse after cleansing, transforming and integrating.
  • Imported metadata from repository, created new job categories, routines and data elements.
  • Designed and developed jobs using DataStage Designer as per the mapping specifications using appropriate stages.
  • Used Perl for file parsing for loading into destination.
  • Created JIL files for Datastage jobs entry in Autosys.
  • Worked extensively With AutoSys for scheduling Jobs,Provided Production support for AutoSys.
  • Worked HP Quality Center to resolve Data related defects.
  • Used Unix Script to copy files from Development Server to Production Server for testing Datastage jobs.
  • Worked with Unix admin to resolved datastage bug related error.
  • Developed job sequences to execute a set of jobs with restart ability, check points and implemented proper failure actions
  • Wrote UNIX shell scripts to read parameters from files for invoking DataStage jobs.
  • Created source to target mapping and job design documents from staging area to Data Warehouse.
  • Used DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).

Environment: IBM Information Server 8.1, IBM Information Analyzer 8.1 IBM Data Stage 8.1 (Designer, Manager, Director), Erwin 4.1, Windows XP, Unix Shell scripting, TOAD 8.1, Oracle 10g, MS SQL server flat files, xml files,Mainframe files(QVSM, PVSM), Autosys.

Confidential, RI

Sr. ETL Datastage Developer/Admin/ETL Onshore Lead

Responsibilities:

  • Identified business needs, evaluated business and technical alternatives, recommended solutions and participated in their implementation.
  • Involved in end-to-end implementation and also involved in coding at the lowest level.
  • Imported data from source to different targets like Flat files, SQL Server 2005, XML, Queues etc.
  • Extensively used Autosys for automation of scheduling for UNIX shell script jobs on daily, weekly monthly basis with proper dependencies.
  • Written several documents like Technical Design Documents, Data Stage standards and best practices documents, Data Stage Naming Conventions document, ETL methodology, Deployment Guide, Post Implementation Operational Guides, etc.
  • Created environment to load data files, codes in testing environment to test with customers and also evaluated it.
  • Used UNIX scripts for archiving files, file watcher, purging, ftp etc
  • Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
  • Responsible for creating users and assigning roles to the created users.
  • Responsible for monitoring all the jobs that are running, scheduled, completed and failed and troubleshooting the failed jobs.
  • Responsible for unit, system and integration testing. Development test scripts, test plan and test data. Participated in UAT (User Acceptance Testing).
  • Migrated and tested jobs from Datastage 7.5 to 8.1.
  • Preparation of Technical specification, Detail Design Document (DDD) for the development of DataStage Extraction, Transformation and Loading (ETL) mappings to load data into various tables and defining ETL standards.
  • Involved in mapping team discussions to solve the issues in present version of mapping document.
  • Created DataStage Sequencers using Job Activity, User Variables Activity, ExecuteCommand Activity, Notification Activity, Sequencer activity and Nested Condition activity for DataStage jobs.

Environment: Ascential Datastage V7.5, IBM InfoSphere Information Server V8.1/8.5 Suite (DataStage, QualityStage, IS Manager), iWay Data Management, ERwin 4.0, Windows XP, Oracle 10g/9i, SQL Server 2005, PL/SQL, IBM DB2, UNIX AIX, CVS version control, Autosys, Mainframe JCL/Focus, CA-7 Scheduler, Clarify, MS Access.

Confidential

ETL Consultant

Responsibilities:

  • Participated in gathering the user requirements and involved in writing technical design documents.
  • Identifying source to target mapping and requirements defects, and documenting recommended solutions
  • Used Information Analyzer for Column Analysis, Primary Key Analysis and Foreign Key Analysis and Cross Domain Analysis.
  • Experience in Data Profiling for the process to examine the data available in the source system and collecting statistics and information about the data.
  • Hands on experience to evaluate the content and structure of the staged data for consistency and quality using Webshpere Information Analyzer.
  • Involved in understanding the actual quality and structure of the data to make the business decisions.
  • Involved in scheduling the analysis jobs and managing data analyses and logs.
  • Performed Data Analysisby taking the results of the Data Profiling and adds metadata definitions, annotations and data validations.
  • Experience inData cleansingwhich is loaded into the warehouse and also monitoring the quality of the data loaded in the warehouse and other operational databases.
  • Extensively worked on Job Sequences to Control the Execution of the job flow usingvarious Activities & Triggers (Conditional and Unconditional) like Job Activity, Wait forfile, Email Notification, Sequencer, Exception handler activity, routines (Threshold) and Execute Command.
  • Extensively used the Sequential File stage, Modify, DataSet, Filter, Funnel, Join, Lookup, Copy, and Aggregator during ETL development.
  • Implemented logic for Slowly Changing Dimensions Type II by using Date methodology.
  • Good practice in using oracle hints, for optimize a query execution plan in different categories like parallel, index and joins etc.
  • Reconciled discrepancies in current state logical and physical data models, and collaborated with Data Architects to model additional entities and relationships.
  • Involved in solving Production support issues.
  • Used Autosys for job scheduling.

Environment: Ascential Datastage 7.5, IBM Information Server V8.1 (DataStage, QualityStage, Information Analyzer), Microsoft Visio, UNIX, Oracle, TOAD, Shell scripting, MS Access, MS Office, MS Visio, Autosys, HP Quality Centre.

Confidential, WI

Etl Developer

Responsibilities:

  • Worked with the Business analysts and Subject Matter Experts to thoroughly understand the different business processes and data at various sources.
  • Involved in creating functional and scope documentation for data cleansing, conversion, and integration processes.
  • Performed through data profiling by using the Investigate stage of Quality Stage and also by writing PL/SQL queries to identify and analyze data anomalies, patterns, inconsistencies etc.
  • Developed a detailed data profiling report.
  • Performed Data Analysis using Information Analyzer for Column, Table, and foreign key and Cross Table analysis.
  • Involved in understanding the actual quality and structure of the data to make the business decisions.
  • Used IBM Information Analyzer, for Data Profiling and Data analysis.
  • Data assessment process is done for the Master Data Management where key data is needed or Data Governance for improving data quality.
  • Experience in defining basic types of DATA rules like transformation and quality rules.
  • Performed through data profiling by using the Investigate stage of QualityStage and also by writing PL/SQL queries to identify and analyze data anomalies, patterns, inconsistencies etc
  • Data profiling is used to ensure file integrity and affirm that the information displayed in a file is correct.
  • Used DataStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data using various stages like Aggregator, Funnel, Change Capture, Change Apply and copy.
  • Performed Unit and Integration testing and validated the test cases by comparing the actual results with expected results.

Environment: IBM InfoSphere Information Server 8.1(QualityStage/Datastage), IBM Information Analyzer 8.0, Erwin, Control M, Microsoft Visio, Windows XP, Unix Shell scripting, Oracle 10g, SQL Server 7.0/2000/2005 , MS Access, MS Office, MS Visio, PL/SQL.

Confidential, NY

SQL Developer/ETL Developer

Responsibilities:

  • Responsible for the Business requirements analysis gathering and identifying different source systems.
  • Prepared SFTP scripts and logs to transfer the files from to different regions in business.
  • Extensively worked with DataStage - Manager, Designer, Director and Administrator to load data from flat files to target Oracle database.
  • Designed and developed complex transformations in DataStage to do multiple look-ups when loading the incoming source data.
  • Used FTP stage to load data from the Mainframe server into staging and then into Oracle Database.
  • Scheduled and ran multiple jobs using DataStage Job Sequencer and received the output log via email system.
  • Created, optimized, reviewed, and executed SQL test queries to validate transformation rules used in source to target mappings/source views, and to verify data in target tables.
  • Primarily worked on Unit testing, developing Test Cases as per the requirement
  • Designed SFTP setup for different cycles in which each cycle having 140 interfaces.
  • Designed DataStage jobs to load data into Oracle IDM and staging tables.
  • Used CA7scheduler for automation of jobs.

Environment: IBM Infosphere Information server 7.5/8.1, Multi client manager, Datastage Version Control, Oracle 10g, PL/SQL, UNIX Shell Scripts, Mainframe, WinSCP, SFTP, Tumbleweed, Toad, Teradata V2R5 SQL Assistant.

We'd love your feedback!