Etl Consultant/technical Team Lead Resume
Charlotte, NC
SUMMARY:
- 12 years of experience in IT industry especially in building data warehouses and Decision support Systems (DSS) analysis, design, development, Testing and implementation.
- Over 9+ years of experience in loading and maintaining Data Warehouses and Data Marts using DataStage ETL processes.
- Extensive exposure to Star, Snowflake Schema and Multidimensional Data Models.
- Extensive experience working wif various source files like Flat Files, Fixed Width Files, Complex Flat Files, Datasets, and XML files etc.
- Designed and developed complex jobs, from varied transformation logic using different stages like Transformer, Lookup, CDC,Filter, Aggregator, Join, Merge, Funnel, Sort, Change Capture and many more..
- Strong noledge of Extraction Transformation and Loading (ETL) processes using Ascential DataStage, UNIX shell scripting and SQL Loader.
- Proficient in interaction wif teh business users. Pioneered load strategies of loading staging area and data marts. Dealt wif SCD Type1/Type2 loads.
- To Standardize and cleansing teh data using QualityStage.
- Experience in Extraction, cleansing, integration, loading of data from/to disparate data sources.
- ETL Performance Monitoring and Tuning to enhance teh Analyze ETL workflows to identify performance bottlenecksby appropriately using teh Datastage job stages and Partition methods.
- Extensive experience in creating Stored Procedures, Functions, Packages and Triggers, Teradata SQL, BTEQ, Multiload and Fast load scripts.
- Expertise in working wif various operational sources like DB2, DB2UDB, SQLServer, Oracle 11g/10g/ 9i, Flat Files into a staging area.
- Experience in Evolving Strategies and developing Architecture for building a Data warehouse Hands on experience in writing, testing and implementation of teh triggers, Procedures, functions at Database level using PL/SQL.
- Extensive experience in loading high volume data, and performance tuning.
- Played significant role in various phases of project life cycle, such as requirements definition, functional & technical design, testing, Production Support and implementation.
TECHNICAL SKILLS:
ETL Tools: Data Stage 11.3/8.x /7.x Quality Stage
Informatica PowerCenter 7.1.4.
OLAP/DSS Tools: Business Objects6.5, XIR2
Databases: Oracle 11g/10g/9.me/8i/7.x, SQL Server 6.5/7.0, DB2 UDB
8. x/7.x, Teradata V2R5/V2R4, Teradata Utilities T - Pump, Fast load, Multi Load, BTEQ, DB2, MYSQL
Database Modeling: Erwin 3.5.2/4.0, Microsoft VISIO
Software Tools: MDM 10, SQL Developer, TOAD, QUEST, Autosys 4.5/11, MQ, MQFTEBorland Star Team, XML, Big Data, Hadoop
Languages: SQL/PL-SQL, Java, C, Shell Scripting
Control Center, Dream Weaver
Operating System: Windows 7/XP/NT/2000, DOS, UNIX, Linux, Z/OS
PROFESSIONAL EXPERIENCE:
Confidential, Charlotte, NC
ETL Consultant/Technical Team Lead
Responsibilities:
- Participated in business requirements and architectural meetings to understand, analyze, design and build teh necessary code base.
- Designed, developed and tested teh standard data feeds process.
- Currently working MDM Project includes Development, Unit testing, Code Migrations, issue fixes & Support.
- Co-ordinate wif teh Data modelers on necessary basis
- Participated in business requirements and architectural meetings to understand, analyze, design and build teh necessary code base.
- Involving and providing superior ideas to teh team in performance issue across DataStage level, DB level issues.
- Interacted and helped teh release management team, DBA and Admin to migrate Datastage components from DEV to QA to Production environments.
- Developed jobs in Parallel Extender using different stages like Transformer, Join, Aggregator, Lookup, Source dataset, External Filter, Row Generator, FTP, Funnel, Column Generator, Remove Duplicates, and Merge.
- Involved in Unit testing, System Testing, and Stress testing and documented teh results.
- Analyze ETL workflows to identify performance bottlenecks and rectifying them by running them in optimized manner.
- Involved in Unit testing, System Testing, and Stress testing and documented teh results.
Environment: Datastage11.3/8.x, Oracle 11g/10g, Delphix, DB2, Autosys 11, UNIX Shell Scripting, MDM CDI Servers, XML, MQFTE agents, Windows 7/XP.
Confidential
Sr. Datastage Developer/Technical Team Lead
Responsibilities:
- Analyze ETL workflows to identify performance bottlenecks and rectifying them by running them in optimized manner.
- Worked closely wif project & Development managers to ensure overall project timelines are met. Providing production support for daily and monthly production issues.
- Co-ordinate wif teh Data modelers on necessary basis
- Participated in business requirements and architectural meetings to understand, analyze, design and build teh necessary code base.
- Interacted and helped teh release management team, DBA and Admin to migrate Datastage components from DEV to QA to Production environments.
- Developed Job templates, Shared components, DS functions and DS routines in order to reduce teh level of effort for future development and ongoing support.
- Used Advance Plug-in like FTP, BAPI, ABAP Extract, Web Services, XML Reader and XML Writer.
- Using datastage director to schedule and run jobs on daily, weekly, monthly.
- Designed and developed User Interfaces using Datastage jobs, XML, JSP and Unix Shell scripts.
- Developed jobs in Parallel Extender using different stages like Transformer, Join, Aggregator, Lookup, Source dataset, External Filter, Row Generator, FTP, Funnel, Column Generator, Remove Duplicates, and Merge.
- Developed SQL Queries for implementing Complex business rules and transformations.
- Involved in Unit testing, System Testing, and Stress testing and documented teh results.
- Analyze ETL workflows to identify performance bottlenecks and rectifying them by running them in optimized manner.
- Involved in Unit testing, System Testing, and Stress testing and documented teh results.
Environment: Datastage EE 8.1, DB2, Oracle 9i, COBOL, JCL, ENDEVOR, UNIX, XML, Websphere MQ Windows XP.
Confidential
ETL Consultant/Technical Team Lead
Responsibilities:
- Designed, developed and tested teh standard data feeds process from teh Enterprise Data Warehouse (EDW).
- Designed, developed and tested teh Pharmacy Carve out process to load external pharmacy data into EDW.
- Co-ordinate wif teh Data modelers on necessary basis
- Participated in business requirements and architectural meetings to understand, analyze, design and build teh necessary code base.
- Interacted and helped teh release management team, DBA and Admin to migrate Datastage components from DEV to QA to Production environments.
- Load teh Mainframe data (DB2 & files) into EDW.
- Used IDQ for Data Analysis and Standardization.
- Created high level design documents and participated in design review meetings.
- Analyze teh source systems data and teh current reports at teh client side (Division level) to gather teh requirements for teh Data Warehouse Data Model
- Written complex SQL’s to verify and validate EDW data wif source systems.
- Studied teh relationship of data from business perspective in teh source systems
- Developed Job templates, Shared components, DS functions and DS routines in order to reduce teh level of effort for future development and ongoing support.
- Used Advance Plug-in like FTP, BAPI, ABAP Extract, Web Services, XML Reader and XML Writer.
- Involved in testing teh configuration and connection between infoserver and SAP R/3 using IDOC stage, ABAP, BAPI stages.
- Designed and developed User Interfaces using Datastage jobs, XML, JSP and Unix Shell scripts.
- Developed jobs in Parallel Extender using different stages like Transformer, Join, Aggregator, Lookup, Source dataset, External Filter, Row Generator, FTP, Funnel, Column Generator, Remove Duplicates, and Merge.
- Multi-instance sequencers running many parallel jobs which maximize resource utilization.
- Expertise on building Datastage process for Real Time Integration (RTI) wif web services.
- Implemented SCD Type 2 updating strategy wif a record change type field in some of teh jobs to retain teh history of teh data which is different from conventional method.
- Performed through data profiling by using teh Investigate stage of QualityStage and also by writing PL/SQL queries to identify and analyze data anomalies, patterns, inconsistencies etc
- Involved in creating High Level Design Docs to capture teh strategy implemented to develop RSH and Custom Feed jobs.
- Developed SQL Queries for implementing Complex business rules and transformations.
- Involved in Unit testing, System Testing, and Stress testing and documented teh results.
- Analyze ETL workflows to identify performance bottlenecks and rectifying them by running them in optimized manner.
- Interacting wif Report Users and Business Analysts to understand and document teh Requirements and translate these to Technical Specifications
- Worked closely wif Project & Development Managers to ensure overall project timelines are met and finally had noledge transfer meetings to make DBA's familiar wif teh project for future production support.
Environment: Datastage EE 8.1, DB2, Oracle 10g, COBOL, JCL, DB2, SAS9.1, ENDEVOR, Redbrick, UNIX, SAP R/3, XML, Websphere MQ Windows XP.
Confidential
Sr. DataStage Developer
Responsibilities:
- Analyzed Business Requirements by working closely wif Business Area.
- me was part of teh middleware ETL team responsible for developing interfaces, conversions, reports for teh SAP implementation.
- Involved in creation of parallel jobs using parallel extender to improve teh performance of jobs.
- Extensively used IBM infoserver (8.0) designer for developing teh code.
- me was actively involved in Interfacing wif teh legacy teams as well as SAP business process teams for gathering teh requirements for teh work assign to me.
- Involved in testing teh configuration and connection between infoserver and SAP R/3 using IDOC stage, ABAP, BAPI stages.
- me developed shared containers which by used among teh team for code reused.
- me worked extensively wif cross table look up for moving and validating data between different data systems.
- Used teh FTP Enterprise stage to send teh data to teh legacy systems.
- Used Complex Flat File (CFF) to create packed fields.
- Designed and developed various jobs for scheduling and running jobs using TIDAL.
Environment: Ascential DataStage 7.5.1, DB2, Oracle10g, MS SQL Server, Sun Solaris, Autosys, Erwin. DB2 UDB 8.1.6, COBOL, DB2,JCL, SAP R/3, SAP BW, Tidal Scheduler, SQL, PL/SQL, Shell Scripts.
Confidential
ETL Developer Adv
Responsibilities:
- Designed parallel jobs to handle source data acquisition and transform it for development applications during teh software development life cycle as well as testing stages.
- Provide staging solutions for Data Validation techniques and Cleansing applications for different source systems.
- Involved in meeting wif Business people to handle technical requirements.
- Involved in mapping team discussions to solve teh issues in present version of mapping document.
- Used Shared Containers to handle Surrogate Keys and Classification IDs dat are a major identification component through out teh design.
- Created complex Ascential DataStage jobs to handle up to 25 million records for daily files as well as monthly files.
- Used various stages like Sequential file, Transformer, Lookup, Join, Merge, ODBC, Aggregator, change capture and remove duplicates.
- Involved in low-level design and developed various jobs and performed data loads and transformations using different stages of DataStage and pre-built routines, functions and macros.
- Created and tested ETL processes composed of multiple DataStage jobs using DataStage Job Sequencer and developed shell scripts to automate teh processes.
- Worked on testing of developed jobs and documented different test cases for different source systems
Environment: Ascential DataStage 7.5.1, DB2, Oracle, JCL, CICS, CRYSTSL REPORTS, BO XI, MS SQL Server, Sun Solaris, Autosys, Erwin.
Confidential, San Antonio, TX
ETL Developer
Responsibilities:
- Worked wif users & analysts to understand requirements.
- Participated in client meetings to review Integrated Data approaches and to interpret results.
- Created DataStage jobs to extract data from various sources, transformed data according to teh requirement and load into data warehouse.
- Involved in implementing star schema for teh data warehouse using Erwin for Logical/Physical data modeling and Dimensional Data Modeling.
- Extensively used Ascential DataStage Manager, Designer, and Director for creating and implementing jobs.
- Used parallel extender for splitting teh data into subsets and to load data, utilizing all available processors to achieve job performance.
- Using data stage to maintain consistent data and values by shielding teh legacy structures.
- Using data stage to maintain consistent data and values by shielding teh legacy structures.
- Involved in creation of parallel jobs using parallel extender to improve teh performance of jobs.
- Used Hashed files for lookups and complex logic.
- Used hashed files for conditional lookups and to handle multivalues.
- Using datastage director to schedule and run jobs on daily, weekly, monthly.
- Created local and shared containers to use in multiple jobs.
- Developed UNIX shell scripts to automate teh Data Load processes to teh target Data warehouse.
- Wrote custom routines for cleaning data before loading data into target database.
- Wrote technical documentation and data processing documentation for backend systems.
Environment: Ascential DataStage 7.5.1, DB2, COBOL, JCL, SAS, CRYSTAL REPORTS, BO XI, Oracle, MS SQL Server, Sun Solaris, Autosys, Erwin.
Confidential, Rochester, NY
Developer
Responsibilities:
- Developed ORACLE database for storing inventory and payroll details. me had various responsibilities from requirement analysis to software installation.
- Designed front end using ORACLE FORMS and reports using ORACLE REPORTS.
- Enabled employees to access teh inventory and payroll data by developing Web interface for teh database. HTML, ASP and DHTML were used for web design.
Environment: Oracle 8, Java Script, VB Script, HTML, Toad