Etl Lead Resume
CA
SUMMARY
- Over 8+ years of experience in all the phases of Data Warehouse Life Cycle involving design, development and analysis and testing in various areas of Data Warehousing.
- Experience in Development and Design of ETL methodologies using Informatica Power Center 9.x/8.x/7.x/6.x with real time exposure to business.
- Strong experience in designing and developing Business Intelligence solutions in Data Warehousing/Decision Support Systems using Informatica Power Center.
- Experience working on various Relational Database systems (Oracle, Sql Server, DB2) and Flatfiles.
- Experience using Data Warehouse Appliances such as Netezza for data warehousing,business intelligence and Error free Data integration.
- Well acquainted using Teradata utilities BTEQ, Fast Load, Multi Load, Fast Export, Tpump, SQL Assistant and SQL Administrator.
- Extensively worked on Informatica IDE/IDQ.
- Involved in massive data profiling using IDQ (Analyst tool) prior to data staging.
- Responsible for the Data Cleansing of Source Data using LTRIM and RTRIM operations of the Expression Transformation.
- Expertise in RDBMS concepts, with hands on exposure in the development of relational database environment using SQL, PL/SQL, Cursors, Stored Procedures, Functions and Triggers.
- Experience in working with Perl Scripts for handling data coming in Flat files.
- Experience working with UNIX Shell Scripts for automatically running sessions, aborting sessions and creating parameter files.
- Hands - on experience with Informatica Power Center - Designer, Repository Manager, Workflow Manager, and Workflow Monitor.
- Extensively worked on Informatica Designer components - Source Analyzer, Warehouse Designer, Transformation Developer, Mapping Designer and Mapplet Designer.
- Extensively worked on Informatica Power Center Transformations such as Source Qualifier, Lookup, Filter, Expression, Router, Normalizer, Joiner, Update Strategy, Rank, Aggregator, Stored Procedure, Sorter, and Sequence Generator
- Good experience with Informatica Performance Tuning.
- Good knowledge of Data modeling techniques like Dimensional/ Star Schema, Snowflake modeling, slowly changing Dimensions using Erwin.
- Good understanding of Business Intelligence tools like Business Objects, Cognos, MicroStrategy
- Good knowledge on DB2, MS SQL Server, T-SQL.
- Worked on Scheduling ETL jobs using $U, Tidal, Autosys tools.
- Experience working with offshore and onsite co-ordination.
- Flexible, enthusiastic and project oriented team player with solid communication and leadership skills to develop creative solution for challenging client needs.
- Able to work independently and collaborate proactively & cross functionally within a team.
TECHNICAL SKILLS
Data Warehousing tools (ETL): Informatica Power Center 9.5.1/9.1.0/ 8.6.1/8.1.1 / 7.1/ 6.1 , Informatica Data Quality 9.5.1(Developer, Analyst), Power Exchange, Power Connect.
Dimensional Data Modeling Tools: Erwin 7.x/4.5/4.1
RDBMS: Oracle 11g/10g/9i, MS SQL Server 2008/2005/2000 , Teradata v12, DB2, Netezza, MS Access
Languages: SQL, PL/SQL, T-SQL, UNIX Shell Scripting, Perl
Operating Systems: UNIX (IBM AIX/HP-UX/Sun Solaris), Win XP/ NT/ Vista/7
DB Utilities: TOAD, SQL* Loader
PROFESSIONAL EXPERIENCE
Confidential, CA
ETL Lead
Responsibilities:
- Involved in gathering Business Requirements and writing Technical specifications.
- Extensively worked on Informatica Data Quality 9.5.1(Analyst tool) for profiling data for various subject areas such as Provider, Confidential t, Payor, Claims prior to staging area.
- Worked on extracting data from the heterogeneous source systems like MS SQL Server, Oracle, HL7 Files, flat files, XML files and loading into Acquisition Layer (Staging) and then to Enterprise Data Vault
- Worked on all components of Informatica Powercenter including Source and Target Analyzer, Transformation developer, mapping and mapplet designer, worklow manager and monitor and also repository manager.
- Worked with various active transformations in Informatica Power Center like Normalizer Transformation, Aggregator Transformation, Lookup Transformation, Joiner Transformation, Rank Transformation, Router Transformation, Sorter Transformation, Source Qualifier, and Update Strategy Transformation
- Extensively worked with various Passive transformations in Informatica Power Center like Expression Transformation, Sequence Generator and Sorter Transformation
- Extensively worked with Slowly Changing Dimensions Type1 and Type2 for Data Loads
- Responsible for Performance Tuning at the Mapping Level, Session Level, Source Level, and the Target Level by determining bottlenecks.
- Used debugger to test the mapping and fixed the bugs.
- Responsible for migrating the workflows across different environment (Dev, Test, QA, PROD)
- Extensively worked with Incremental Loading using Parameter Files, Mapping Variables, and Mapping Parameters
- Created Pre/Post Session/SQL commands in sessions and mappings on the target instance.
- Used Workflow manager to create, schedule and control workflows, tasks and sessions.
- Implemented various loads like Daily Loads, Weekly Loads, and Quarterly Loads using Incremental Loading Strategy.
- Provided detailed technical, process and support documentation like daily process rollback and detailed specifications and very detailed document of all the projects with the workflows and their dependencies.
- Involved in writing batch scripts for file transfers, file renaming and several other database scripts to be executed from UNIX.
- Created documents for data flow and ETL process using Informatica mappings to support the project once it implemented in production.
- Created and Documented ETL Test Plans, Test Cases, Test Scripts, Expected Results, Assumptions and Validations.
- Worked in highly structured division across Infra developers/Data Architects (data modeling team)/DBAs/ Change Management etc.
- Conformed to project standards for Unit test/UAT testing. Carried out end - to end testing and supported UAT effort with immediate requirement document change/fixes/resolution for all changes/defects.
Environment: Informatica Power Center 9.5.1, IDQ 9.5.1, SQL SERVER 2008, XML, TOAD T-SQL, Batch Scripts, Rational Suite, Embarcadero E/R Studio, Business Objects XI R2
Confidential, Greenwood Village, CO
Sr. ETL Informatica Developer
Responsibilities:
- Worked heavily withBusiness Analyststo understand the business and gather requirements.
- Involved in changing functional requirements to Technical Specifications.
- Experience in profiling data using Informatica Data Quality 9.5.1(Analyst tool) and data transformation using Informatica Data Quality 9.5.1 (Developer tool).
- Designed the ETL processes using Informatica to load data from various heterogeneous sources to target Teradata Warehouse database.
- Maintained warehouse metadata, naming standards and warehouse standards for future application development.
- Extensively worked Teradata utilities BTEQ, Fast Load, Multi Load, Fast Export, Tpump, SQL Assistant and SQL Administrator.
- Implemented change data capture (CDC) using Informatica power exchange to load data from clarity DB to Teradata warehouse.
- Created mappings using informatica as per 3rd normal form design model.
- Extracted the data from Oracle, MS SQL Server, Flat Files and XML to Stage using Informatica and loaded the stage data using BTEQ scripts to EDW.
- Worked onPower Exchangeto create data maps, pull the data fromsource systems, and transfer intoStaging area.
- Developed and tested Stored Procedures,FunctionsandPackagesin PL/SQL
- Worked on Perl for writing scripts handling flat files such as validating file formats, encryption/decryption, SFTP/FTP etc.
- Extensively involved in implementing NormalLoads, BulkLoads, InitialLoads, IncrementalLoads, Dailyloads and Monthlyloads.
- Created and ExecutedWorkflowsandWorkletsusing Workflow Manager to load the data into the Oracle Database.
- Responsible forMonitoring Scheduling, running completed and failed sessions. Involved indebuggingthe failed mappings and developing error-handling methods.
- Worked closely withSystemsAdministratorto setup project folders in development, test and production environments.
- WroteUNIX Shell ScriptsforInformaticaPre-Session, Post-Session and Autosys scripts for scheduling the jobs (work flows)
- Worked with theQuality Assurance teamto build the test cases to perform unit, Integration, functional and performance Testing.
- Performed migration of mappings and workflowsfrom Development to Test and to Production Servers.
- Involved in creating reports using business objects
- UsedInformaticaVersion Controlfor checking in all versions of the objects used in creating the mappings, workflows to keep track of the changes in the development, test and production environment.
Environment: Informatica Power Center 9.5.1/9.1.1 , IDQ 9.1, Power Exchange 9.1, MDM, Embarcadero, Teradata v12, Oracle 11g, SQL SERVER 2008, XML, T-SQL, Rational Suite, Business Objects XI R2
Confidential, Jersey City, NJ
Sr. ETL Informatica Developer
Responsibilities:
- Coordinated with Business Users to understand business needs and implement the same into a functional Data warehouse design.
- Worked on requirement gathering for B2B XML's feed (Customer and Product).
- Developed XML's using XML parser Transformation for large scale data transmission.
- Converted functional specifications into technical specifications.
- Developed complex mappings to load data from multiple source systems like Oracle 10g, Essbase, COBOL files, flat files, XML files to data mart in Oracle database.
- Worked on exported Data Services results to Microsoft Excel for quick analysis to business users.
- Worked extensively in tuning the current ETL processes for better performance by implement database partitioning and increasing block size, data cache size, sequence buffer length and target based commit interval and SQL overrides.
- Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Informatica power center 8.6.1/7.1.4 and Power Connect for ESSBASE.
- Extensively working on developingContinuous Change Data (CDC).
- Debugging invalid mappings using break points, testing of stored procedures and functions, testing of Informatica sessions, batches and the target Data.
- Used Tidal Batch scheduler for automation of ETL process.
- Creating Informatica Development Standards. This document describes the general guidelines for Informatica developers, the naming conventions to be used in the Transformations and also development and production environment structures.
- Participated in weekly end user meetings to discuss data quality, performance issues. Ways to improve data accuracy and new requirements, etc.
- Involved in migrating objects from DEV to QA and testing them and then promoting to Production.
- Developed mappings using the parser techniques to transform multiple source documents into XML by using B2B Data transformation.
- Extensively worked on PDF and HTML Documents to load the data into stage tables using B2B Data Transformation.
- Creating Type 1 and Type 2 Source definitions from reading the data from ESSBASE cubes.
- Worked extensively in loading data into pre stage and stage tables from ESSBASE cubes.
Environment: Informatica PowerCenter 8.6.1, IDQ 8.6.1, Power Exchange 8.6.1, Power Exchange for Essbase Component 8.6.1.0.1, B2B, Oracle 10g, PL/SQL, TOAD, Flat Files, Windows XP, Unix, TIDAL
Confidential, Richmond, VA
ETL Informatica Developer
Responsibilities:
- Analyze the system, meeting with end users and business units to define the requirements.
- Involved in design phase of logical and physical data model using ERwin 4.0.
- Involved in designing STAR Schema for the business processes.
- Extracted the data from Oracle, Flat files and loaded them into Data Warehouse.
- Wrote SQL Queries, Stored Procedures, Functions and Shell Scripts to apply and maintain the Business Rules.
- Translated business requirements into Informatica mappings/workflows.
- Used Source Analyzer and Warehouse designer to import the source and target database schemas, the Mapping Designer to map the sources to the target.
- Used Informatica Designer to create complex mappings using different transformations like Filter, Router, Lookups, Stored Procedure, Joiner, Update Strategy, Expressions and Aggregator transformations to pipeline data to Data Warehouse/Data Marts.
- Developed Mappings that extract data form ODS (Operaional Data Store) to Data mart and monitored the Daily and Weekly Loads.
- Created and monitored Sessions/Batches using Informatica Server Manager/Workflow Monitor to load data into target Oracle, MS SQL Server databases.
- Extensive work on Performance Tuning, determining bottlenecks from session, target, source, mapping and transformations.
- Migrated existing mappings to production environment from testing phase.
Environment: Informatica PowerCenter 8.6.1/8.1.1 , Oracle 10g/9i, PL/SQL, MS SQL Server 2005, PL/SQL, ERwin 4.0,Windows NT, UNIX Shell Scripts (AWK)
Confidential, Emeryville, CA
ETL Informatica Developer
Responsibilities:
- Analyzed the requirements to identify the necessary tables that need to be populated into the staging database.
- Prepared the DDL’s for the staging/work tables and coordinated with DBA for creating the development environment and data models.
- Involved in analyzing the source data coming from different Data sources such as XML DB2, flat files etc.
- Worked on Informatica Power Center tools - Source Analyzer, Warehouse Designer, Mapping & Mapplet Designer, and Transformation Developer.
- Created mappings using transformations like Source Qualifier, Aggregator, Expression, lookup, Router, Filter, Update Strategy, Joiner, Normalizer, Union, Stored procedure, and XML transformations.
- Converted existing PL/SQL Packages to ETL Mappings using Informatica Power Center.
- Used Error handling strategy for trapping errors in a mapping and sending errors to an error table.
- Used IDQ for understanding data analysis.
- Wrote UNIX Shell scripts to automate and schedule workflows.
- Worked on Erwin to create tables.
- Developed stored procedures using T-SQL and optimized queries for report generation and data modifications activities.
- Worked with the oracle forms, which generate the screen that presents the data.
- Schedule and run Extraction and Load process, monitor task and workflow using the Workflow Manager and Workflow monitor.
- Used Workflow Manager for creating workflows, work lets, email and command tasks.
- Used Informatica features to implement Type II changes in slowly changing dimension (SCD) tables.
- Involved in Performance Tuning at various levels including Target, Source, Mapping, and Session for large data files.
- Supported the Quality Assurance team in testing and validating the Informatica workflows.
Environment: Informatica Power Center 8.1/7.1, Oracle 10g/9i, PL/SQL, Oracle Forms, SQL*Plus, Erwin 4.0/3.5.2, DB2, MS SQL Server 2005, MS-Excel, MS - Access, XML, Flat files, Windows NT, ControlM
Confidential, Chicago, IL
ETL Informatica Developer
Responsibilities:
- Imported various Sources, Targets, and Transformations using Informatica Power Center Server Manager, Repository Manager and Designer.
- Responsibilities included source system analysis, data transformation, loading, validation for data marts, operational data store and data warehouse.
- Used heterogeneous files from Oracle, Flat Files as source and imported stored procedures from oracle for transformations.
- Implemented change data capture (CDC) logic to check for changes in data.
- Used Dimensional Modeling Techniques to create Dimensions and Fact tables.
- Written PL/SQL procedures for processing business logic in the database. Tuned SQL queries for better performance.
- Extensively worked on performance tuning of the created mappings, to identify bottlenecks at Target, Source, Mapping, Session and System levels and its Optimization.
- Developed Informatica ETL; Informatica mappings, mapplets, sessions, batches. Designed and developed the sessions for the relevant mapping(s) or Informatica jobs and organized as sequential / concurrent batches.
- Scheduled Sessions and Batch Process based on demand, run on time, run only once using Informatica Server Manager.
Environment: Informatica PowerCenter 6.1, Oracle 8i, SQL, PL/SQL, SQL*Loader, UNIX Shell Script, Autosys, CDC, Win 2000/NT
Confidential
ETL Informatica Developer
Responsibilities:
- Involved in the Analysis of Physical Data Model for ETL mapping and the process flow diagrams.
- Created and maintained metadata and ETL documentation that supported business rules and detailed source to target data mappings.
- Designed and wrote data extraction, transformation, clean and load and Informatica mappings for the enterprise Data Warehouse environment
- Used Informatica transformations such as the Source Qualifier, Aggregators, and Connected & Unconnected lookups, Filters, Sequence Generator and Stored Proc. etc.
- Created and maintained metadata and ETL documentation that supported business rules and detailed source to target data mappings.
- Wrote PL/SQL procedures, SQL Scripts, and SQL*Loader control files for creating a development database.
- Created and maintained data governance strategies that reduced data redundancy wherever possible.
- Developed and executed test plans and played an active role in project rollouts.
- Investigated and assisted users in the resolution of any day-to-day data warehouse issues.
Environment: Informatica PowerCenter/PowerMart 6.1 (Repository Manager, Designer, Server Manager), Oracle 9i, Windows 2000, SQL, PL/SQL