Sr. Etl Lead/ Developer Resume
Peapack, NJ
SUMMARY
- Over 10 years of IT experience as an ETL Developer/Program analyst, which includes Data Warehouse/Database Developer experience using Informatica Power Center 10.x/9.x/8.x/7.x.
- 2+ years of experience in Informatica Power Exchange CDC.
- Hands on experience in the Application Design, Business Requirements Analysis, Data Modeling, Development, Implementations and Testing of Database Business Systems and Data Warehousing using Dimensional modeling of STAR, SNOWFLAKE schema, OLAP, Fact and Dimension tables.
- Good understanding of all phases of Software Development Life Cycle (SDLC) including Business Requirement Analysis, Application designing, Development, Implementations and Testing of Data warehousing and Database business systems.
- Proven experience in writing and modifying ETL design documentation, technical requirements analysis, test results documentation and standard operating procedures (SOP) documentation.
- Expertise in ETL designs, including process flow, data flow, source - to-target mappings, physical database designs and data models.
- Worked on Teradata loading utilities like Multi Load, Fast Load, TPump and BTEQ.
- Experience in developing Shell scripts on UNIX and experience wif UNIX command line.
- Knowledge of Software Testing and Quality Assurance.
- Excellent communication and writing skills and capable of working successfully both in teams and independently.
- Ability to self-manage time and task priorities to meet project timelines, and identify potential project risks.
- Excellent interpersonal and communication skills, technically competent and result-oriented wif problem solving skills and ability to work TEMPeffectively as a team member as well as independently.
- Developed TEMPeffective working relationships wif client team to understand support requirements, develop tactical and strategic plans to implement technology solutions and TEMPeffectively manage client expectations.
TECHNICAL SKILLS:
ETL: InformaticaPowerCenter 9.6.1/9.1/8.6.1/8.5.1/7.1.4, Informatica Power Exchange 9.1/8.6
DATA MODELLING: Dimensional Data Modeling, Star Schema, Snow-Flake Modeling, FACT and Dimensions Tables, Physical and Logical Data Modeling, Erwin 7.1/4.x
DATABASES: Oracle 11g/10g/9i, MS SQL Server7.0/2000, MS Access, Sybase, DB2,MySQL,Teradata V2R6/13.1
PROGRAMMING: C, C++, SQL, PL/SQL, HTML,UNIX Scripting, Java
REPORTING TOOLS: Business Objects XIR2,Crystal Report,MicroStrategy
OPERATING SYSTEMS: Windows 98/NT/2000/XP/7,MAC, Sun Solaris, UNIX, MS-DOS
APPLICATIONS: MS Office, MS Project, FrontPage, Toad 9.2/8.6,Oracle SQL Developer, FileZilla,Teradata SQL Assistant
MANAGEMENT TOOLS: MS-Office 2007, MS Project
TESTING TOOLS: HP ALM,HP Quality Center 9.2
SCHEDULING TOOLS: Autosys, ESP,Tivoli Maestro,Control-M
PROFESSIONAL EXPERIENCE:
Confidential, Peapack, NJ
Sr. ETL Lead/ Developer
Responsibilities:
- As an ETL Tech Lead, Lead the ETL Development for Enhancements in the PGS Data warehouse.
- Managed Team of 4 members and coordinated between the Business users and the team to Develop the ETL Process.
- Worked on ETL coding, testing, implementing, debugging and documenting the complex programs.
- Developed complex pivot logic process mappings to the incremental process in order to improve the performance.
- Tuned the performance by implementing MD5 logic in the mappings.
- Extensively used Reusable transformations and Mapplets are built wherever redundancy is needed.
- Performed the performance tuning at source, Target levels by creating Indexes, Hints and Partitioning in ORACLE and Informatica.
- Assisting the project manager by compiling information from the current systems, analyzing the program requirements and ensuring that it meets the specified time requirements.
- Experience usingTeradata utilities ( B-TEQ, Fast Load, MultiLoad, FastExport, Tpump)Teradata parallel support and Unix Shell scripting.
- Created the BTEQ scripts for loading the data into the Dimensions and Fact tables which are in Teradata DB.
- Involved in creation of BTEQ Script for validating the data quality like referential integrity, not null check.
- Created batch jobs to schedule the workflows using Informatica Scheduler.
- Written shell scripts for file transfer/archiving./Email notifications.
- Created the Materialized Views and grant the access to the Roles.
- Worked wif peers to perform the Code review as per the Informatica standards and Best Practices.
- Created Test plans in HP ALM.
- Manually Executed the use cases in the Test lab using ALM & routed Test Runs for the approval.
- Documented all Technical specifications, Installation Instructions, Verification protocol & Source code review Documents.
- Upload the documents into the PDOCS & route for the approvals.
- Expertise in RDBMS, database Normalization and Denormalization concepts and principles.
- Giving estimates for the efforts in developing application.
- Analyzing and doing Impact analysis on the issues and resolving and providing solution for the issues.
- Giving Clear Instructions to the offshore team to deploy the code in the Higher environments.
Environment: Informatica PowerCenter10.1/9.6.1, Oracle 11g, Toad 11.5,HP ALM, PDOCS, Business Objects 4.2,RHEL 6.8, Teradata 15.1
Confidential, Peapack, NJ
Sr. ETL Developer
Responsibilities:
- Involved in gathering and analyzing requirements.
- Developed several complex mappings using transformations, Mapping Parameters, Mapping Variables, Mapplets & Parameter files using Power center Designer.
- Understand the Source systems, IGATE,Manugistics, SAP Source systems requirements and Data format.
- Extensively worked on reusable transformations, Sessions, Mapplets and Worklets
- Responsible for creating Business requirement doc, ETL Design doc, Change impact analysis doc, Unit testing doc and Migration checklist doc.
- Worked wif the Production support team and assisted the Support Team in resolving issues.
- Deployed the Code form Dev to Test environment and responsible for the Data validation and support code testing.
- Expertise in Performance Tuning by identifying the bottlenecks at Sources, Targets, PowerCenter transformations and sessions using techniques like Explain plans, Oracle hints, re-designing the mappings.
- Created and optimized diverse SQL queries.
- Wrote complex SQL queries using joins, sub queries and correlated sub queries to retrieve data from the database.
- Created UNIX shell scripts to accomplish the requirements.
- Worked on indirect method of file loading.
- Used Informatica Scheduler for scheduling the Batch loads during Americas, Europe, and Asia region time zone.
- Involved in giving estimations for the efforts in application development.
Environment: Informatica 9.6.1, Oracle 11g, RHEL 6.7,TOAD 11.5,Microstrategy 10.1
Confidential, NJ
Sr.ETL Consultant
Responsibilities:
- Design and build the data warehouse components in multitier architecture which comprises of stage operational data store and analytical data mart for each applications.
- Understand the source system (Rave-Medi data) requirements and xml structure.
- Parse the xml format data from web services wif Java transformation.
- Process the data in metadata driven fashion which stores the history of reference data information.
- Developed the ETL mapping, session and workflow to load standard and custom Operational data.
- Solution the logic to dynamically created or alter the object and load the clinical data using dynamic sql
- Gather the user requirements and build the analytical marts based on reference, operational and clinical data.
- Created workflows and used various Tasks like Email,Event wait,Event Raise,Command,Decision and session in the workflow manager.
- Worked extensively on various reusable transformations, Mapplets and transformations such as Lookup, Joiner, Expression, Sorter, Router, Update strategy, Aggregate, Normalizer etc.
- Responsible for migrating to integration environment and user acceptance environment and support code testing and validation.
- Extensively used dynamic parameters and created workflows, worklets for the load logic based on decision strategies and roll back on failure scenario.
- Documented the design and build process for support and analysis.
- Involved in giving Estimations for efforts in the application development.
- Did Performance tuning and optimized if any bottlenecks were found in different areas.
- Worked wif peers to perform the code reviews and documented.
- worked in Agile/Scrum method of product implementation and delivery.
- Worked as a lead for a team of 5 members and coordinated between the business users and the team.
- Co-ordinated wif the QA team and certifying the test cases and test plans.
Environment: Informatica 9.1, Oracle 11g, HP-UX,Control-M,HP-ALM 11.0,Fitness Tool.
Confidential, OH
Sr. ETL Specialist
Responsibilities:
- Contributed as a member of the Data Management Group (DMG) responsible for Design, Development, and Implementation of interfaces and conversions.
- Involved in analyzing the different interfaces and source systems like SalesForce, Beam, Sigma, which were as a part of initial phase of SDM and working closely wif the business.
- Prepared application enhancement Designed document, Technical document based on the business requirements for the enhanced project.
- Developed and Tested Informatica mappings to load data into Flat files and to Teradata database from various source systems using MlOAD utility.
- Worked in Agile environment.
- Created Deployment groups for migrating the code from Dev to QA to Prod environments. Responsible for creating folders and giving privileges to the new users.
- Involved in creating the Bteq scripts for loading the data into the Dimensions and Fact tables which are in Teradata DB.
- Used Teradata SQL assistant for running the SQL Queries to check the data loaded to the Target Tables.
- Worked extensively on various reusable transformations, Mapplets and transformations such as Lookup, Joiner, Expression, Sorter, Router, Update strategy, Aggregate, Union etc.
- After the loading was complete balancing scripts were developed in order to make sure that the number of rows read from the source was in agreement wif the number of rows loaded in the target. This validation was done to check for the total counts and also for the data in all the fields.
- Designed and developed a script to Schedule jobs in the Meastro.
- Supporting the DW applications EASE, e-Prod, to ensure all the SLA's met and Financial extracts are sent on time.
- Analyzing and doing Impact analysis on the issues and resolving and providing solution for the issues.
- Handover the production support activities to the offshore as a daily handshake.
- Involved in giving Estimations for efforts in the application development.
- As a part of production support used my expertise in Trouble shooting and giving the appropriate resolution.
- Tuned the Informatica code to meet the SLA’s
Environment:Informatica 9.1,Teradata 13.1,Microstrategy 9.3,Linux 2.6,MS office 2007,HP ServiceCenter 6.2.6,HP QualityCenter 11,Meastro,CA Workstation 11.3/ESP,CA Software change workbench Manager(Harvest package) 12.1,Ultraedit
Confidential, Carmel, IN
Sr. BI ETL Developer
Responsibilities:
- Involved in overall SDLC lifecycle of the project in all stages right from the Analysis, requirement gathering, IVSC SDM design, development & reporting requirements.
- Created documents like the TDD, STT and UTP to suffice all the business requirements for the project.
- Involved in analyzing the different interfaces and source systems like AMS, EBIZ, LAI, AFC, and AutoVIN which were as part of the initial phase of the SDM working closely wif the Business.
- Worked very closely wif Architects to drive the Logical & physical models for the project looking into different subject areas and inter relations between each entity which derived in creating different set of tables for SRC, XREF, STG & TGT tables for the respective Dimension & Fact tables in the SDM.
- Design and develop Extract Transform and Load (ETL) and Data Integration (ETL) solutions for complex functional and technical requirements using Informatica Power Center and Power Exchange.
- Design and develop CDC and Datamap using Power Exchange 9.1.
- Creating Power Exchange Registration and Customizing power Exchange connection property and creating restart token.
- Created workflows and used various Tasks like Email,Timer,Schedular,Control,Decision and session in the workflow manager.
- Designed same set of mappings, mapplet & components to reuse for both Historical initial loads and incremental loads to pick data wifout manual intervention.
- Defined Target load order plan for loading data into different Target Tables.
- Documented different scenarios in the UTP and their results considering the business requirements for each table separately. Did Performance tuning and optimized if any bottlenecks were found in different areas.
- Worked wif the business users to assist them wif the system and UAT and system end to end test.
- Developed ftp scripts for external file processing wif the system to integrate wif Informatica. Documented the issues & failures occurred during each phase of the project.
- Did the code migration each environment to the other keeping in sync all the required objects of Informatica, UNIX, Windows and the DB scripts in a synchronized manner using versioning and migration documents.
- Used my expertise in debugging issues and noledge sharing when others in the team required it.
- Created Project run book for the production support team and transitioned it over to them along wif all the issues and resolutions. Worked on Production support until transition was done to the support team and as part of thewarrantyof the project developed. Documented all the process in detail at every phase of the project.
Environment: Informatica Power Center 9.1.6, Power Exchange 9.1, Oracle10g, Toad, BusinessObjectsXI 3.1, Sql server 2007, Erwin Data Modeler 7.2, HP Quality Center 9.2, Clearcase, Windows XP, Microsoft office 2007, MS Visio 2007, Unix.
Confidential, Whippany, NJ
S r. DW Developer
Responsibilities:
- Used Informatica Designer to create complex mappings using different transformations like Filter, Router, Connected & Unconnected lookups, Stored Procedure, Joiner, Update Strategy, Expressions and Aggregator transformations to pipeline data to Data Warehouse.
- Interacted wif business community and gathered requirements based on changing needs. Incorporated identified factors into Informatica mappings to build Data Warehouses.
- Developed mappings to extract data from SQL Server, Oracle, Flat files, DB2, Mainframes and load into Data warehouse using the Power Center, Power exchange.
- Conducted Database testing to check Constraints, field size, Indexes, Stored Procedures, Created testing metrics using MS-Excel.
- Implemented various identifying Bottleneck Performance Tuning technique on Source, Targets, Mapping, and Workflows.
- Designed and developed UNIX shell scripts to schedule jobs. Also wrote pre-session and post-session shell scripts, Wrote PL/SQL scripts for dropping, rebuilding indexes.
- Performed Configuration Management to Migrate Informatica mappings/sessions/workflows from Development to Test to production environment.
- Collaborated wif Informatica Admin in process of Informatica Upgradation from PowerCenter 8.6 to PowerCenter 9.1.
- Extensivly worked wif various Lookup caches like Static cache,Dynamic cache,and persistant cache.
- Developed workflow dependency Informatica using Eventwait Task,command wait.
- Worked closely wif the business analyst’s team in order to solve the Problem Tickets/ Service Requests.
- Involved in L3 support of the project.
Environment:Informatica Power Center 8.6, Oracle 10g, SQL, PL/SQL,BusinessObjectsXI 3.1,InformaticaPowerexchange 8.6, MS SQL Server 2000, Flat Files, Windows XP, Microsoft office 2007, UNIX Shell Scripting, Sql*Loader TOAD, SQL Developer, Erwin Data Modeler 7.2, Linux.
Confidential, Plano,TX
Sr. ETL Developer
Responsibilities:
- Involved in the documentation/Design of Technical Design Document of various interfaces like Sales organization, Field AOP, and Field Forecast.
- Used Teradata, SQL assistant for running the SQL Queries to check the data loaded to the Target Tables.
- Designed and developed mappings, mapplets and sessions from source to target database using Informatica Power Center.
- Used simple to moderately complex debugging techniques to test ETL applications.
- Developed Test Cases for testing the ETL mappings.
- Conducted code reviews and lead design reviews to assure compliance.
- Involved in migration of ETL/Bteq code from Development environment to QA environment and finally to Production environment.
- Followed Informatica development standards and enforce best practices.
- Performed QA work to verify the results provided from other teams.
- Worked wif various file formats like fixed length and delimited.
- Written SQL overrides in source qualifier and Lookups according to the business requirements.
- Involved in creation of BTEQ Script for validating the data quality like referential integrity, not null check.
- Utilizing the existing UNIX shell scripts to run the informatica workflow through process control.
- Scheduled sessions and batch process based on demand, run on time, run only once using Informatica Workflow Manager.
- Participated in *on-call* support for ODS and the data warehouse.
- Involved in documentation to describe program development, logic, coding, testing, and any changes and corrections.
Environment: Informatica Power Center 8.1, Teradata V2 R6, SQL, Windows XP, SQL Assistant, UNIX Shell Script. DB2, Sun Solaris.
Confidential, CT
Informatica Developer
Responsibilities:
- Involved in identification of facts, measures, dimensions and hierarchies for the DM model.
- Analyzed Source System data. Worked on Informatica Source Analyzer, Warehouse Designer, Mapping Designer, Mapplet and Transformation designer.
- Imported data from various Sources (Oracle, fixed width flat files, XML), transformed and loaded into Targets using Informatica.
- Used Teradata Special Loads like Tpump, Mload, and Fast Load.
- Created Stored Procedures to transform the Data and worked extensively on PL/SQL for various needs of the transformations while loading the data.
- Tuned mappings, transformations and recommended tuning options of source/target database to DBA team for obtaining optimum performance.
- Created Universe & the Business Objects Reports using the universe as the main Data provider and writing the complex queries including Sub queries, Unions, Intersect and Aliases using Business Objects features like Slice and Dice, Drill Down, and Formulae.
Environment: Informatica Power Center 7.1, Oracle 10g, SQL * Loader, MS SQL Server 2000, Sybase, Teradata, Erwin 3.5, Clear case, Business Objects 5.1, HP-UX, Windows 2000.
Confidential, St. Louis, MO
ETL Developer
Responsibilities:
- Analyzed source data and gathered requirements from the business users.
- Designed the functional specification and technical specification for migrating the existing database system to the data mart.
- Developed technical design specification to load the data into the data mart tables confirming to the business rules.
- Involved in the design phase of logical and physical data model using Erwin.
- Developed technical design specifications to extract the data from the data mart tables and export them as text files to the downstream system.
- Extensively worked on tuning of Informatica map for better performance.
- Tuned performance of Informatica session for large data files by increasing block size, data cache size, sequence buffer length and target based commit interval.
- Worked along wif the QA team in order to determine the data validation and preformed the data validating at the source and the target database level.
Environment: Informatica Power Center 7.1, Oracle 9i, Windows 2000, flat files, Erwin, Business Objects 5.0, Crystal Reports