Etl Engineer Resume
Irvine, CA
SUMMARY
- 8+ years of total IT experience in the Planning, Analysis, Design, Implementation and Maintenance in different domains of Financial, Manufacturing, Pharmaceutical, Health and Retail Oriented companies.
- 7+ years of Data Warehousing experience in designing and implementing Data Warehouse applications using Informatica Power Center.
- Proficient in Data Modeling, Strong in Data Warehousing concepts, Dimensional, Star Schema and Snowflake Schema methodologies. Complete understanding of Ralph - Kimball and Inmon approaches to Data Warehousing.
- Extensively worked on the ETL mappings, analysis and documentation of OLAP reports requirements. Solid understanding of OLAP concepts and challenges, especially with large data sets.
- Worked on Slowly Changing Dimensions (SCD's) and its implementation to keep track of historical data.
- Experience in using Agile/Scrum methodologies..
- Associated with Finance, Insurance, Healthcare, and Energy & Utilities industries
- Worked on various types of transformations like Lookup, Update Strategy, Stored Procedure, Joiner, Filter, Aggregator, Expression, Rank, Router, Normalizer, Sorter, External Procedure, Sequence Generator, and Source qualifier and SCD Type-2 .
- Worked on data integration of multiple data sources and targets like Oracle, SQL Server, MS Access, Flat files, COBOL files and XML.
- Experience in UNIX working environment, writing UNIX shell scripts for Informatica pre & post session operations.
- Developed reports using Microsoft Reporting Services platform (SSRS), MS Excel, Pivot tables.
- Good knowledge in interacting withInformatica Data Explorer (IDE), and Informatica Data Quality (IDQ).
- Experienced in database development like PL/SQL Packages, Stored Procedures/Functions, triggers, Cursors, Indexes.
- Hands on experience in tuning mappings, identifying and resolving performance bottlenecks in various levels like sources, targets, mappings, and sessions and at database.
- Working Knowledge of Implementation Methodology, Scope, Planning, Estimates, Designing, Developing, Debugging, Testing, Documentation and Data Archiving.
- Strong experience in writing UNIX Shell scripts, SQL Scripts for Development, Automation of ETL process, error handling and reporting purposes.
- Having a good understanding of Teradata.
- Expertise in SQL queries and Query Optimization, Report Testing techniques.
- Experience in analyzing and modifying current SQL Server Integration Services SSIS packages in order to support business change requirements and new source data.
- Responsible for interacting with business partners to identify information needs and business requirements for Reports.
- Excellent analytical, problem solving, communication and interpersonal skills, with ability to interact with individuals at all levels and ability to work in a team as well independently.
TECHNICAL SKILLS
Databases: Oracle 8.x/9.x/10g/11g, SQL Server 2005/2008/2012 DB2, My SQL 5.0/4.1, MS-Access. Editors (SQL Navigator, Toad), Teradata
Database Tools: Oracle Enterprise Manager, Quest TOAD, SQL*PLUS, SQL*Loader SQL Navigator Export/Import, SSIS, SSRS
ETL Tools: Informatica Power Center 9.5/9.1/8.6.0 , Informatica Power Exchange 9.1, Informatica Power Analyzer, Informatica Data Quality (IDQ),Webservices
Data Modeling: ERWIN 4.0, Star and Snowflake Schema Modeling, Dimensional Data modeling, Fact and Dimensional Tables.
Programming Skills: SQL, PL/SQL, C, C++, Unix Script
Package: MS Office (MS Access, MS Excel, MS PowerPoint, MS Word, MS Project), Visual Studio 6.0.
Environment: Windows 2000/XP/7, Unix, Windows SERVER 2003
PROFESSIONAL EXPERIENCE
Confidential, Irvine CA
ETL Engineer
Responsibilities:
- Designed high level ETL architecture for overall data transfer from the OLTP to OLAP.
- Involved in support the agile development team by picking up stories for design/development
- Participated in addition of new sources for MDM implementation.
- Created various Documents such as Source-To-Target Data mapping Document, Unit Test Cases and Data Migration Document.
- Implemented the logic by usingHTTP transformationto query the web server.
- Configure and setup a secureFTP connectionto the vendor using the Informatica Managed File transfer software.
- Created complexBatch scriptsfor various set of actions in the MFT (managed file transfer) that would automate the process of executing the actions like validating the presence of indicator files and concurrently running the actions for successful transmission.
- Wrote Korn Shell Scripts to execute Power center jobs using Control M Scheduling tool.
- Designed and build aweb services integration.
- Unit tested and tuned SQLs and ETL Code for better performance.
- Created mappings using the transformations like Source Qualifier, Aggregator, Expression, Lookup, Router, Normalizer, Filter, Update Strategy and Joiner transformations.
- Designed the Data Acquisition, Transformation, and Data Cleansing approach for the MDM implementation.
- Created reusable transformations and Mapplets and used them in complex mappings.
- Used debugger in identifying bugs in existing mappings by analyzing data flow, evaluating transformations.
- Designed and developed UNIX shell scripts to schedule jobs. Also wrote pre-session and post-session shell scripts.
- Implemented Logging and Event Handlers on SSISpackages for trouble shooting.
- Excellent report creation skills using Microsoft SQL Server Reporting Services(SSRS) with proficiency in using Report Designer as well as Report Builder.
- Created SQL Server Reports based on the requirements using SSRS 2012.
- Wrote Korn Shell Scripts to execute Power center jobs using Control M Scheduling tool.
- Unit tested and tuned SQLs and ETL Code for better performance.
- Created Stored Procedures to transform the data. Worked extensively on SQL, PL/SQL for various needs of the transformations.
- Actively involved in building the system test environment and migrated mappings from Development to System Test environment and executed code in QA environment.
- Analyzed and modified current SQL Server 2008 Integration Services SSIS packages in order to support business change requirements and new source data.
- Created packages in Harvest to migrate code across multiple environments through a standard transmittal process.
- Participated in Review of Test Plan, Test Cases and Test Scripts prepared by system integration testing team.
- Executed business needs in relation to MDM requirements of company sites
- Monitored the performance and identified performance bottlenecks in ETL code.
Environment: Informatica Power Center 9.5, Web Services, Integration Services SSIS, SSRS, Microstrategy 9.4x,Oracle 11g, DB2, Erwin 4.0, Unix Shell Scripting, TeraData, Control M, MS PowerPoint, Business Objects 6.0/6.5, SAS, TOAD, SQL, PL/SQL.
Confidential, St.Louis MO
ETL Informatica Developer
Responsibilities:
- Performed major role in understanding the business requirements and designing and loading the data into data warehouse (ETL).
- Created new mappings and updating old mappings according to changes in Business logic.
- Performed extraction, transformation and loading of data from RDBMS tables and Flat File sources into Oracle RDBMS in accordance with requirements and specifications.
- Extensively used various transformations Lookup, Update Strategy, Expression, Aggregator, Filter, Stored Procedures and Joiner.
- Performed Unit Testing and tuned the mappings for better performance.
- Created reusable transformations and mapplets.
- Used Informaticareal time using webservices, Salesforce.com and Change Data Capture.
- Writing PL/SQL procedures days of supply for processing business logic in the Database.
- Worked on SQL tools like TOAD to run SQL queries to validate the data.
- Worked on database connections, SQL Joins in Database level.
- Extensively used SQL to load Data from flat files to Database tables In Oracle.
- Used Workflow manager for session management, database connection management and scheduling of jobs to be run in the batch process.
- Using Unix Shell Scripting for scheduling Informatica workflows.
- Used calculations, variables, sorting, drill down, slice and dice for creating Stock Status Report.
- Configured the report viewing security for various users at various levels using SSRS Report Manager.
Environment: Informatica Power Center 9.1,Oracle 10g, Windows NT, Flat files, TOAD, SQL, PL/SQL, SQL Workbench, Putty, Unix Shell Scripting.
Confidential, Columbia, MD
Sr. ETL Developer
Responsibilities:
- Involved with Business Analysts in gathering requirements.
- Used MicroStrategy to deliver strategic, reliable, best-of-breed business intelligence solutions to customers.
- Involved in designing Logical/Physical Data Models.
- Developed PowerCenter mappings to extract data from various databases, Flat files and load into DataMart using the Informatica 8.6.1.
- Created complex mappings using different transformations like Filter, Router, Connected & Unconnected lookups, Stored Procedure, Joiner, Update Strategy, Union, Expression and Aggregator transformations to pipeline data to DataMart. Also, made use of variables and parameters.
- Collects metadata from across data integration environments and provides a visual map of the data flows within that environment.
- Worked on multiple enhancement projects, conversion from PowerCenter 8.1.1 to 8.6.1 and Oracle Warehouse Builder to Informatica.
- Created T-SQL procedures to detect CDC methodologies and developed Slowly Changing Dimension for Type 1 SCD.
- Created Indexes, primary keys and checked other performance tuning at data base level.
- Implemented various Performance Tuning techniques on Sources, Targets, Mappings, and Workflows.
- Created Technical Design Document and worked with operations team to resolve production issues, created testing metrics using MS-Excel.
- Written shell scripts in UNIX to execute the workflow in a loop to process ‘n’ number of files and FTP Scripts to pull the files from FTP server to Linux Server.
- Involved with reporting team to generating reports from Data Mart using Cognos.
Environment: Informatica PowerCenter 8.6/8.1, Microstrategy version 9, SQL Server 2005, TOAD, Rapid SQL, Oracle 10g (RAC), T-SQL, PL/SQL, UNIX Shell Scripts, FTP and Oracle Warehouse Builder .
Confidential, Houston, TX
Data Warehouse Analyst
Responsibilities:
- Worked with various active transformations in Informatica Power Center like Filter Transformation, Aggregator Transformation, Joiner Transformation, Rank Transformation, Router Transformation, Sorter Transformation, Source Qualifier, and Update Strategy Transformation.
- Extracted data from various heterogeneous sources like Oracle, SQL Server, Teradata, MS Access, and Flat files.
- Extensively worked with Slowly Changing Dimensions Type1, Type2, and Type3 for Data Loads
- Responsible for Performance Tuning at the Mapping Level, Session Level, Source Level, and the Target Level.
- Implemented Informatica Power Exchange CDC Option to capture the changes for up-to-the-minute data and increasing business agility.
- IDQ is used to deliver powerful data cleansing, matching capabilities in a single solution, empowering business information and manage effective and lasting data quality processes enterprise wide.
- Informatica Web Services integrated with Informatica Power Center to exploit the platform’s scalability and management of Web services for enterprise deployment.
- Worked with re usable objects like Re-Usable Transformation and Mapplets.
- Responsible for migrate the workflows from development to production environment.
- Extensively worked with Incremental Loading using Parameter Files, Mapping Variables, and Mapping Parameters.
- Responsible for Performance in Informatica Power Center at the Target Level, Source level, Mapping Level, Session Level, and System Level.
Environment: Informatica Power Center 8.1.1,.Net, Java, Toad 7.2, Teradata, SQL Server, Oracle 9i,HIPAA X12 files, Flat Files, Pearl Scripting, UNIX, Windows XP.
Confidential
Informatica Developer
Responsibilities:
- Coordinated with the client and gathering user requirements. Designed and ETL process using Informatica Tool.
- Worked with various active transformations in Informatica PowerCenter like Filter Transformation, Aggregator Transformation, Joiner Transformation, Rank Transformation, Router Transformation, Sorter Transformation, Source Qualifier Transformation, and Update Strategy Transformation.
- Worked extensively with passive transformations in Informatica PowerCenter like Expression Transformation, Sequence Generator and Lookup Transformation.
- Extensively worked with aggregate functions like Avg, Min, Max, First, Last and Count in Aggregator Transformation.
- Extensively used SQL Override, Sorter and Filter in the Source Qualifier Transformation.
- Extensively used Normal Join, Full Outer Join, Detail Outer Join and Master Outer Join in the joiner Transformation.
- Created Connected and Unconnected Lookup Transformation for better performance.
- Done caching optimization techniques in Aggregator, Lookup and Joiner Transformation.
- Performance tuning of sources, targets, mappings and SQL queries in the transformations.
- Created reusable transformations and used in various mappings.
- Used various debugging techniques to debug the mappings.
Environment: Informatica Powercenter 7.X, TOAD, Oracle 8.0.4, SQL server 2000, Flat Files, Erwin, MS Visio, UNIX, Windows.
Confidential
PL/SQL Developer
Responsibilities:
- Gathered requirements from business and created functional specifications
- Analysis of data models based on business requirements.
- Studied current state and designed future state in PL/SQL and derived extract and load strategy
- Involved in Unit Testing, Integration Testing, and System Testing.
- Written stored procedures for ledger processing and bill processing modules.
Environment: Oracle 8i, Windows 2000, PL/SQL, JDK1.1, HTML 3.2, Java Script 1.2.