Sr. Etl Developer Resume
Irving, TexaS
SUMMARY
- Overall 8+ years of extensive experience in the implementation of Data Warehousing application.
- Well versed with Data warehousing Architecture on the Design, Development, Extraction, Transformation and Loading of data using Informatica Power Center 7.1.3/8.1/8.6/9.1/9.5 as an ETL tool.
- Handled Enterprise Data Warehouse(EDW)/Data mart, ODS, OLTP and OLAP implementations teamed with project scope, Analysis, requirements gathering, data modeling, Effort Estimation, ETL Design, development, System testing, Implementation and production support.
- Highly Proficient in Informatica Designer Components like Source Mapping Designer, Mapplet Designer, Transformation Developer, Workflow Manager and Workflow Monitor.
- Expertise in using Oracle 8i/9i/10g/11g/12c & Teradata and had hands on experience in building advanced relational database objects which uses Oracle 8i/9i/10g/11g/12c, Teradata database.
- STREAM & UPDATE operators) to export and load data to/from different source systems including flat files.
- Strong knowledge in Data Modeling (Relational, dimensional, Star and Snowflake Schema), identifying FACT and Dimensions Tables, Physical and Logical Database design using ERWIN .
- Troubleshooting and problem solving applications with Informatica Debugger and performing code migration from Dev to Test.
- Extensive experience on Designing, Managing and administrating MDM/DIW objects using MDM.
- Experience in Customer Data Integration (CDI), and Product Information Management (PIM) comprising of the Master Data Management (MDM).
- Hands on Experience with Informatica MDM - XU-DB2
- Experienced in using Informatica DATA quality (IDQ 8.6) - profiling, metadata validation, address cleansing and matching rules.
- Designed complex mappings using Source Qualifier, Filter, Normalizer, Aggregator, Router, Update Strategy, Union, Unconnected and Connected Lookups, Joiner, Sorter and Stored Procedure Transformations.
- Developed various Data Documentation Standards and ETL Mapping Documentations.
- Exposure to various business processes spanning over Insurance, Banking, Health Care, Finance and Retail.
- Designed Reusable Transformations and Mapplets for better usability and performance.
- Hands on experience in Performance Tuning of sources, targets, transformations and sessions.
- Knowledge of working with tools like Toad and utilities like SQL* PLUS, SQL Developer.
- Good understanding of IT Mainframe Applications written in JCL, COBOL/SAS and DB2 database tool (SPUFI).
- Expertise in Enterprise Data Warehouse (EDW) SDLC and architecture of ETL, reporting and BI tools.
- Excellent analytical and logical programming skills with a good understanding at the conceptual level and possess excellent presentation, interpersonal skills with a strong desire to achieve specified goals. Excellent written and verbal communication skills including experience in proposal and presentation creation.
- Extensive experience working in an Agile/Scrum, Waterfall development environment.
- Excellent team member with problem solving, troubleshooting skills and interpersonal skills.
- Worked closely with the business analyst team in order to solve the Problem Tickets, Service Requests.
TECHNICAL SKILLS
ETL Tools
: Informatica Power Center 7.1.3/8.1/8.6/9.1/9.5, Power Exchange Navigator v5.2.2/8.1, Information Data Quality(IDQ),Informatica Power Center MDM.
Databases: Oracle 8i/9i/10g/11g/12c, MS SQL Server 2005/2008, DB2 8.1/9.7, Teradata 8.1/13
Operating Systems: Windows 2000/2003/XP/Vista/7.0/8.0, UNIX, Z/OS
Programming Languages: C, C++, Core JAVA, SQL, PL/SQL, Base SAS, COBOL, HTML
Database utilities: SQL*Plus, SQL Developer, TOAD, Teradata, MS SQL Server
Data Modeling: ERWIN
Scripting Languages: UNIX Shell Scripting, Power Shell, JCL
Methodologies: E-R Modeling, Star Schema, Snowflake Schema
IBM MF Tools: File-Aid, Changeman, Infoman, SPUFI
Scheduling Tool: Autosys
PROFESSIONAL EXPERIENCE
Confidential, Mount Laurel New Jersey
Sr. ETL Developer/Lead
Responsibilities:
- Prepared the Technical specification documents based on business requirements
- Understanding the existing ETL code and then addingnew business rules and migrated to new ETL Environment.
- Responsible for proper knowledge transfer from development team and ensure all the required documents are handed over.
- Responsible for identifying the Addition/removal of Power center objectsneeded while upgrading.
- Responsible for Unit testing, regression and performance testing in new upgraded environment.
- Worked on performance Tuning of the mappings to handle increasing data volume
- Extensively worked on UNIX shell scripts on automation (Auto restart of servers, Disk space utilization, Informatica Server monitoring and UNIX file system maintenance and cleanup, and scripts using Informatica Command line utilities.
- Experience with Data profiling and address match/merge rules with IDQ.
- Validated data dictionary using IDQ with new legacy mergers.
- Prepared the scheduling document to implement the job dependencies, setup the sequential or concurrent jobs for better execution in each subject area.
- Designed and implemented Informatica Data Quality applications for the business and technology users across the entire full development life-cycle.
- Used post session success, post session failure commands in the session task to execute scripts for reconciliation, cleanup and updates
- Involved in writing test scripts, unit testing, system testing and documentation
- Prepared and ran sql queries to verify Dimensional and Fact tables data loads
- Developed complex mappings using Informatica Power Center Designer to for multiple geographic locations via flat files to load to database
- Developed Shell Scripts for retrieving files from FTP server, achieving the source files, Concatenating files and finally to deliver them to remote shared drive
- Scheduled, Run and Monitored Informatica flows using Informatica scheduling tool.
- Identify list of tables to consider for Data replication and categorize them for incremental vs truncate/reload vs drop/create. Also Built the configs for incremental vs truncate reloads.
- Developed Shell Scripts for retrieving files from FTP server, achieving the source files, Concatenating files and finally to deliver them to remote shared drive
- Design and review documents including Software Requirement Specifications to ensure all the requirements are covered.
- Reviewed complex mappings using multiple transformations, sessions, workflows in Informatica and lead the ETL team.
Environment: Informatica Power Center 9.5/8.6, Informatica Power Center IDQ 8.6.1, Oracle 12c/11g, PL/SQL developer, SQL*PLUS and UNIX
Confidential, Irving Texas
Sr. ETL Developer
Responsibilities:
- Involved in identifying the source and source datavalidation,developing particular logic and transformation as per the requirement and creating mappings and loading the data.
- Designedthe ETL processes using Informaticato load data from Flat Files, XML Files, Excel files and used Power exchange for mainframe sourcesto Oracle Staging area.
- Designed and customized data models for EDW from multiple sources on real time
- Involved in design and development complex ETL mappings and stored procedures. Designed and developed Informatica mappings for data loads, business rules development and data cleansing.
- Debugged mappings by creating logic that assigns a severity level to each error,and sending the error rows to error table so that they can be corrected and re-loaded into a target system.
- Worked onSource Analyzer, Data warehouse designer, Mapping Designer, Mapplet Designer, Transformation Developer and Repository Manager.
- Populated MDM tables using Stating table feed or File feed.
- Extensive knowledge on Informatica Master Data Management (MDM) concepts.
- As an MDM Developer, responsible for the developing, enhancing and supporting the Informatica MDM platform and related data integration applications.
- Implemented Informatica MDM new source workflow, including data profiling, configuration specification and coding, match rules tuning.
- Extensively worked on the performance tuning of theInformatica PowerCenter Mappings as well as the tuning of the sessions.
- Extensively used Data Profiling and Data Dictionary validation as part of heave history data conversion from legacy systems using Informatica Power Center IDQ.
- Created Detail design documents and Technical design specification documents for ETL Process based on the Business Requirements.
- Extensively used Transformations likeAggregator, Joiner, Expression, Filter, Update, Lookup, Sorter and Stored Procedure transformations
- Tested all the mappings developed and checked the data transformations.
- Improved session performancewith pipeline partitioning and increasing block size, data cache size, sequence buffer length and targetbased commit interval.
- Worked extensively on Informatica to extract data from flat files and Oracle, and to load the data into the target database.
- Worked on Informatica Power Centerfor (ETL) extraction, transformation and loading data from heterogeneous source systems
- Extensively worked onInformatica client tools like Designer, Workflow Manager, and Workflow Monitor and Repository Manager.
- Created Stored Procedures for data transformation.
- Created Tasks, Workflows, Worklets to move the data at specific intervals on demand using Workflow Manager and Workflow Monitor.
- Created complex mappings using Aggregator, Expression,Joiner, XML transformations, Union Transformation, SQL Transformation,complex lookups, Stored Procedures, Update Strategy, PDO and others.
- Used Informaticaas a Data Cleansing tool to correct the data before loading into the staging area.
- Developed scenarios for Unit, System Integration testing to ensure that all the components work correctly when integrated.
- Developed UNIX shell scripts to manipulate the data.
- Solving day-to-day problems, giving support to the Business Users.
- Worked closelywithBusiness QA team during the testing phase andfixed bugs that were reported.
- Involved in Production Support in a 24/7 environment and troubleshooting data quality and integrity issues.
- Created reusable transformations and mapplets in the designer using transformation developer and mapplet designer tools.
- Implemented Performance Tuning Logics wherever possible to provide maximum efficiency and performance.
- The team followed an Agile/Scrum development methodology, so I performed development on user and technical stories in an iterative fashion.
Environment: InformaticaPower Center 9.0.1/ 8.6.1, Informatica Power Center IDQ, Informatica MDM,Oracle 11g/12c, PL SQL (Stored Procedure, Trigger, Packages) and UNIX.
Confidential, Arlington Texas
Sr. ETL Developer
Responsibilities:
- Attended multiple requirement gathering sessions with source system teams and business users.
- Designed data structures for storage and programmed logic for data flow between the various stages of toll transaction processing.
- Maintained and tracked weekly status call with team and finished the deliveries within given timeline.
- Experience in working with Slowly Changing Dimensions and setting up Change Data Capture (CDC) mechanisms.
- Extensively Implemented SCD TYPE 2 Mappings for CDC (Change data capture) in EDW.
- Developed mappings to extract data from SQL Server, Oracle, Flat files, XML files, and loaded into Data warehouse using the Mapping Designer.
- Used Source Analyzer and Warehouse Designer to import the source and target database schemas, and the Mapping Designer to map the sources to the target.
- Created and modified COBOL copybook to connect source data using Power Exchange Navigator.
- Used Power Exchange Data Change option (CDC) to capture modified records.
- Used Informatica Designer to create complex mappings using different transformations like Filter, Router, Connected & Unconnected lookups, Stored Procedure, Joiner, Update Strategy, Expressions and Aggregator transformations to pipeline data to Data Warehouse.
- Supported Informatica MDM Allscripts application.
- Shared the knowledge with Business people on how to work on MDM interface, key-in the master data, authorize and publish the data.
- Worked on providing the data security for the MDM categories. Only the assigned role people can enter the data into MDM interface and to authorize or approve the master data.
- Developed Slowly Changing Dimensions for Type 1 SCD and Type 2 SCD.
- Developed various Stored Procedures, Functions, Packages and Materialized views for ETL needs.
- Developed unit test plans for each scenario and programmed for data validation and proper error handling to manage the transactions without any data loopholes.
- Responsible for tuning the Informatica Mappings and Sessions for optimum performance.
- Involved in Dimensional modeling (Star Schema) of the Enterprise Data Warehouse (EDW) and used Erwin to design the business process, dimensions and measured facts.
- Responsible for loading the flat files into Oracle database by using SQL* Loader and Informatica.
- Database performance by optimizing back end queries, PL/SQL tuning and implementing performance improvements by analyzing indexes, table partition, parallelism etc.
- Documentation of all changes made to enhance the code for new requirements.
- Used external tables to manipulate data obtained on monthly basis for vehicle information before loading them into the tables.
- CreatedInformaticamappings, sessions, workflows and scheduled it throughShellScripts.
- Created different SCD-II mappings using changed data capture (CDC) processes.
- Utilized Quest tool (Toad 8.0) for database monitoring and tuning.
- Involved in writing complex report SQL queries, oracle forms and oracle reports solutions.
- Worked in the Agile/ Scrum development environment with frequently changing requirements.
- Involved in post-production support activities.
Environment: Informatica 9.0.1/8.6, Informatica MDM, Erwin 7.1, Oracle 11g, Teradata 13, PL/SQL developer, SQL*PLUS, SQL, SQL*Loader, Toad, ER-Studio, UNIX, Power Shell, CVS, HTML, XML
Confidential, Deerfield Illinois
Sr. Informatica Developer
Responsibilities:
- Designed, developed and delivered Data Warehouse solutions as per business requirements.
- Coordination with business users to gather the requirements.
- Parsed high-level design specification to simple ETL coding and mapping standards.
- Estimations, planning and tracking of ongoing ETL projects.
- Evaluation of ETL processes to identify areas of improvement. Tuning of Informatica ETL components for optimal load performance.
- Extensively used Informatica Power Center for Extracting, Transforming and Loading from different databases.
- Developed mappings, tested the mappings using various test cases in the test plans
- Developed complex mappings using Informatica Power Center Designer to transform Data extraction from different legacy systems, Oracle, SQL Server, flat files and loading to different target systems.
- Understanding Source system data issues with Source System Owners and designing to handle the gaps.
- Document the source - to target transformation rules for the various data entities by studying the existing batch programs and interviewing the system owners.
- Create data definition documentation for the enterprise including metadata, data flow diagrams, system data flowcharts and source to target mappings.
- Designed and developed ETL Processes based on business rules, job control mechanism using Informatica Power Center.
- Provide technical and analytical support for process improvement initiatives.
- Single point of contact for user’s data questions, any new enhancements in current DWH processes.
- Preparing migration/deployment strategy, rollout and rollback plans, identifying the potential risks involved.
- Weekly, Monthly, Quarterly reporting of ongoing project’s status, challenges and achievements.
- Responsible for maintaining different process documents like mapping status document, Issue log, Defect detection log etc.
- Responsible for analyzing the Error table data/rejected data and fix them.
Environment: Informatica Power center 8.6, Oracle 10g/11g, PLSQL, MY-SQL, SQL Developer, Toad, HP Quality center, MS Office, Business Objects XI 3.2, CSV files, Flat Files, and Linux.
Confidential, Irving Texas
Informatica Developer
Responsibilities:
- Involved in gathering the business requirements and molding them in to the technical specifications required for the conversions team.
- Designed the target Data Warehouse using Star Schema, Involved in Extraction, Transformation and Loading (ETL) Process.
- Extensively worked over the online tracking system for work-requests, database change request issues, automated UNIX scripts modification issues and various scheduler jobs issues.
- Collection of requirements from business users and analyzed based on the requirements.
- Designed and developed complex Informatica mappings using expressions, aggregators, filters, lookup and stored procedures to ensure movement of the data between various applications.
- Mappings involved transformations like Expression, Sequence Generator, Joiner, and Update Strategy.
- Created sessions by extensively using ETL methodology for complete processing of data extraction, transformations and loading using Informatica.
- Managed multi source data extraction using Informatica.
- Involved in necessary training and knowledge transfer to assigned project members.
- Implemented mapping for slowly changing dimensions (SCD) to maintain current data as well as historical data.
- Created sessions and batches for data movement using Workflow Manager.
- Created reusable Transformations and Mapplets and used them in mappings in case of reuse of the transformations in different mappings.
- Developed and documented Data Mappings/Transformations, and Informatica sessions as per the business requirement.
- Developed PL/SQL procedures for processing business logic in the database and use them as a Stored Procedure Transformation.
- Extensively worked in the performance tuning of programs, ETL procedures and processes. Error checking and testing of the ETL procedures and programs using Informatica session log.
- Provided end user training and production system support, also worked with architecture team to review the Informatica standard documents.
- Worked extensively on Oracle database 10g and flat files as data sources.
Environment: Informatica Power center 8.1/7.5, SQL Developer, Oracle 10g, PLSQL, Jira, MS Office Suite, UNIX Shell Scripting.
Confidential
ETL Developer
Responsibilities:
- Designed ETL mapping based on Existing ETL logic.
- Worked with various transformations like Source Qualifier, Look up (connected and unconnected), Expression, Aggregate, Update Strategy, Sequence Generator, Joiner, Filter, Rank and Router transformations.
- Involved in the development of Informatica mappings and also tuned for better performance.
- Extensively used ETL to load data from flat files to Oracle.
- Prepared mapping specification document, which gives the data flow and transformation logic for populating each column in the data warehouse table.
- Made adjustments in Data Model and SQL scripts to create and alter tables.
- Worked extensively on SQL, PL/SQL and UNIX shell scripting.
- Analyzed the source system of ETL Maps.
- Designed and developed the fact/dimension entities.
- Co-ordination with Client Business & Systems team for QA.
- Performed the tuning of ETL SQLs.
- Compared actual results to expected results and suggested changes to mappings owned by others
- Worked on new data model to form the single security master for all the Data Marts and retrofit the existing and new securities in the FACT tables.
- Worked on Informatica Power Center tools - Designer, Repository Manager, Workflow Manager, and Workflow Monitor.
- Extracted the data from the flat files and other RDBMS databases into staging area and populated onto Data warehouse.
- Used Type 1 and Type 2 SCD mappings to update slowly Changing Dimension Tables.
- Used Session parameters, Mapping variable/parameters and created Parameter files for imparting flexible runs of workflows based on changing variable values.
- Worked as a fully contributing team member with independent planning & execution responsibilities.
Environment: Informatica Power center 7.1.2, Oracle 9i, PLSQL, MY-SQL, SQL Developer, HP Quality center, MS Office, Business Objects XI, and Linux.