Data Warehouse Etl Developer Resume Profile
SUMMARY
TECHNICAL SKILLS
|
EXPERIENCE
Confidential
ETL Developer
Responsibilities:
- Involved in gathering of business scope and technical requirements and created technical
- Specifications.
- Developed complex mappings and SCD type-I, Type-II and Type III mappings in
- Informatica to load the data from various sources using different transformations like Source
- Qualifier, Lookup connected and unconnected , Expression, Aggregate, Update Strategy,
- Sequence Generator, Joiner, Filter, Rank and Router and SQL transformations. Created
- Complex mapplets for reusable purposes.
- Deployed reusable transformation objects such as mapplets to avoid duplication of
- metadata reducing the development time. Responsible for migration of mapping from
- Development to Testing and to Production.
- Designed and Developed IDQ plans for Data Cleansing.
- Created synonyms for copies of time dimensions, used the sequence generator
- transformation type to create sequences for generalized dimension keys, stored procedure
- transformation type for encoding and decoding functions and Lookup transformation to
- identify slowly changing dimensions.
- Design and Develop ETL jobs using DataStage tool to load data warehouse and Data Mart.
- Develop complex ETL jobs by using DataStage parallel extender parallel processing capabilities.
- Fine-tuned existing Informatica maps for performance optimization. Created and managed
- the global and local repositories and permissions using Repository Manager.
- Worked on Informatica Designer tools Source Analyzer, Warehouse designer, Mapping
- Designer, Mapplet Designer, Transformation Developer and Server Manager to create and
- monitor sessions and batches.
- With the help of DataStage ETL, applied the business logic to the data in staging database and load them into target Oracle database.
- Seamlessly integrated the application with Informatica data quality IDQ tool for addressing the data quality issue and standardizing the data formats.
- Involved in the development of Informatica mappings and also tuned for better
- performance. Extensively used Stored Procedures, Triggers, Functions and Packages using
- PL/SQL for creating Connected and Unconnected Stored Procedure Transformations.
- Debugged mappings by creating logic that assigns a severity level to each error, and sending
- the error rows to error table so that they can be corrected and re-loaded into a target system.
- Involved in the Unit testing, Event Thread testing and System testing.
- Wrote a DataStage routine to capture the start and end times of the job to help get the incremental data.
- Analyzed existing system and developed business documentation on changes required.
- Mainly worked on the Mainframe JCL Made adjustments in Data Model and SQL scripts
- To create and alter tables.
- Maintained defects using Defect Tracking System in Test Director/ Quality Center.
- Extensively involved in testing the system from beginning to end to ensure the quality of the
- adjustments made to oblige the source system up-gradation. Also extensively involved in
- solving the ticket in mainframe JCL.
- Worked on various issues on existing Informatica Mappings to produce correct output.
- Efficient Documentation was done for all phases like Analysis, design, development, testing and maintenance.
Environment: Informatica Power Center 8.6, Oracle 9i, ODI, Mainframe JCL, UNIX, Solaris , Erwin 4.0/3.5.x, MS SQL Server 2000, PL/SQL, IBM Datastage, MS Access 2000, Shell Programming, SQL Loader Toad, TOAD for Oracle 10, Erwin, IDQ, WINCVS, XML, HP-UNIX
Confidential
ETL Developer
Responsibilities:
- Worked Developed various Mappings, Mapplet and Transformations for migration of data from various existing systems to the new system using Informatica Designer.
- on performance tuning and optimization of the Sessions, Mappings, Sources and Target
- Development and deployment of various Informatica mappings in different Environments.
- Developing various Job Scheduling codes to run various Production jobs using Job Scheduler.
- Testing the codes, Workflows, Mappings in Informatica Power center.
- Data Modeling done with Multidimensional Architecture.
- Extensive Experience in SDLC and in handing large volume of data.
- Testing the Application under various Environment using tools like Mercury Quality Center.
- Did error handling and performance tuning in Teradata queries and utilities.
- Did data reconciliation in various source systems and in Teradata.
- Involved in peer to peer to peer reviews.
- Identifying Bugs and reporting defects.
- Applied business rules using Informatica Data Quality IDQ tool to cleanse data.
- Knowledge of Backups, Partitioning of Database.
- Created and managed the global and local repositories and permissions using Repository Manager.
- Created DataStage jobs to extract data from the Teradata staging tables and loading them into Teradata Base tables.
- Knowledge of the ODI.
- Responsible for migration from Development to Testing and to Production.
- Responsible for Unit Test Plans and verification of functional specifications and review of deliverables.
- Designed and Developed ETL processes using Datastage, Teradata, PL/SQL, Oracle, SQL loader bulk loads and Unix shell programming for loading RDB data warehouse.
- Set up batches and participated in data quality tasks using Informatica data quality tool IDQ
- Extract and deploy various types of data in the target database using ODI.
- Development of pre-session, post-session routines and batch execution routines using server to run Informatica sessions.
- Developed data mappings between source systems and warehouse components.
- Created and defined DDL's for the tables at staging area.
- Documentation for ETL development process. Installation and troubleshooting guide.
- Worked on EDI transactions like 834/835/837.
- Dealt with Medicare D reports/data.
- Used FACETS data as source for the various data marts member/claims
- Worked with EDI gateways like Sybase Accelerator, Biztalk.
- Transformed EDI XML data to oracle tables.
- Involved with ICD 9 to ICD 10 changes for procedure and diagnosis codes.
- Involved with EDI 4010/5010 changes.
- Did integraiton testing of mappings and data transformations involvng service centers for various EDI transactions.
- Dealt with batch processes related to EDI/CLaims/Member data load.
Environment: Informatica Power Center 8.6, Oracle 9i, ODI, Teradata V2R3, UNIX Solaris , Erwin 4.0/3.5.x, MS SQL Server 2000, PL/SQL, IDQ, DataStage, MS Access 2000, Shell Programming, SQL Loader Toad
Confidential
Sr. Informatica Developer/Analyst
Responsibilities:
- Work experience with Informatica Power center 8.5.1/8.1.1.
- Created connected, unconnected and dynamic lookup for better performance.
- involved in fine tuning of sql queries in the transformations
- Created reusable Mapplets and transformations in informatica.
- Best in doing complex logic like slowly changing dimension typ2 and typ1, loading fact less fact table like LNK RATE FACT, FTP mappings for loading tables like ftp stage, GL stage, CC stage, Officers data and creating views or mapping using mapping specifications.
- Developed and Implemented Informatica parameter files to filter the daily data from the source system.
- Developed workflow tasks like reusable Email, Event wait, Timer, Command, Decision.
- Good Work Experience in various types of testing likes Integration testing, performance testing, parallel testing.
- Did error handling and performance tuning in Teradata queries and utilities.
- Worked with various databases of Teradata Warehouse in our project like Stage,Target and work and Error datastage
- Extensively worked in data Extraction, Transformation and loading from source to target system using Bteq, FastLoad, and MultiLoad.
- Experience in integration of various data sources like Oracle, DB2, SQL server and MS access into staging area.
- Have experience in developing mappings according to business rule, migrating to QA AND production, naming conventions, mapping design standards and good sound knowledge in DATAWAREHOUSE, PL/SQL concepts, ODBC connections etc.
- Used Ralph Kimball Methodology for building the data warehouse.
- Good Experience in Repository Administration, Backups and creation of User Groups.
- End to End support IN the Oracle data integration ODI .
- Solve the complex logic in the ODI.
- Creating Test case documents for Unit Test, Integration Test to check the data and Mapping documents.
- According to business logic created various transformations like Join, Expression, Aggregate, Rank, Lookup, Update Strategy, Filter and Router Transformations.
- Created Schema objects like Indexes, Views, and Sequences.
- Created Tasks, Workflows and Worklets using Workflow Manager. Monitoring of Workflows and Worklets using Workflow Monitor.
- Tuned performance of Informatica sessions for large data files by increasing block size, data cache size and, sequence buffer length.
Environment:Informatica Power Center /8.5/8.1 Workflow Manager, Workflow Monitor, Worklets, Source Analyzer, Warehouse designer, Mapping Designer, Mapplet Designer, Transformations ,Power Exchange Tool,Oracle 10g, Quest Central , SQL Developer, Datastage, SQLplus, PL/SQL Stored Procedure, Trigger, Packages ,ODI, Teradata, DB2,Erwin, MS Visio, Windows 2000, UNIX HP-UX
Confidential
Sr. Informatica Developer
Responsibilities:
- Interacted with the Business Users to analyze the business requirements and transform the business requirements into the technical requirements.
- Prepared technical specifications for the development of Informatica ETL mappings to load data into various target tables and defining ETL standards.
- Created logical and physical data models using Erwin.
- Created Entity Relationship ER diagrams based on requirements.
- Created ETL mapping documents for every mapping and Data Migration document for smooth transfer of project from development to testing environment and then to production environment.
- Migrated repository and Informatica mapping from 7.1.4 to 8.5.1
- Worked with various Informatica client tools like Source Analyzer, Warehouse designer, Mapping designer, Mapplet Designer, Transformation Developer, Informatica Repository Manager and Workflow Manager.
- Created mappings using different transformations like Source Qualifier, Joiner, Aggregator, Expression, Filter, Router, Lookup, Update Strategy, and Sequence Generator etc.
- Developed mapplets and worklets for reusability.
- Implemented weekly error tracking and correction process using Informatica.
- Implemented audit process to ensure Data warehouse is matching with the source systems in all reporting perspectives.
- Designing and creation of complex mappings using SCD type II involving transformations such as expression, joiner, aggregator, lookup, update strategy, and filter.
- Implemented Performance tuning in Mappings and Sessions by identifying the bottlenecks and Implemented effective transformation Logic.
- Extensively used Stored Procedures, Triggers, Functions and Packages using PL/SQL for creating Connected and Unconnected Stored Procedure Transformations.
- Created Maestro schedules/jobs for automation of ETL load process.
- Involved in Unit Testing, User Acceptance Testing UAT to check whether the data loads
- into target are accurate, which was extracted from different source systems according to the
- user requirements.
- Extracted the JMS text messages from the Oracle Advance Queue JMS Provider through the JMS Adapters installed on Informatica PowerCenter Server.
- Worked with JMS text messages as a source system, which arrive in the form of XML payload and also implemented Mid-stream transformations such as XML parser transformation to parse the XML string.
- Formatted Reports as per the user requirements using extensive functionalities in Business Objects, which allows the users to analyze the data.
- Created the reports using Business Objects functionalities like Queries, Slice and Dice, Drill down, functions, Cross Tab, Master/Detail and Formulae etc.
- Preparing and using test data/cases to verify accuracy and completeness of ETL process.
- Involved in the Production support and also transferred knowledge to the other team members.
Environment: Informatica Power Center 8.1.4, Oracle 7g, Unix, DB2, Sybase 12.x, MS SQL Server 2005, Business Object 6.x, TIBCO, TOAD, Erwin, WINCVS, XML, HP-UNIX
Confidential
Data Warehouse ETL Developer
Responsibility:
- Responsible for preparing the technical specifications from the business requirements.
- Analyze the requirement work out with the solution. Develop and maintain the detailed project documentation.
- Used Informatica and generated Flat file to load the data from Oracle to Teradata and BTEQ/Fast Load Scripts to do incremental load. Used Stage work and Dw table concept to load data, applied Start Schema concept. Created UDFs in JAVA Transformation to complete some tasks.
- Design, develop and implemented ECTL process for Marketing Team for existing tables in Oracle. Wrote BTEQ Scripts in order to support the project.
- Wrote stored procedures in PL/SQL and UNIX Shell Scripts for Automated execution of jobs
- Used version control system to manage code in different code streams like Clear case
- Performed data-oriented tasks on Master Data projects especially Customer/Party, like standardizing, cleansing, merging, de-duping, determining survivorship rules.
- Responsible for the design, development, testing and documentation of the Informatica mappings, PL/SQL, Transformation, jobs based on Paypal standards.
- Initiate, define, manage implementation and enforce DW data QA processes across, Interact with other QA Team. Interacted with data quality team.
- Identify opportunities for process optimization, process redesign and development of new process.
- Anticipate resolve data integration issues across applications and analyze data sources to highlight data quality issues. Did performance and analysis for Teradata Scripts.
- Migrate SAS Code to Teradata BTEQ Scripts to do the scoreing for score taking in account various parameters like login details, transaction amount etc. Playing with Marketing Data for various reports.
Environment: Oracle 7i, Informatica PC 7.1, PL/SQSL, Teradata V2R6, Teradata SQL Assistant, Fast load, BTEQ Script, SAS Code, Clear case, JAVA Language, Pearl Scripts, XML Source.
Confidential
ETL Developer
Responsibilities:
- Used Session parameters, Mapping variable/parameters and created Parameter files for imparting flexible runs of workflows based on changing variable values.
- Implemented complex mapping such as Slowly Changing Dimensions Type 2 using Flag.
- Designed various mappings and developed several transformation logics like source qualifier, joiner, update strategy, filter, router and expression in Informatica Designer.
- Developed pre-session and post sessions routines for sessions to drop and re-create indexes and key constraints for bulk loading.
- Documented all the mappings and sessions in accordance with unit test results
- Using the debugger in Informatica, tested the data in the warehouse and performed unit testing of Informatica mappings.
- Involved in adding Sources and Target databases to Mapping Designer of Informatica
- Extensively involved in production support, testing the data and day to day aspects of the data warehouse including deploying new code and loading history data into the data warehouse
- Debugged and implemented the best practices in mappings, sessions, and workflows for data extraction and loading from source to target databases.
- Documented design specifications
- Responded to help desk calls from customers and coordinated solutions with the rest of the developer's team. Took care of any process failures, easily identified cause of the problem and resolved issues.
Environment: Informatica Power Center, SQL Server, Windows XP, UNIX.