Etl Developer (informatica) Resume
Grand, RapidS
SUMMARY
- 6+ years experience of working as ETL / Informatica developer.
- Hands - on experience in Data warehousing, ETL, applications using Informatica (Powercenter/Power Mart).
- Ensure accuracy and integrity of archived data through analysis, coding and validation.
- Created clear documentation of the process to be followed during the retirement of legacy applications and archiving of Health System data.
- Created mapping using different transformations such as Source Qualifier, Connected - Unconnected Lookup, Filter, Expression, Router, Normalizer, Joiner, Update, Rank, Aggregator, Stored Procedure, Sorter and Sequence Generator.
- Created custom reports using various tools including Crystal Reports and JReport.
- Describes the Capabilities of DTS and summarizes the business problem it addresses.
- Used Informatica to convert Oracle data into HDFS(Hadoop distributed file system)
- Worked in a Development profile, creating rules / mapplets, mappings using transformations like standardizer, match, parser, labeler and SQL, profiles and scorecards in IDQ 9.x developer and Analyst.
- Analyze and Translate data needs and change requests into technical specifications.
- Excellent hands-on experience with Informatica Workflow Manager and Mapping Designer and Data Quality (IDQ) (mappings, profiles and scorecards).
- Used IDQ transformation like labels, standardizing, proofing, parser, address doctor, Match, Exception transformations for standardizing, profiling and scoring the data.
- Used IDQ analyst tool to correct the bad table records, reprocessed the records in Analyst.
- Created reference data table in IDQ Analyst.
- Created views on all the required claims tables and got required data in staging area.
- Experienced in creating, backup and restore the Informatica repository Manager and worked with various Error handling strategies.
- Extensively used ETL to load data from Flat files, XML Files, SQL server and oracle sources to SQL server target and worked with Dynamic parameter files.
- Good knowledge of working with various sources like Oracle, SQL Server, Teradata files.
- Experienced in using the Oracle SQL* Loader feature for loading the data from Flat Files to Data Base tables for Bulk Loading.
- Outstanding experience in retrieving the data by writing simple/ complex SQL Queries and using SQL, PL/SQL, Indexes, Functions, Procedures, Triggers and Cursors.
- Strong hands on experience using Teradata utilities (SQL, B-TEQ, Fast Load, MultiLoad, FastExport, Tpump, Visual Explain, Query man, WinDDI) and Unix Shell scripting.
- Worked on coding, testing and tuning of Informatica jobs and performed extensive data analyzing and testing the reporting files coordinating with offshore team.
- Provided Production support and user training.
TECHNICAL SKILLS
ETL tools: Informatica Power Center 9.x/8.x/7.x/6.x, IDQ 9.1
Databases: MS SQL SERVER 2008, Oracle 9i, 10g, 11g, Teradata, IBM DB2, Sybase, Tidal, TOAD.
Client side: SQL, T-SQL, PL/SQL, UNIX Shell scripting, XML, Microsoft Visual Studio, Microsoft DTS Packages.
Operating Systems: Windows 2002/2003/XP/7/8, UNIX
Web technologies: HTML, XML, XHTML, DHTML
PROFESSIONAL EXPERIENCE
Confidential, Grand Rapids
ETL Developer (Informatica)
Responsibilities:
- Installed and configured PowerCenter 9.6.1 on windows platform.
- Creation and maintenance of Informatica users and privileges.
- Created Groups, roles, privileges and assigned them to each user group.
- Used XML, Java, Transaction control and various transformation.
- Ensure accuracy and integrity of archived data through analysis, coding and validation.
- Created clear documentation of the process to be followed during the retirement of legacy applications.
- Involved in the requirement definition and analysis in support of Data Warehouse efforts.
- Extensively used Informatica Client tools - Source Analyzer, Warehouse Designer, Mapping Designer, Mapplet Designer, Transformation Developer, Informatica Repository Manager and Informatica Workflow Manager.
- Developed data Mappings between source systems and warehouse components using Mapping Designer.
- Worked in extensively testing and performance tuning of the mapping and logic.
- Worked on Performance tuning of Oracle queries usingSQLtrace, SQLplan, various indexes and join types.
- Worked on Power Exchange for change data capture (CDC).
- Develop test, and implement program logic.
- Created, launched & scheduled Workflows/sessions. Involved in the Performance Tuning of Mappings and Sessions.
- Documented to describe program development, logic, coding, testing, changes and corrections.
- Provided support in administration of the Informatica repository Manager and assisted in the design and architecture of multiple repositories to support multiple application development and QA environments.
- Provided Production support.
Environment: Informatica Power Center 9.6, Informatica Analyst Tool, Power Connect, Oracale Data Integrator, Flat file, TOAD, UNIX scripting, Windows XP Professional, Hyperion, Microsoft DTS pakages.
Confidential, Richmond, Virginia
ETL Developer (Informatica Data Quality)
Responsibilities:
- Worked with architect, created logical data object (LDO) and custom data object (CDO).
- Ensure accuracy and integrity of archived data through analysis, coding and validation.
- Created clear documentation of the process to be followed during the retirement of legacy applications and archiving of Health System data.
- Involved in the requirement definition and analysis in support of Data Warehouse efforts.
- Describes the Capabilities of DTS and summarizes the business problem it addresses.
- Developed ETL mappings, transformations using Informatica Power Developer.
- Extensively used Informatica Client tools - Source Analyzer, Warehouse Designer, Mapping Designer, Mapplet Designer, Transformation Developer, Informatica Repository Manager and Informatica Workflow Manager.
- Developed data Mappings between source systems and warehouse components using Mapping Designer.
- Describes specifics data conversion and data transformation issues that can arise when using DTS
- Experienced in data profiling & data quality rules development using Informatica Data Quality tools
- Worked in extensively testing and performance tuning of the mapping and logic.
- Worked on Performance tuning of Oracle queries usingSQLtrace, SQLplan, various indexes and join types.
- Worked on Power Exchange for change data capture (CDC).
- Develop test, and implement program logic.
- Utilize ETL tools such as Informatica product suit.
- Worked on building UNIX Shell Scripts to check and update the Teradata/Oracle tables and appending multiple CSV’S to a single CSV and used them in Data stage jobs.
- Used IDQ transformation like labels, standardizing, proofing, parser, address doctor, Match, Exception transformations for standardizing, profiling and scoring the data.
- Used IDQ analyst tool to correct the bad table records, reprocessed the records in Analyst.
- Created custom reports using various tools including Crystal Reports.
- Created, launched & scheduled Workflows/sessions. Involved in the Performance Tuning of Mappings and Sessions.
- Experienced in several facets of MDM implementations including Data Profiling, metadata acquisition and data migration.
- Documented to describe program development, logic, coding, testing, changes and corrections.
- Implemented extreme programming by using fact paced agile methodology, involving in task completion, user stories, and iterations.
- Provided support in administration of the Informatica repository Manager and assisted in the design and architecture of multiple repositories to support multiple application development and QA environments.
- Provided Production support.
Environment: Informatica Power Developer 9.6, Informatica Analyst Tool, Power Connect, Teradata, Oracale Data Integrator, Flat file, TOAD, UNIX scripting, Windows XP Professional, Hyperion, Microsoft DTS pakages.
Confidential, Dallas, Texas
Sr.ETL Developer (Informatica)
Responsibilities:
- Involved in the requirement definition and analysis in support of Data Warehouse efforts.
- Developed ETL mappings, transformations using Informatica PowerCenter.
- Extensively used Informatica Client tools - Source Analyzer, Warehouse Designer, Mapping Designer, Mapplet Designer, Transformation Developer, Informatica Repository Manager and Informatica Workflow Manager.
- Created ETL processes to extract data from Mainframe DB2 tables for loading into various oracle staging tables.
- Developed data Mappings between source systems and warehouse components using Mapping Designer.
- Created custom reports using various tools including JReport.
- Worked extensively on different types of transformations like source qualifier, expression, Aggregator, Router, filter, update strategy, lookup, sorter, Union, Stored Procedure and Sequence generator.
- Used Informatica to convert Oracle data into HDFS(Hadoop distributed file system)
- Did reporting in Tableau
- Experienced in data profiling & data quality rules development using Informatica Data Quality tools.
- Worked in extensively testing and performance tuning of the mapping and logic.
- Created SSIS Packages using Pivot Transformation, Fuzzy Lookup,Derived Columns, Condition Split, Term extraction, Aggregate, Execute SQL Task, Data Flow Task and Execute Package task etc. To generate underlying data for the reports and to export cleaned data from Excel Spreadsheets, Text file, MS Access and CSV files to data warehouse.
- Designed SSIS package for automatic data migration to transform Data from Oracle to SQL Server 2012
- Tune SSIS packages for reducing the processing time by using parallel processing approach and using SQL Profiler.
- Worked on Performance tuning of Oracle queries usingSQLtrace, SQLplan, Quest SQL optimizer, Oraclepartitioning, various indexes and join types.
- Worked on Power Exchange for change data capture (CDC).
- Worked on building UNIX Shell Scripts to check and update the Teradata/Oracle tables and appending multiple CSV’S to a single CSV and used them in Data stage jobs.
- Used IDQ transformation like labels, standardizing, proofing, parser, address doctor, Match, Exception transformations for standardizing, profiling and scoring the data.
- Used IDQ analyst tool to correct the bad table records, reprocessed the records in Analyst.
- Implemented Type 1 and Type 2 Slowly changing dimensions.
- SAP provides the cost data in the form of flat files. Informatica is used to extract the data from SAP UNIX system and load it into the Oracle staging database.
- Created, launched & scheduled Workflows/sessions. Involved in the Performance Tuning of Mappings and Sessions.
- Experienced in several facets of MDM implementations including Data Profiling, metadata acquisition and data migration.
- Documented to describe program development, logic, coding, testing, changes and corrections.
- Implemented extreme programming by using fact paced agile methodology, involving in task completion, user stories, and iterations.
- Provided support in administration of the Informatica repository Manager and assisted in the design and architecture of multiple repositories to support multiple application development and QA environments.
- Provided Production support.
Environment: Informatica PowerCenter 9.5, IDQ 9.1, IBM Web Sphere Information Server (Data Stage Designer), Power Connect, SQL Server Integration Services (SSIS)Teradata, Oracle 11g Flat file, TOAD, UNIX scripting, Autosys, Windows XP Professional, Hyperion.
Confidential, Lynchburg, VA
ETL Developer
Responsibilities:
- Interacted with business users and team leads for better understanding of business specifications and requirements, identifying data sources and Development strategies.
- Analyzed business requirements, technical specifications, source repositories and physical data models for ETL mappings.
- Worked extensively with mappings using expressions, aggregators, filters, lookup, joiner, update strategy and stored procedure transformations.
- Coordinated and developed documentation related to ETL design and development.
- Used update strategy transformation to effectively migrate data from source to target.
- Used Informatica Data Quality as a tool for data quality measurement.
- Worked on Power Exchange for change data capture (CDC).
- Created stored procedures and invoked from Informatica.
- Used Informatica debugger to debug the mappings.
- Performed partitions on sources to improve the performance.
- Optimized the mappings and implemented the complex business rules by creating reusable transformations and mapplet.
- Used Informatica workflow manager for create, ran batches and sessions and scheduled them to run at specified time.
- Involved in Performance Tuning of mappings, SQL overrides and stored procedures.
- Improved the performance of ETL process by indexing and caching.
- Created workflows, tasks, database connections, FTP connections using workflow manager.
- Created UNIX shell scripting for automation of ETL process.
- Developed simple & complex mappings using Informatica to load dimensions & facts tables as per STAR schema techniques.
- Analyzed Session log files to resolve errors in mapping and managed session configuration.
Environment: Informatica PowerCenter 8.6, IDQ 9.1, Oracle 10g, SQL Server 2005, Oracle Designer, Toad, PL/SQL, Linux, Erwin and Windows 2000 / XP.
Confidential, Vermont, VT
Informatica Developer
Responsibilities:
- Analyzed the business requirements and functional specifications.
- Extracted data from oracle database and spreadsheets and staged into a single place and applied business logic to load them in the central oracle database.
- Used informatica PowerCenter 8.6 for extraction, transformation and load (ETL) of data in the data warehouse.
- Developed complex mapping in Informatica to load the data from various sources.
- Implemented performance tuning logic on target, source, mappings, sessions to provide maximum efficiency and performance.
- Parameterized the mappings and increased the re-usability.
- Used Informatica Workflow manager to create sessions, workflow and batches to run with the logic embedded in the mappings
- Extensively used Toad Utilies for executing SQL scripts and worked on SQL for enhancing the performance of the conversion mapping.
- Used SQL procedures for Informatica mapping for truncating the data in target table at run time.
- Extensively used Informatica debugger to figure out the problem in mapping. Also involved in troubleshooting existing ETL bugs.
- Created a list of the inconsistencies in the data load on the clients side as to review and correct the issue on their side.
- Created the ETL exception reports and validation reports after the data is loaded into the warehouse database.
- Wrote documentation to describe program development, logic, coding, testing, changes and corrections.
- Created Test cases for the mappings developed and then created integration Testing Documents.
- Followed Informatica recommendations, methodologies and best practices.
Environment: s: Informatica PowerCenter 8.X (Repository Manager, Designer, Workflow Monitor), SQL Server 2000.
Confidential, Pittsburgh, PA
ETL Developer
Responsibilities:
- Worked closely with business analysts to understand and document business needs for Decision support data.
- Used several Informatica Transformations i.e Lookup, expression, aggregator, joiner, filter, normalizer
- Used the Update Strategy Transformation to update the Target Dimension tables.
- Developed ETL procedures to transform the data in the intermediate tables according to the business rules and functionality requirements.
- Involved in the development of Informatica mappings and also tuned for better performance.
- Created Mapplets and used them in different Mappings.
- Used designer debugger to test the data flow and fix the mappings. Tuned Informatica, Mappings and sessions for optimum performance.
- Provided detailed technical, process and support documentations like daily process rollback and detailed specifications and very detailed document of all the projects with the workflows and their dependencies.
- Worked with mapping parameters and variables to load data from different sources to corresponding partition of the database table.
- Created Schema objects like Indexes, Views and Sequences.
- Extracted the data from Flat files & Oracle and load them through Informatica.
- Involved in Production Support and issue resolutions.
- Involved in Unit testing of Mappings, Workflows and Debugging mappings for failed sessions.
- Created partitions, SQL over ride in Source Qualifier, session partitions for improving performance.
- Performed unit testing and system testing of the mappings developed and documented with various scenarios.
- Wrote Unix Shell Scripting based on requirements
Environment: Informatica PowerCenter 8.6, Oracle 11i/10g, SQL Server 2005, UNIX, Shell Scripting, Toad, Netezza.
Confidential
SQL Developer
Responsibilities:
- Interacted and coordinated with System architects, Business executives, analysts, Data population engineers and developers.
- Analyzed the Functional requirements and Technical requirements, preparing technical design documents, HLD and LLD for mappings and automating the daily flow. Lead the Team; maintain the capacity of Team, working in offshore model.
- Involved in Business Requirements gathering and Analysis.
- Developed SSIS packages using looping, data formatting, check points, error handing, email notification etc.
- Used bcp utility inside SSIS packages to import and export bulk data across servers.
- Developed SQL Quries to fetch complex data from different tables in remote databases using joins, database link and formatted the results into reports and kept logs.
- Created SSRS report according to user requirements and technical standards.
- Analyzed the source data coming from Oracle and working with business users and developers to develop the Model.
- Participated in all phases including Requirement Analysis, Design, Coding, Testing and Documentation.
- Extensively used SQL to validate the data loaded.
- Designed complex SQL queries to view the data from front-end.
- Created Reports as per the User requirements using extensive functionalities in Business Objects, which allows the users to analyze the data.
Environment: MSSQLServer 2005, SQL Server Integration Services (SSIS), SQL Serer Reporting Services (SSRS), Windows NT/XP, Crystal Reports, Query Analyzer, Enterprise Manager.
Confidential
SQL Server Database Developer
Responsibilities:
- Involved in gathering and analysis of user requirements.
- Created functional and technical specifications for projects.
- Extracting data from different source like SQL Server, Flat Files, Taradata, and Composite View and transformed, Loaded onto required database through SSIS.
- Created and optimize complex T-SQL queries and stored procedures to encapsulate reporting logic.
- Involved in performance tuning and monitoring of T-SQL blocks.
- Created and managing Event Handlers, Package Configurations, Logging, System and User defined Variables for SSIS Packes.
- Used DDL and DML for writing triggers, stored procedures, and data manipulation.
- Responsible and for logical and physical design of database.
- Used Crystal Reports to design and develop reports.
- Created database maintenance plans for the performance ofSQLServer including database integrity checks, update database statistics, re-indexing and data backups.
- Migrated bulk data using BCP and DTS from flat files.
- Created documentation as required.
- Involved in Performance tuning and testing on stored procedures, indexes, and triggers.
- Performed daily backup of entire database and recovery.
- Created functional and technical specifications for projects.
Environment: MSSQLServer 2005, SQL Server Integration Services (SSIS) Windows NT/XP, Crystal Reports, Query Analyzer, Enterprise Manager.