Etl Developer Lead Resume
MA
SUMMARY
- Having 11 years of experience in ETL Development/ Data Modeling / Informatica Data quality,/ Master data Management, Data Governance in all phases of Software Development Life Cycle / Agile methodology includes Horizon phase, Concept assessment, requirement, analysis, architectural design and development and QA cycle, and Production Implementation and Production Support/maintenance of the applications
- Strong working experience in Informatica PowerCenter 9.6/9.1/8.6X, IDQ, Informatica Metadata Manager 9.6, Informatica Developer, Informatica Analyst, Power Exchange CDC, Data Transformation Developer, MDM Hierarchy Manager, Web Services, SAP BW services to Extract, Transform and Load the data.
- Extensive experience with Java server side and enterprise applications using Web Services, XML, XSD, SOAP, and REST.
- Data Modeling: Data modeling knowledge in Dimensional Data modeling, Star Schema, SnowFlake Schema, FACT and Dimensions tables, Physical and logical data modeling and De - normalization techniques.
- Database: Using Oracle 11g/10g, Teradata TD13/TD12, SQL, PL/SQL, SQL*Plus, SQL Server 2008/2005. Proficient in working with PL/SQL to write stored procedures and triggers. Expertise in WinSQL, TOAD (Tool for Oracle Application Developers).
- Proficient in Analyzing Business processes requirements and translating them into technical requirements.
- Configuring and maintaining various components of the MDM Hub including the schema, staging and landing tables, configuring base objects, Look ups, Hierarchies, display queries, put queries and query groups.
- Defined the Trust and Validation rules and setting up the match/merge rule sets to get the right master records
- Expertise in Informatica MDM Hub Match and Merge Rules, Batch Jobs and Batch Groups.
- Experience inPower Exchangeto connect and import sources from external systems like SAP R/3, and AS/400.
- Expertise in Data Warehouse/Data mart, ODS, OLTP and OLAP implementations teamed with project scope, data modeling, ETL development, System testing, Implementation and production support.
- Experience in Dimensional Modeling using Star and SnowFlake Schema, Identifying Facts and Dimensions, Physical and logical data modeling using ERwin.
- Expertise in working with relational databases such as Oracle 11g, SQL Server 2008/2005 and Teradata.
- Extensively involved in developing Stored Procedures, Functions, Views and Triggers, Complex SQL queries using SQL Server, Oracle SQL and Oracle PL/SQL.
- Experience in using Automation Scheduling tools like Autosys
- Strong hands on experience usingTeradata utilities (B-TEQ, Fast Load, MultiLoad, FastExport, and Tpump).
- Involved in providing Extensive production support to various Applications along with server Maintenance projects 24x7.
TECHNICAL SKILLS
Operating Systems: Windows 2008/2007/2005/ NT/XP, UNIX, MS-DOS
ETL Tools: Informatica MDM/Powercenter/Data Quality 9.5.1/9.1/8.6.1 (Designer, Workflow Manager, Workflow Monitor, Repository manager and Informatica Server),Power Exchange,Data Transformation Studio/Informatica Developer.
Databases: Oracle 11g,SQL Server 2008/2005, Teradata R12,Sybase 12.0.1
Data Modeling tools: Logical/Physical Data Modeling, IBM Rational Rose, ERWIN 7.3.10, Microsoft Visio 2004, 2007,2010., TOAD.
Languages: SQL, JDBC, PL/SQL, UNIX, Linux, Shell scripts, SOAP UI, Web Services, Java Script, HTML,XML/XSD, Eclipse
Scheduling Tools: Autosys, Control-M.
Testing Tools: Quality Center, Test Director, Clear test, Clear case.
PROFESSIONAL EXPERIENCE
Confidential
ETL Developer Lead
Responsibilities:
- Interacted with the Business Users & Enterprise Data Architects in the analysis & design of conceptual and logical data model that is required for solid MDM implementation & ensuring that it meets the business requirements and also supports the products capabilities.
- Understanding business needs and implement the same into a functional database design.
- Participated in requirements gathering.
- Worked with business analysts for gathering requirements from high-end users and Performed Analysis on Business Data.
- Responsible for development, support and maintenance of theETL(Extract, Transform and Load) processes usingInformatica Power Center.
- Extensively used Informatica client tools Source Analyzer, Warehouse designer, Mapping designer, Mapplet Designer, Transformations.
- Designed and developed complex Aggregate, expression, filter, join, Router, Lookup and Update transformation rules.
- Createdreusable transformationsandmappletsand used them in complex mappings.
- UsedWorkflow Managerfor creating, validating, testing and running the sequential and concurrentBatchesandSessions, scheduled them to run at a specified time.
- Used mappingparametersandvariables.
- Analyzed Session log files to resolve errors in mapping and managed session configuration.
- Involved in migrating theETL applicationfrom development environment to testing environment and extensively used SQL and PL/SQL to write Stored Procedures, Functions, Packages and triggers.
- Performed extraction, transformation and loading of data from RDBMS tables, Flat Files into Teradata in accordance with requirements and specifications.
- Developed and tested all the backend programs, Error Handling Strategies and update processes.
- Writing Stored Programs (Procedures & Functions) to do Data Transformations and integrate them with Informatica programs and existing applications.
- Created, scheduled, and monitored workflow sessions on the basis of run on demand, run on time, using Informatica Power Center workflow manager.
- Used Informatica Version Control for checking in all versions of the objects used in creating the mappings, workflows to keep track of the changes in the development, test and production environment.
- Used Erwin data modeling tool to do conceptual/logical/physical data models.
- Developed UNIX shell scripts to scheduling Scripts by using scheduling tools.
- Designed Excel Sheets for each mapping of their Test Scenarios.
- Worked on Critical Data Elements and Involved in the Data Governance Framework which Includes Data quality and Master data.
- Creating Landing, Staging and Base Tables and defining Foreign Key relationships, Lookups in the Hub
- Developing the Mappings to move the data loaded from Landing to Stage by using various cleanse and addressdoctor functions.
- Developed the Match paths, Match Columns and Match rules (Exact and Fuzzy) in the Match and Merge Process
Environment: Informatica Powercenter/MDM 9.5.1, Autosys 4.5, UNIX Sql server 2008, Oracle 11g and Unix Shell scripting.
Confidential
ETL Developer
Responsibilities:
- Involved in landing the data from Seven Different source systems by running external batch process to load business data for creating customer master data. External batch process used was ETL process.
- Defined the Landing tables, Base objects, staging tables, foreign key relationships, lookup definitions, queries, packages and query groups.
- Analyzed the source systems for erroneous, duplicative, and integrity issues related to the data which is resided in various source systems such as ERP, LEGACY, CRM, DNB, SALES system, and defined those all source systems in systems and trust model workbench.
- Developed and managed relationships between data domains for the data models.
- Created mappings to perform the tasks such as cleansing the data and populate that into staging tables.
- Analyzed the business data and defined the Match and Merge rules and Trust Scores for MDM Hub.
- Involved in loading data from different sources to staging area by cleansing data
- Involved with ETL developers, for developing complex mappings, mapplets, reusable transformations using Informatica designer to integrate data from different sources like Oracle, Flat files, and SQL databases by following guidelines and loaded data successfully into target.
- Created complex mappings, Mapplets using the advanced transformations like Router, Update, Expression, normalization, and SAP IDOC etc.
- Used Informatica components extensively Repository, Designer, Workflow Manager & Workflow Monitor .
- For loading business logic successfully to database used different transformations like Router, Expression, Source Qualifier, Aggregator, Filter and Sequence Generator transformations extensively.
- Created workflows and used various tasks like Email, Event-wait and raise, decision in workflow manager.
- Involved in interaction with DBA team for creation of primary and secondary indexes on data warehouse tables.
- Used debugger to test the mappings and fixed bugs accordingly.
- Created Session and Batches using server manager to execute mappings.
- Helped the testing team for data integrity and consistency.
Environment: MDM 9.1, Informatica Power Center 8.6, Weblogic, Oracle 10g, SQL Developer, AddressDoctor, Toad, SQL*Loader, Windows server 2003, Erwin
Confidential, MA
Responsibilities:
- Involved in the ETL architectural design and the preparation of the technical specs based on the business requirements and high interaction with the business users.
- Proper guidance has given to the team to follow Agile software development methodology to develop standard coding and delivered the work on time in a systematic manner.
- Created complex mappings, mapplets using the advanced transformations like Filter, Router, connected/unconnected Lookups, Aggregator, Joiner, Sequence generator, Update, and Expression.
- Experience with Data Profiling large data sets and rapidly creating deliverables and recommendations based on those profiles
- Stored procedures and functions are created and modified in Oracle to call it from Informatica.
- Used Informatica Data Quality (IDQ) for Analysis, data cleansing, creating Rules and Data Standardization.
- Integrated Informatica Data Quality with Informatica PowerCenter and Created various data quality mappings in Informatica Data Quality tool and imported them into Informatica powercenter as Mapplets.
- Worked with Informatica Data Quality toolkit, Analysis, data cleansing, data matching, data conversion, exception handling, and reporting and monitoring capabilities of IDQ.
- Configured Analyst tool and helped data stewards or business owners in profiling the source data, create scorecards, applying inbuilt DQ rules and validating the results.
- Designed, developed, implemented and maintained Informatica data quality for matching and merging process.
- Utilized of Informatica data quality to complete initial data profiling and matching/ removing duplicate data.
- Experienced with DVO, Informatica Data Quality (IDQ) tools for Data Analysis Data Profiling and Data Governance.
- Created the deployment groups and migrated in the migration of the coding into different repositories.
- Run the sessions with error handling strategies and also used the collect performance data, verbose to identify the errors in the mappings.
- Used Informatica command, email, and Event Wait and Event Raise tasks to schedule the Informatica Workflows and send emails to the support groups on successful /failure completion of the workflows.
Environment: Informatica powercenter 9.1.1, Oracle 11g, DB2, SQL Server 2005, SQL Loader, Informatica IDQ, HTML 4.0, CSV files,PL/SQL, MS SQL Server, Toad 9.1.2, Erwin 4.0/3.5.2, windows NT, MS Office, XML Sources, Unix Shell Scripting.
Datawarehouse Developer
Confidential
Responsibilities:
- Gathered requirements from Business users and created a Low level technical design documents using high level design document.
- Participated in the design meetings, and prepared technical and mapping documentation.
- Designed ETL specification documents for all the projects.
- Created Tables, Keys (Unique and Primary) and Indexes in the SQL server.
- Extracted data from Flat files, DB2, SQL and Oracle to build an Operation Data Source. Applied business logic to load the data into Global Data Warehouse.
- Extensively worked on Facts and Slowly Changing Dimension (SCD) tables.
- Maintained source and target mappings, transformation logic and processes to reflect the changing business environment over time.
- Used various transformations like Filter, Router, Expression, Lookup (connected and unconnected), Aggregator, Sequence Generator, Update Strategy, Joiner, Normalizer, Sorter and Union to develop robust mappings in the Informatica Designer.
- Extensively used the Add Currently Processed Flat File Name port to load the flat file name and to load contract number coming from flat file name into Target.
- Worked on complex Source Qualifier queries, Pre and Post SQL queries in the Target.
- Worked on different tasks in Workflow Manager like Sessions, Events raise, Event wait, Decision, E-mail, Command, Worklets, Assignment, Timer and Scheduling of the workflow.
- Extensively used workflow variables, mapping parameters and mapping variables.
- Created sessions, batches for incremental load into staging tables and scheduled them to run daily.
- Used shortcuts to reuse objects without creating multiple objects in the repository and inherit changes made to the source automatically.
- Implemented Informatica recommendations, methodologies and best practices.
- Implemented performance tuning logic on Targets, Sources, Mappings and Sessions to provide maximum efficiency and performance.
- Involved in Unit, Integration, System, and Performance testing levels.
- Written documentation to describe program development, logic, coding, testing, changes and corrections.
Environment: Informatica Power Center 8.6.1, Oracle 10g, SQL Server 2008, Sybase 12.0.1, Windows XP, Toad, Cognos 8.4.1., SQL developer.
Confidential
ETL Developer
Responsibilities:
- Involved in business analysis and technical design sessions with business and technical staff to develop requirements document, and ETL specifications.
- Involved in all phases of SDLC from requirement gathering, design, development, testing and roll out to the field user and support for production environment.
- Extensively worked with Informatica PowerCenter client tools like Source Analyzer, Warehouse Designer and Mapping Designer to develop mappings for implementing the transformation logic to implement the business rules and requirements.
- Worked with the DBA to build the fact and dimension tables.
- Extensively developed source to target mappings and scheduling Informatica sessions.
- Worked on various transformations like Lookup, Aggregator, Expression, Router, Filter, Update Strategy, and Stored Procedure.
- Designed and Developed the workflows, validated the dependencies in between the workflows which involved various tasks like even-wait, command, session tasks.
- Monitored production jobs on a daily basis and worked on issues relating to the jobs failure and re started failed jobs after correcting the errors.
- Used pmcmd command to run Informatica Workflows in Scripts.
- Used Incremental Loading and Slowly Changing Dimension type 2 to maintain history data.
Environment: Informatica PowerCenter 8.6.1,sql server 2000, UNIX, Windows Server 2005