Sr. Etl / Talend Developer Resume
Greenwich, CT
SUMMARY
- 8 years of work experience in Information Technology as Informatica Developer with strong background in ETL Data warehousing experienced using InformaticaPowerCenter9.5/9.1/ 8.x/ 7.x.
- A good experience with SQL Server Integration Services (SSIS)
- Experienced using MapReduce, and "BIgdata" work on Hadoop and other NO SQL platforms worked extensively on the Master Data Management (MDM) and application used for MDM
- Excellent Experience with BIgdatatechnologies (e.g., Hadoop, BIgQuery, Cassandra
- Experienced inInformatica ILM and Informatica Lifecycle Management andits tools proficiency in requirement gathering and data modeling including design and support of various applications in OLTP, Data Warehousing, OLAP and ETL Environment
- Extensive experience in developing complex mappings from varied transformations like Router, Filter, Sorter, Connected and Unconnected lookups, Normalizer, Expression, Aggregator, Joiner, Union, Update Strategy, Stored Procedure and Sequence Generator etc.
- Expertise in design and implementation of Slowly Changing Dimensions (SCD) type1, type2, type3.
- ExcellentDataWarehousing concept Metadatamanagement (MDM)
- Experience in monitoring and training junior developers team
- Experienced in loading data, troubleshooting, Debugging mappings, performance tuning of Informatica (Sources, Targets, Mappings and Sessions) and fine - tuned transformations to make them more efficient in terms of session performance.
- Expert in writing SQL queries and optimizing the queries in Oracle, SQL Server 2008,Netezza&Teradata.
- Database experience using Oracle 11g/10g/9i, MS SQL Server 2000 and MS Access.
- Experienced in loading and maintaining Data Warehouses in Teradata. Extensively used tools are MLoad, BTeq, FastExport and FastLoad to design and develop dataflow paths for loading transforming and maintaining data warehouse.
- DataModelerwith strong Conceptual, Logical and PhysicalDataModeling skills,DataProfiling skills, MaintainingDataQuality, experience with JADsessions for requirements gathering, creating datamapping documents, writing functional specifications, queries.
- Expertise in working with various operational sources like Oracle, Teradata, DB2, SQL Server 2005/2008, Flat files, Netezza into a staging area
- Experience with Mainframe systems (COBOL, JCL, CICS, VSAM, DB2, IMS, IDMS) and also conversion of Mainframedatato ETL Staging tables.
- Expertise in Gathering and Analyzing Information Requirements,DataAnalysis,DataArchitecture, Business (E-R) modeling, Dimensional Modeling, ETL Design.
- Experience in InformaticaPowerCenter 8.x/ 7.1.4/6.2/5.1 with Oracle 9i/10g, 3 years of experience in SSIS and SQLServerDataWarehouse in Microsoft DW/BI environments.
- Strong experience using SQL, PL/SQL Procedures/Functions, Triggers and Packages.
- Experience inUNIXOperating System andShell scripting.
- Working knowledge of datawarehouse techniques and practices, experience including ETL processes, dimensional data modeling (Star Schema, Snow Flake Schema, FACT& Dimension Tables), OLTP and OLAP.
- Experienced in all data processing phases, from the Enterprise Model, Data Warehousing (ETL)
- Excellent skills in fine tuning the ETL mappings in Informatica.
- Extensive experience using database tool such as SQL *Plus, SQL * Loader
- Excellent communication, presentation, project management skills, a very good team player and self-starter with ability to work independently and as part of a team.
TECHNICAL SKILLS
ETL Tools: Informatica 9.5/9.1//8.x/7.x (PowerCenter/PowerMart) (Designer, Workflow Manager, Workflow Monitor, Server Manager, Power Connect)
Data Modeling: Physical Modeling, Logical Modeling, Relational Modeling, Dimensional Modeling (Star Schema, Snow-Flake, Fact, Dimensions), Entities, Attributes, Cardinality, ER Diagrams.
Databases: Oracle 11g10g/9i, MS SQL Server 2008/2005, MS Access and DB2, Teradata, Netezza.
Languages: SQL, PL/SQL, C, Data Structures, Facets, Unix Shell Script
Packages: Microsoft Office 2010, Microsoft Project 2010, SAP and Microsoft Visio, Share point Portal Server 2003/2007.
Web Technologies: HTML, XML, Java Script.
Tools: SQL plus, PL/SQL Developer, Toad, SQL* Loader, Active Batch
Operating systems: Windows NT/2000/2003/XP/VISTA/7,UNIX,MSDOS and LINUX.
PROFESSIONAL EXPERIENCE
Confidential, Greenwich, CT
Sr. ETL / Talend Developer
Responsibilities:
- Created ETL Mapping with Talend Integration Suite to pull data from Source, apply transformations, and load data into target database.
- Extracted data from flat files/excel files, applied business logic to load them in the staging database.
- Managed the growth of data with ILM Informatica.
- Worked on Optimizing test data management through ILM
- Optimized Data Management at Every Step with ILM
- Designed and developed data movements using SQL Server IntegrationServices, TSQL and Stored Procedures
- Performed code reviews, analyze execution plans, and re-factor inefficient code.
- Supported IT staff and business users in the development, usage and troubleshooting of database-driven applications.
- Conducted system tests, corrected database defects.
- DevelopedDataMapping,DataGovernance, and transformation and cleansing rules for the MasterData Management Architecture involving OLTP, ODS.
- Design/developed and managedPower Center upgrades from v7.x to v8.6, Migrate ETL code from Informatica v7.x to v8.6. Integrate and managed workload of Power Exchange CDC.
- Design solution using SAP MDM.
- Worked on Managing reference data, metadata and business data
- Installing apache hadoop and implementing sub hadoop projects.
- Hadoop cluster configuration & deployment to integrate with systems hardware in the data center.
- Implemented Proof of Concepts on Hadoop stack and differentbigdata analytic tools, migration from different databases like mysql, oracle to hadoop.
- Enforced referential integrity in the OLTPdatamodel for consistent relationship between tables and efficient database design
- Designed different type of STAR schemas for detailed data marts and plan data marts in the OLAP environment.
- Worked with OLTP and OLAP database to generate the ddl
- Handled and monitored a team of 5-7 junior developers for planning releases, project plans, pipeline of work, resource utilization
- Developed mappings /Transformation/Joblets and designed ETL Jobs/Packages using Talend Integration Suite (TIS) in Talend 5.6.1.
- Implemented population of slowly changing dimensions to maintain current information and history information in warehouse tables with change data capture (CDC).
- Worked on heterogeneous data sources such as Oracle, excel files, Flat files etc.
- Created complex jobs in Talend using tMap, tJoin, tReplicate, tParallelize, tJava, tJavaFlex, tAggregateRow, tDie, tWarn, tLogCatcher, etc.
- Created Talend jobs to populate the data into dimensions and fact tables.
- Created Talend ETL job to receive attachment files from pop e-mail using tPop, tFileList, tFileInputMail and then loaded data from attachments into database and archieved the files.
- Designed and Implemented ETL for data load from heterogeneous Sources to SQL Server and Oracle as target databases and for Fact and Slowly Changing Dimensions SCD-Type1 and SCD-Type2.
- Conducted test run, debug & fix, and upload to SVN based Versioning system for deployment.
- Used Talendjoblet and various commonly used Talend transformations components like tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tSetGlobalVar, tHashInput&tHashOutput and many more.
- Used common Data Warehousing practices for Data Modeling using Star schema and Snowflake schema with Facts, Measures and Slowly Changing Dimensions (SCD) Type1, Type2, and Type3.
- Used Talend components tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator.
- Performed requirement gathering, Data Analysis using Data Profiling scripts, Data Quality (DQ) scripts, and unit testing of ETL jobs.
- Installation of Talend Open Studio (TOS) and Configuration along with Java JRE & JDK.
- Worked on creating various Oracle PL SQL stored procedures to handle complex logics.
Environment: ER/Studio 8, MS SQL Server 2008, Power Exchange (CDC) Talend Integration Suite 5.6.1, SVN Oracle 12c
Confidential, Dayton, OH
Sr. ETL/Informatica Developer
Responsibilities:
- Gathered user Requirements and designed Source to Target data load specifications based on Bussiness rules.
- Worked on Optimizing test data management with Informatica ILM
- Worked on Architect, designed and Implemented data archival and masking engagements with Legacy data decommissioning, on-going data archival, data masking using Informatica ILM
- Worked on supporting pre-sales activities on data archival opportunities as technical solution definition for proposals, estimation and deliverin Informatica ILMWorked on Optimizing test data management through ILM
- Worked on both SAP MDM and Informatica
- Tested the database to check field size validation, check constraints, stored procedures and cross verifying the field size defined within the application with metadata.
- UsedInformatica Power Exchangefor loading/retrieving data frommainframe systems.
- Used InformaticaPowerCenter9.5 for extraction, loading and transformation (ETL) of data in the datamart.
- Designed and developed ETL Mappingsto extract data from flat files, MS Excel and Oracle to load the data into the target database.
- Developing several complex mappings in Informatica a variety of PowerCenter transformations, Mapping Parameters, Mapping Variables, Mapplets& Parameter files in Mapping Designer using InformaticaPowerCenter.
- Extensively used ETL processes to load data from various source systems such as DB2, SQLServer and Flat Files, XML files into target system applying business logic on transformation mapping for inserting and updating records when loaded.
- Worked with Teradata data lake
- Responsible for design and developing TeradataBTEQ scripts, MLOAD based on the given business rules and design documents.
- Experience in CodingTeradataSQL,TeradataStoredProcedures, Macros and Triggers
- Handled data loading operations from flat files to tables using NZLOAD utility.
- Extensively used NZSQL and NZLOAD utilities. eveloped UNIX Shell scripts in conjunction with NZSQL/NZLOAD utilities to load data from flat files to Netezza database.
- Loading the data into Netezza from legacy systems and flat files using complex UNIX scripts.
- Implemented Slow changing dimensions SCD-1 and SCD-II mappings to upgrade Slowly Changing Dimension Tables.
- Experience in migration Informatica objects from 9.1 to 9.5.
- Experience in Informatica upgrade testing, troubleshoot and resolve issues.
- Created complex mappings in the designer and monitored them. The mappings involved extensive use of Aggregator, Filter, Router, Expression, Joiner, Union, Normalizer and Sequence generator transformations.
- Ran the workflows on a daily and weekly basis using Active Batch Scheduling tool.
- Examined the workflow log files and assigning the ticket to the Informatica support based on the error.
- Experience in developing UnixShellScripts for automation of ETL process.
- Performed operational support and maintenance of ETL bug fixes and defects.
- Maintained the target database in the production and testing environments.
- Supported migration of ETL code from development to QA and QA to production environments.
- Migration of code between the Environments and maintaining the code backups.
- Designed and developed Unix Shell Scripts, FTP, sending files to source directory & managing session files
- Done extensive testing and wrote queries in SQL to ensure the loading of the data.
- Developed PL/SQL code at the database level for the new objects.
Environment: InformaticaPowerCenter 9.5, Power ExchangeOracle10g/9i,PL/SQL, Flat files, Facets, XML, MS Access, SQLServer2008, VSS, Active Batch
Confidential, Kansas City MO
Sr.ETL/Informatica Developer
Responsibilities:
- Gathered user Requirements and designed Source to Target data load specifications based on Business rules.
- Involved with Data Analysis primarily with Meta Data, Data Definitions and Data Formats
- Worked Build MDM repository
- Designed and Implemented the ETL Process using Informatica power center.
- Involved in Data Extraction from Oracle, Flat files using Informatica.
- Experience in analysis members and providers data.
- Used Source Analyzer and Warehouse designer to import the source and target databaseschemas.
- Create ETL Mapping with Talend Integration Suite to pull data from Source, apply transformations, and load data into target database.
- Developed and designed ETL Jobs using Talend Integration Suite (TIS) in Talend 5.2.2.
- Created complex jobs in Talend 5.2.2 using tMap, tJoin, tReplicate, tParallelize, tJava, tJavaFlex, tAggregateRow, tDie, tWarn, tLogCatcher, etc.
- Used tStatsCatcher, tDie, tLogRow to create a generic joblet to store processing stats.
- Created Talend jobs to populate the data into dimensions and fact tables.
- Created Talend ETL job to receive attachment files from pop e-mail using tPop, tFileList, tFileInputMail and then loaded data from attachments into database and archieved the files.
- Used Talendjoblet and various commonly used Talend transformations components like tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tSetGlobalVar, tHashInput&tHashOutput and many more.
- Created mappings from source systems to target systems. Implemented Join, Expression, Aggregate, Sort, Rank, Lookup, UpdateStrategy, Filter and Router Transformations in Mappings.
- Worked on Designer tool - Source Analyzer, warehouse designer, Mapping Designer &Mapplet Designer and Transformation Developer.
- Involved in complete software development life cycle (SDLC) of the project.
- Mapplets and Reusable Transformations were used to prevent redundancy of transformation usage and maintainability.
- Creating Reusable Transformations and Mapplets in a mapping.
- Involved in Creating tasks, worklets, workflows and Schedule, Run, Monitor sessions by using workflow manager and workflow monitor.
- Worked on moving mappings from Development to Test and from Test to Production environments.
- Migrated Mappings, Sessions, and Workflows from Development to Test and then to Production environment.
- Identified and fixed the Bottle Necks and tuned the Mappings and Sessions for improving performance. Tuned both ETLprocess as well as Databases.
- Created and monitored sessions and batches to run the mappings.
Environment: InformaticaPowerCenter 9.1, Talend, 5.2, SQL Server 2008, Facets, Windows XP, Oracle 11g, VSS
Confidential, Milpitas, CA
ETL Informatica Developer
Responsibilities:
- Interacted with Business Analysts to understand the requirements and the impact of the ETL on the business.
- Worked with data modellers in preparing logical and physical data models and adding/deleting necessary fields using Erwin.
- Extracted data from flat files and oracle database, applied business logic to load them in the central oracle database.
- Developed mappings/Reusable Objects/Transformation/mapplets by using mapping designer, transformation developer and mapplet designer in Informatica Power Center.
- Extracted Mainframe files using Informatica Power Exchange and transformed them to be loaded in Operation Data Store(ODS) tables.
- Created reusable transformations and mapplets and used them in mappings.
- Implemented slowly changing dimensions to maintain current information and history information in dimension tables.
- Involved in creation of Folders, Users, Repositories, Deployment Group using Repository Manager.
- Worked on different data sources such as Oracle, SQL Server, Flat files etc.
- Developed PL/SQL and UNIX Shell Scripts for scheduling the sessions in Informatica.
- Created E-mail notifications tasks using post-session scripts.
- Wrote SQL, PL/SQL, stored procedures &triggers, cursors for implementing business rules and transformations.
- Used Change Data Capture to implementincremental load.
- Created various reports in report studio and packages in framework manager.
- Generated various reports like List, Crosstab, Chart, Master detail, Drill through reports in report studio.
- Provided support to develop the entire warehouse architecture and plan the ETL process.
Environment: Informatica Power Center 9.1/ 8.6.1, Power Exchange (CDC) Oracle 11g/10g, SQLServer2008, PL/SQL, XML, MS Access, SQL Aginity, UNIX, UDB DB2 8.1, Autosys
Confidential, Pleasanton CA
ETL Developer
Responsibilities:
- Designed and Implemented the ETL Process using Informatica power center.
- ETL flows are developed from Source to Stage, Stage to Work tables and Stage to Target Tables.
- Worked in developing Mapplets and Re-usable Transformations for reusability and reducing effort.
- Created Talend jobs to populate the data into dimensions and fact tables.
- Created Talend ETL job to do various validations on header and trailer of a given file and used tjavarow component to build custom code pop e-mail using tPop, tFileList, tFileInputMail and then loaded data from attachments into database and archieved the files.
- Used Talendjoblet and various commonly used Talend transformations components like tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator, tSetGlobalVar, tHashInput&tHashOutputetc
- Created WorkFlows with Command Tasks, Worklets, Decision, Event Wait and Monitored sessions by using workflow monitor.
- Migrated Informatica Folders from Development Environment to Test and System Test Environment and Worked with Admins to migrate the same to Production environments.
- Wrote PL/SQL procedures for reconciliation of financial data between source and target to automate testing phases and help business for preliminary validation.
- Wrote UNIX scripts, environment files for Informatica.
- Developed Metadata driven code for effective utilization and maintenance using technical metadata, business metadata and process metadata.
- To externalize the business logic instead hardcoding in the mapping I have used Parameter file in Informatica.
- Generated Business objects reports to test standardized reports as per business requirements.
- Tuned Mappings and Mapplets for best Performance on ETL Side and Created Indexes and Analyzed tables periodically on Database side.
- Organized the data flow and developed many Control M jobs for Scheduling Jobs and moved to production.
- Primary resource in Production support team so, involved in emergencycalls when application outage occurred and resolved defects when raised.
Environment: InformaticaPowerCenter 8.6.0, SQL Server 2005, Oracle 10g, MS Excel, MS Access, Flat Files, Cognos 8.0, SQL Dev, Toad, Unix, Windows XP, Erwin, Control M.
Confidential, Richmond, VA
Informatica Developer
Responsibilities:
- Designed and Implemented the ETL Process using Informatica power center.
- Involved in Data Extraction from Oracle, Flat files using Informatica.
- Worked on Designer tool - Source Analyzer, warehouse designer, Mapping Designer &Mapplet Designer and Transformation Developer.
- Involved in complete software development life cycle (SDLC) of the project.
- Mapplets and Reusable Transformations were used to prevent redundancy of transformation usage and maintainability.
- Creating Reusable Transformations and Mapplets in a mapping.
- Involved in Creating tasks, worklets, workflows and Schedule, Run, Monitor sessions by using workflow manager and workflow monitor.
- Worked on moving mappings from Development to Test and from Test to Production environments.
- Migrated Mappings, Sessions, and Workflows from Development to Test and then to Production environment.
- Identified and fixed the Bottle Necks and tuned the Mappings and Sessions for improving performance. Tuned both ETL process as well as Databases.
- Created and monitored sessions and batches to run the mappings.
Environment: InformaticaPowerCenter 8.1, SQL Server 2005, Unix/AIX 5.3.8.0, Oracle 10g, Erwin.
Confidential
Software Engineer
Responsibilities:
- Developed various mappings using MappingDesigner and worked with Aggregator, Lookup, Filter, Router, Joiner, Source Qualifier, Expression, Stored Procedure and Sequence Generator transformations.
- Implemented Slowly Changing Dimensions of type 1 & type 2 to store history according to business requirements.
- Used Parameter files to pass mapping and session parameters to the session.
- Tuned the Informatica mappings to reduce the session run time.
- Developed PL/SQL procedures to update the database and to perform calculations.
- Worked with SQL*Loader to load data into the warehouse.
- Contributed to the design and development of Informatica framework model.
- Wrote UNIX shell scripts to work with flat files, to define parameter files and to create pre and post session commands.
- Performed Unittesting and System testing of Informatica mappings.
- Involved in migrating the mappings and workflows from Development to Testing and then to Production environments.
Environment: Oracle8i, SQL, PL/SQL, SQL*PLUS, HP-UX 10.20, InformaticaPowerCenter 7, DB2 Cognos Report net 1.1, Windows2000,