Etl Onsite Lead Designer Resume
San Jose, CA
SUMMARY
- About 8 years of experience in IT Software Development Life cycle involving business requirement analysis, application design, data modeling, development, testing and implementation of Data Warehousing and Database Business Systems mainly in ‘Health Care’, ‘Consumer goods’ and ‘Banking’ domains.
- Good experience in Informatica Power Center and databases such as Teradata, Oracle, MySQL and Ingres.
- Worked on Erwin data modeling tool; expert in Unix Shell scripting; experience in using ControlM, Work Load Manager to schedule jobs; experience in using Rally tool for Agile software development.
- Developed various complex Informatica mappings such as loading data from web service applications, implemented Slowly Changing Dimension (SCD) and Change Data Capture (CDC) mechanism.
- Excellent in communication, documentation, interpersonal and analytical skills, quick learner, adaptable to new and challenging technological environments, and acted as liaison between client and development team for project delivery.
TECHNICAL SKILLS
ETL Tools: Informatica Power Center 9.x/8.x/7.x, Talend 5.1, Jasper ETL
Databases: Teradata v2R5/12/13, Oracle 10g/9i/8i, DB2, MySQL 5.5.1, Ingres
RDBMS Tools: Teradata SQL Assistant, Toad, SQL Developer
Data Modeling: Erwin
Programming Languages: SQL, PL/SQL, BTEQ, MLOAD, TPT, UNIX Shell Scripting, Perl
Operating Systems: Windows 9X, DOS, UNIX.
Scheduling Tools: ControlM, Work Load Manager (WLM), Autosys
Version Control Tools: Star Team, Microsoft Visual Source Safe
Agile software: Rally
PROFESSIONAL EXPERIENCE
Confidential, Chicago, IL
ETL Tech Lead
Responsibilities:
- Provide estimation, track overall development schedule including outstanding tasks and dependencies across modules and projects.
- Built BTEQ and MLoad scripts to apply business rules and to load data from staging layer to data mart.
- Implemented table driven data load mechanism which supports various features such as parallel data loading, restartability, monitoring load status, error handling etc.
- Developed TPT scripts to transfer data across multiple environments in Teradata.
- Extensively used TPT operators such as Dataconnector, Export, Load, Update, DDL and OS Command.
- Developed Teradata stored procedure to load incremental data.
- Created a reusable Perl script which invokes Informatica workflows and also triggers BTEQ scripts used to load data into EDW, after ensuring that Informatica Job has ran successfully.
- Developed Informatica mappings to pull data from Web services Application into Teradata tables.
- Extensively used Star team for version control.
- Built ControlM jobs, Set dependencies, and scheduled to run on specific day/time as per Business needs.
- Used HP Service Manager to raise requests for triggering/holding ETL jobs.
- Co - ordinate team activities through the entire development life cycle until warranty support period.
- Maintain issue tracker and other analysis based documents to track the work on a daily basis.
- Review test plans and test cases for System testing and UAT.
- Involved in debugging and providing technical Solutions in case of load failure.
- Created exception process to move the erroneous records to error table.
- UAT coordination with business users.
- Creating Migration document and checklists for migrating ETL components to QA and PROD environment
Environment: Informatica Power Center 9.1, Teradata 13.1, Unix Shell Scripting.
Confidential, San Jose, CA
ETL Onsite Lead Designer
Responsibilities:
- Implemented table driven data load mechanism using UNIX Platform to migrate sales data from Oracle to MySQL.
- Used the inbuilt MySQL export/import utilities extensively in data loading process.
- Automated the entire load process which includes data validation, data recovery and error handling.
- Used an open source ETL tool, ‘Talend’ to move data from source database to data mart.
- Conducted knowledge transfer session for the entire team about the current system.
- Raised questions on the SLA impact, volume of data and the level of consistency with the current system.
- Involved in performance tuning techniques to improve data load efficiency.
- Prepared complex UNIX scripts to implement Audit Balance and Control.
- Reviewed test plans and test cases for System testing and UAT.
- Validated test cases and carried out testing in lower environments.
Environment: Informatica Power Center 8.6.1, MySQL 5.5.1, Talend 5.1, UNIX Shell Scripting.
Confidential, Miami, FL
ETL Onsite Lead
Responsibilities:
- Designed and developed ETL mappings using Informatica.
- Documented existing mappings as per standards
- Involved in developing SQLs, which are used to apply all business rules on the data before loading into target tables.
- Built materialized views to replicate data and to improve query performance.
- Implemented optimization techniques for performance tuning and wrote necessary Pre & Post session shell scripts.
- Debugged Informatica mappings and validated data in target tables after it was loaded with mappings.
- Performed testing, conducted knowledge transfer sessions; provided technical support and hands-on mentoring in the use of Informatica.
- Involved in peer review and created coding standards document.
- Created system test plan and system test cases.
- Coordinated UAT and provided support to business users.
Environment: Informatica Power Center 8.6.1, Oracle 9x/10x, UNIX Shell Scripting.
Confidential
Senior Lead Developer
Responsibilities:
- Implemented File watcher mechanism using Shell scripting, which was used to validate and load source files.
- Incorporated an effective data back tracking mechanism using load log key concept.
- Prepared Job dependency sheet for WLM (Work Load Manager) to schedule Jobs.
- Designed and developed Complex ETL mappings using Informatica.
- Documented existing mappings as per client’s standards.
- Extensively used Teradata analytical functions such as Row number, Rank in BTEQ Scripts.
- Conducted knowledge transfer sessions for the team about the current system.
- Maintained issue tracker and other analysis based documents to track tasks on a daily basis.
- Implemented slowly changing dimension type 2 and change data capture mechanism using bteq.
- Worked with testing team to define a robust test plan and supported them during the functional testing of the application.
- Contributed to performance tuning and volume testing of the application.
Environment: Informatica Power Center 8.6.1, Teradata 12, UNIX Shell Scripting, MLoad, BTEQ.
Confidential
ETL Lead Developer
Responsibilities:
- Developed and documented ETL mappings and workflows used for validation of incoming data and exploding the data into standardized set of accounting entries which post into GGL
- Developed Job Information Languages (JIL’s) using Autosys for scheduling the Jobs.
- Used Shell script to validate source files and to notify if files are not received on time.
- Developed Mapplets to reduce complexity of mapping.
- Applied Change data capture mechanism to load Incremental data.
- Carried out various levels of integration testing and user acceptance testing.
- Involved in Informatica performance tuning to improve efficiency.
- Monitored Informatica sessions; troubleshot errors and failures.
Environment: Informatica Power Center 8.6.1, Oracle10g, UNIX Shell Scripting.
Confidential
ETL Developer
Responsibilities:
- Was responsible to interact with the business user for Requirement Gathering
- Analyzed business requirements in detail and transformed them to technical specification.
- Developed Informatica Mappings and Sessions.
- Worked extensively on different types of transformations like Source qualifier, Expression, Filter, Aggregator, Lookup, Sequence generator, Router and Joiner.
- Developed sessions/ workflows and scheduled the Informatica jobs.
- Used techniques like source query tuning, caching lookups to achieve optimum performance in existing sessions.
- Created user defined functions to leverage the coding effort.
- Coordinated UAT.
Environment: Informatica Power Center 7, UNIX Shell Scripting, Oracle 10g.
Confidential
ETL Developer
Responsibilities:
- Involved in System Analysis, Requirement Specification Documentation and project discussions.
- Creation of IT-Analyst database, stored procedures, replication of database, backup.
- Data loading from flat files to Ingres database.
- Creation of Jasper ETL jobs, scheduling jobs to load data from one stage to another in Ingres Database.
- Creation of reports using Jasper reports
Environment: Ingres BI suite which includes Jasper ETL, Ingres and Jasper Reports.