Informatica / Datastage Developer Resume
Dallas, TX
SUMMARY
- Nearly 10 years of IT experience with 7 years of professional work experience in Data Warehouse/Data Mart design, System analysis, design, development, Database design, SQL, PL/SQL programming.
- Extensive experience on Informatica PowerCenter 9.x/8.x with strong business understanding in power utility and insurance sectors.
- Expertise in implementing complex Business rules by creating robust mappings, mapplets, and reusable transformations using Informatica Power Center and Power Mart.
- Industry experience as a Data Modeler with solid understanding of Data Modeling, Evaluating Data Sources and strong understanding of Data Marts / Data warehouse designs, ETL, BI, OLAP, Client / Server applications.
- Strong experience in OLAPDataModelingusing DimensionalDataModeling, Star Join Schema Modeling, Snow - FlakeModeling, FACT and Dimensions Tables, Physical and LogicalData Modeling, Normalization and building Referential Integrity Constraints
- Proficient inDataAnalysis on Oracle, MS SQL Server & MS Access, Teradata, Netezza with sound knowledge in extraction ofdatafrom various database sources like Oracle, Teradata, Netezza, MS SQL Server, DB2 and Flat files intoInformatica.
- Well versed in system analysis, ER/Dimensional Modeling, Database design and implementing RDBMS specific features.
- Very good experience in Object Orienteddatamodeling using tools like ERwin, ER/Studio and Power Designer, for both forward and reverse engineering.
- Worked with Erwin, Power Designer Model in multi-user environment for normalized and dimensional datastructure as well as Project planning and project management.
- Working experience in using Informatica Workflow Manager to create and schedule workflows and Worklets.
- Experience in using the Informatica command line utility to schedule and control sessions and batches.
- Extensive Knowledge in architecture design of Extract, Transform, Load environment using Informatica Power Mart and Power Center.
- Experience in identifying and resolving the bottlenecks in Source, Target, Transformations, Mappings and Sessions for better performance
- Experience in optimizing query performance, session performance and fine tuning the mappings for optimum performance
- Worked on integrating data from heterogeneous sources like Oracle, flat files, DB2, COBOL and XML files.
- Experience with pre-session and post-session SQL commands to drop indexes on the target before session runs, and then recreate them when the session completes.
- Used Debugger to validate the mappings and gain troubleshooting information about data and error conditions.
- Knowledge of full life cycle development for building a Data Warehouse.
- Excellent problem solving skills with a strong technical background and good interpersonal skills. Quick learner and excellent team player, ability to meet tight deadlines and work under pressure.
TECHNICAL SKILLS
ETL Tools: Informatica (Power Center 9.X/ 8.1.2), Data stage 11.3, SSIS
Operating Systems: Windows 2000/NT/98/95, Sun Solaris 2.x, HP-Unix, Red Hat Linux 7.2/7.3
RDBMS: Oracle7/ 8i/9i /10g/11g(SQL, PL/SQL, Stored Procedures, Functions), MS-Access 2002/2003, Teradata V2R4.1/V2R5, SQL Server 2000/7, DB2
Data Base Tools: Toad, SQL Navigator 4.0, SQL Loader
Data Modeling: Erwin
Reporting tools: Business objects, Cognos 10.3, Cognos Report net, Crystal Reports, SSRS, SSAS.
Scripting: Unix Shell Scripting.
Web Technology: HTML, Dream weaver Ultra Dev4.0, CSS, Java Script
Languages: C, C++, Java, HTML, PL/SQL
PROFESSIONAL EXPERIENCE
Confidential, Dallas, TX
Informatica / DataStage Developer
Responsibilities:
- Reviewed business, technical requirements, and large scale data models for an enterprise systems to ensure the data integration platform meets requirements.
- Interacting with Business users for Gathering information on new requirements to develop and generate reports to meet business needs and provide reports on timely manner using Business Intelligence information.
- Lead design, development and implementation of end-to-end complex ETL system using Informatica tools.
- Reviewed and implemented the naming standards for the entities, attributes, alternate keys, and primary keys for the logical model.
- Involved in development/testing/deployment of Informatica IDW/EDW jobs.
- Based on requirements using mapping created various Informatica parallel jobs using various transformations such as AGGREGATOR, SCD, LOOK UP, JOINER, EXPRESSION, FILTER, ROUTER, SEQUENCE GENERATOR, STORED PROCEDURE etc.
- Created sequences for various subject areas (Claims, Diagnosis, Clinical Order, Charge master).
- Created DDL's from different sources (EPIC, PATCOM, VISION, LUMINDEX, CAG) and sent to configuration file for different subjects.
- Making sure to meet the coding standards of Informatica for ease of understanding.
- Maintain the Legacy Data warehouse application up and running.
- Adhere to the SLA of different modules in daily basis.
- Involved in the documentation of existing as well as upcoming projects for support perspective.
- Represent the application Confidential status on weekly basis to Managers.
- Implement ETL systems that are operationally stable, efficient and automated
- Promote the code from lower environment (DEV) to upper environment (QA/UAT/PRODUCTION)
- Performed Unit/Load testing, deployment, and implementation of the solutions using the Informatica tools.
- Implement ETL systems that maximize re-usable components/services, collect/share metadata, in corporate audit, reconciliation and exception handling
- Implement parallel processing, load balancing, near real-time and real-time ETL, ELT processes
- Wrote SQL Queries to test data at various stages to generate data lineage, and to monitor and measure data quality as defined by business rules.
- Conducted End to end Testing - execute job flows, investigate system defects, resolve defects and document results
- Worked with DBAs, application specialists and technical services to tune performance of the system to meet performance standards.
- Assist in the development, documentation and application of best practices and procedures that govern DW implementations and operations
- Work closely with offshore team member and guide them in case of any issues.
- Off hours and week end support may be required to meet project milestones.
- Achievement’s:
- Designed the dynamic jobs for level 5.1/5.2 for Type1/Type2 jobs which wouldcreate file per source per thread at run time based on driving meta data table.
- All the Load balancing and adhoc runs can be now controlled from Meta data without any modification of Informatica jobs.
- Implemented the Lumedx ( NTX/CTX )and CAG project successfully independently.
Environment: Informatica Powercenter 9.x, Oracle 11g, Netezza 7.1, SQL Server, Putty, TOAD, Secure CRT, UNIX Shell scripts, Autosys, Cognos, Serena Dimensions, Jira 6.2.
Confidential, Omaha, NE
Informatica Lead Developer
Responsibilities:
- Understand business processes and collaborate with business users/analysts to get specific user requirements.
- Prepare the high and low level technical specification documents based on the Business requirements.
- Designed a STAR schema for Immunizationdatainvolving shared dimensions (Conformed) using Erwin DataModeler.
- Created Source to Target ETL mapping documents.
- Architect the solutions using Informatica Power center 8.5 for reading the data from multiple sources like Oracle, Sybase and Flat files; Transform and load the data into Enterprise Data Warehouse.
- Design and develop PL/SQL Stored procedures to generate the outbound extract files for Third party vendors.
- Developed Parallel jobs with various stages including Aggregate, Join, Lookup, Sort, Merge, Expression, Surrogate Key generator and slowly changing dimension (SCD) stages.
- Developed IDQ tool to Investigate, Data Rules and match frequency stages to clean up the data from multiple sources.
- Implemented ETL/ELT framework for Enterprise Data warehouse. Worked on resolving the performance issues.
- Wrote complex SQL and PL/SQL queries to generate Data Lineage and Reconciliation reports.
- Loading data from various data sources and legacy systems into Teradata production and development warehouse using BTEQ, FASTEXPORT, MULTI LOAD, and FASTLOAD
- Define appropriate Testing (Unit, SIT, Performance, and UAT), Quality Assurance, and Quality Control Strategy.
- Develop test plans, test cases, test scripts, and test validation data sets for all the newly built interfaces.
- Proposed solutions to resolve the performance issues of the existing jobs in the nightly batch flow.
- Involved in performance tuning of Informatica jobs, Oracle SQL queries and stored procedures.
- Developed shared containers for re-usability purpose and job templates as well.
- Documenting the Industry best practices to develop Informatica solutions.
- Mentored the team members to be compliant with the Industry best practices for developing, administering and maintenance of the Informatica applications.
- Promote the Informatica jobs from Dev to QA/UAT and then to Production environment.
- Automate the Informatica jobs using Autosys scheduler.
- Provide production support and resolve the issues in timely manner.
Environment: Informatica Powercenter 8.5, Teradata, Oracle, Netezza, WinSQL, TOAD, Secure CRT, UNIX Shell scripts, Autosys, Serena Dimensions, HP-Quality Center
Confidential, TX
Informatica Lead Developer
Responsibilities:
- Propose system solutions and architect the solutions using Informatica Powercenter 8.5 for integration from various data sources with Data warehouse.
- Developed / designed various new processes and fixed the existing process with new business requirements, various meetings with users input.
- Designed and developed complex ETL jobs for extracting, transforming, integrating, and loading data into data mart using Informatica Designer.
- Worked with Informatica Director to schedule, monitor, analyze performance of individual stages and run Informatica jobs.
- Loading data from various data sources and legacy systems into Teradata production and development warehouse using BTEQ, FASTEXPORT, MULTI LOAD, and FASTLOAD
- Extensively used various Processing and development stages to develop the parallel jobs.
- Generated Surrogate Keys for composite attributes while loading the data into Data Warehouse using Key Management functions.
- Developed Complex ETL jobs to implement Slowly Changing Dimensions.
- Prepared technical design documents and source to target mapping documents.
- Involved in configuring, tuning and maintenance of Informatica applications.
- Setup the project, added users and configured the environments (DEV, QA and PROD) to run the Informatica applications.
- Developed Informatica jobs using various stages like Aggregator, Sort, Expression, Merge, Join, Lookup, Change Data Capture, SCD, Sequence key generator.
- Conducted peer designing, code reviews, and standard documentation of ETL procedures.
- Define appropriate Testing (Unit, SIT, Performance, and UAT), Quality Assurance, and Quality Control Strategy.
- Develop test plans, test cases, test scripts, and test validation data sets for all the newly built interfaces.
- Wrote complex SQL queries and PL/SQL procedures.
- Automate all the new ETL jobs using UNIX shell scripts and add data validation checks including business rules and referential integrity checks.
- Involved in scheduling the ETL jobs using CA Autosys scheduler.
- Worked on troubleshooting, performance tuning and performances monitoring for enhancement of Informatica jobs.
- Mentored the team members to be compliant with the Industry best practices for developing, administering and maintenance of the Informatica applications.
Environment: Informatica Powercenter 8.5, Oracle, Teradata, SQL Server 2012, SQL, PL/SQL, Cognos, DB2, UNIX Shell scripts
Confidential, Richardson, TX
DataStage Developer
Responsibilities:
- Understand business processes and collaborate with business users in requirements analysis, functional design, and technical design documentation.
- Architect the solutions using IBM DataStage v8.5 for implementing the interfaces to load the data into Netezza enterprise Data warehouse and Teradata.
- Created the logical model for the EDW with approximately 85 entities and 1000 attributes using Erwin. The logical model was fully attributed till 3rd normalization and contains both current and history tables.Datamodel is divided in number of sub models for the ease of understanding and comprehension
- Designed low level and high level design documents.
- Designed complex ETL mapping documents.
- Developed parallel ETL jobs making use of different stages like transformer, lookup, join, modify, filter, funnel, pivot, sort, remove duplicates, Aggregator stage, Change Capture stage, Change Apply stage etc.
- Created low level and high level technical specification documents.
- Wrote complex SQL queries to fetch the data from multiple data sources.
- Loading data from various data sources and legacy systems into Teradata production and development warehouse using BTEQ, FASTEXPORT, MULTI LOAD, and FASTLOAD.
- Created Data lineage and Data analysis documents.
- Promote the code from lower environment (DEV) to upper environment (QA/UAT/PRODUCTION)
- Implemented exception and error handling to gracefully handle the ETL code.
- Define appropriate Testing (Unit, SIT, Performance, and UAT), Quality Assurance, and Quality Control Strategy.
- Develop test plans, test cases, test scripts, and test validation data sets for all the newly built interfaces.
- Proposed solutions to resolve the performance issues of the existing jobs in the nightly batch flow.
- Developed shared containers for re-usability purpose.
- Worked on optimization of SQL queries and improving the performance of DataStage jobs.
Environment: IBM DataStage 8.5, Oracle, Teradata, UNIX Shell scripts, ZENA, Serena Dimensions, HP-Quality Center
Confidential, Colorado springs, CO
Sr.Informatica Developer
Responsibilities:
- Reviewed the conceptual EDW data model with business users, App Dev and information architects to make sure all the requirements are fully covered.
- Developed / designed various new processes and fixed the existing process with new business requirements, various meetings with users input.
- Designed and developed jobs for extracting, transforming, integrating, and loading data into data mart using Informatica Designer.
- Developed, executed, monitored and validated the ETL Informatica jobs in the Informatica designer and Director Components.
- Worked with Informatica Director to schedule, monitor, analyze performance of individual stages and run Informatica jobs.
- Extensively used various Processing and debug/development stages to develop server and parallel jobs.
- Created Source to Target Mapping (STM) documents.
- Created low and high level technical specification documents.
- Generated Surrogate Keys for composite attributes while loading the data into Data Warehouse using Key Management functions.
- Developed Complex ETL jobs to implement Slowly Changing Dimensions and Change Data Capture.
- Implemented ELT framework for few Data marts to achieve more performance.
- Performed Troubleshooting and Tuning of Informatica Jobs using job parameters, configuration files and environment variables.
- Developed shell scripts to validate, automate and schedule Informatica jobs using UNIX shell scripting and Crontab Utility.
- Developed Complex SQL queries and PL/SQL stored procedures.
- Worked on SQL query optimizations and performance tuning of Informatica jobs.
- Promoted the code from DEV to QA/UAT/PROD environments.
- Provided production support for deployed applications and worked on support tickets to resolve the issues.
- Worked on Onsite/Offshore model. Used to co-ordinate with offshore team on delivering the projects/tasks on time.
Environment: Informatica 8.5, Netezza 6.0, Oracle 9i, SQL server 2005, DB2, SQL, PL/SQL, WinSQL, Toad, SQL Navigator, Control-M
Confidential, Irving, TX
Informatica Lead Developer
Responsibilities:
- Played a key role in building the strategy to migrate the Oracle based Retek Data Warehouse (RDW) to Netezza based Enterprise Data Warehouse (EDW).
- Actively involved in building the strategy to Implement Customer and transaction level data warehouse on Netezza appliance.
- Document user requirements and translate requirements into system solutions.
- Architect Star & Snowflake based logical & physical data models for Data Warehouse systems using data modeling tools such as Erwin.
- Implement the migration plan with Oracle, Pro*C, SQL, PL/SQL, Netezza data warehouse appliance, and Informatica.
- Involved in creating the functional specification documents for ETL interfaces.
- Architect, design, develop, deploy, and support of integration processes across the enterprise by utilizing Informatica.
- Created source to target mapping documents & Data lineage documents.
- Created low and high level technical specification documents.
- Develop test plans, test cases, test scripts, and test validation data sets for Data Mart, Data Warehouse, and Informatica integration/ETL processes.
- Architecting and designing the Customer module for Master Data Management.
- Designing and Implementing the ETL processes for History load and Incremental loads for EDW, Customer and Transaction level data warehouse.
- Played major role in designing and implementing proof of concept for migrating the data from RDW (Retek Data Warehouse) to EDW (Enterprise Data Warehouse).
- Document all the interface processes in current data warehouse system and translate them into new ETL processes using Informatica.
- Wrote to complex SQL queries around Data reconciliation and Lineage report.
- Prepare the Migration scope and validation strategy documents.
- Perform Data cleansing activities to improve the data quality.
- Automate all the new Informatica ETL jobs using UNIX shell scripts through Control-M scheduler and add data validation checks including business rules and referential integrity checks.
- Developed multiple shared container jobs for reusability & created job templates.
- Create dimension and fact tables in Netezza and perform data loads using nzload utility.
- Design and implemented ETL/ELT framework for Data warehouse and Data marts.
- Developed PL/SQL Stored procedures to perform database operations.
- Design and develop Parallel jobs to extract data, clean, transform, and to load the target tables using the Informatica Designer.
- Utilize Informatica Director to run, schedule, monitor, and test the interfaces and obtain the performance statistics.
- Perform troubleshooting, performance tuning and performance monitoring for enhancement of Informatica jobs.
- Promoted the code from lower environment (DEV) to upper environment (QA/PRODUCTION)
- Provide support in post-deployment phase and involve in project transition to production support.
- Provided 24/7 production support for various systems including EDW, RDW and implement the changes to improve system performance.
- Coordinated with offshore team to deliver the projects on time.
Confidential, Irving, TX
Informatica Lead Developer
Responsibilities:
- Developed the strategy for Informatica migration from 7.5 version to 8.5
- Played key role as Architect and Technical lead in migration plan, architecture, capacity plan, and implementation of Informatica ETL migration project.
- Played a key role in executing the proof of concept on selected set of ETL jobs to study the challenges, and gauge the work effort for the ETL migration.
- Install and configure Informatica Information server on all the three (Dev, Test and Production) environments.
- Set up the projects, roles, users, privileges in these environments.
- Involved in preparing the project plan (Rolling out the projects in Phased approach) for migrating the jobs to the new 8.5 server with work breakdown structure.
- Performed the impact analysis for moving the projects from existing server to new server and documented the action items to be taken to carry out smooth migration.
- Involved in ETL governance, standards, administration and process documentation.
- Define appropriate Testing (Unit, SIT, Performance, and UAT), Quality Assurance, and Quality Control Strategy.
- Very instrumental in leading the team to migrate around 5000 ETL jobs to 8.5 environments.
- Collaborated with IT support teams to review the migration plan.
- Played a key role in implementing the testing strategy, defect tracking and bug fixing.
- Provide 24/7 On-call support in post-deployment phase and involve in project transition to production support.
- Created and Implemented Industry standard procedures for maintenance, monitoring, backup and recovery operations for the Informatica applications.
- Analyzed and identified the enhancements that can be made to the ETL jobs for better design and performance.
Environment: Informatica PowerCenter 8.7/7.5.2, Netezza 6.0, Oracle 10g, Microstrategy, UNIX Shell scripts, Control-M, PVCS, Pro*C scripts, SQL, PL/SQL, Erwin and Perl.
Confidential, Austin, TX
Informatica Developer
Responsibilities:
- Understand business processes and collaborate with business users/analysts to get specific user requirements.
- Develop Informatica Parallel jobs using various stages like Join, Merge, Funnel, Lookup, Sort, Transformer, Copy, Remove Duplicate, Filter, Peek, Column Generator, Pivot and Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems.
- Involved in configuring, tuning and maintenance of many Informatica applications.
- Design and develop the Routines and Job Sequence for the ETL jobs and prepare the complete data mappings.
- Created source to target mapping documents.
- Created low and high level technical design specification documents.
- Develop UNIX shell scripts to execute Informatica jobs.
- Develop test plans, test cases, test scripts, and test validation data sets for Data Mart, Data Warehouse, and ETL processes.
- Validate, schedule, run, and monitor the ETL jobs using Informatica Director.
- Manage the ETL repository using Informatica Manager.
- Develop UNIX scripts to automate the Data Load processes to the target Data warehouse.
- Promoted the code from lower environment (DEV) to upper environment (QA/PRODUCTION)
- Supported Disaster Recovery activities for all the InfoSphere suite related applications.
- Prepare and execute the Component Integration Testing (CIT) test cases.
- Work on troubleshooting, performance tuning and performance monitoring for enhancement of Informatica jobs.
- Always a team player and able to multitask within the team.
- Convert complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
- Participate in weekly status meetings.
- Implement the application in the Production environment and provide support in post-deployment phase and involve in project transition to production support.
- Actively provided production support of many Informatica applications with 24/7 On-Call support.
Environment: Informatica PowerCenter 7.5.x, Teradata, Oracle 9i, SQL server 2005, DB2, Sybase, Erwin, SQL, PL/SQL, Toad, SQL Navigator, Control-M, LINUX/UNIX Shell scripts.