Etl Developer Resume
Teaneck, NJ
SUMMARY
- Over 7 years of experience in IT industry with expertise in MSSQL, Oracle, Informatica and ETL tools.
- 6+ years of experience in the Development and Implementation of Data warehousing with Informatica, OLTP and OLAP involving Data Extraction, Data Transformation, Data Loading and Data Analysis.
- Experience in all phases of the Data warehouse life cycle involving Analysis, Design, Development and Testing of Data warehouses using ETL Logic.
- Extensively used Informatica tools (both Server and Client tools) like Repository Manager, Designer, Workflow manager, Workflow Monitor.
- Experience in implementing complex business rules by creating transformation, re - usable transformations (Expression, Aggregator, Filter, Connected and Unconnected Lookup, Router, Rank, Joiner, Update Strategy), and developing complex Mapplets, Mappings, SQL Stored Procedures, Triggers.
- Developed Slowly Changing Dimension Mappings of type I, type II (version, flag and time stamp) and type III.
- Experience in debugging, error handling and performance tuning of sources, targets, mappings and sessions with the help of error logs generated by Informatica server.
- Worked with Oracle Stored Procedures and experienced in loading data into Data Warehouse/Data Marts using Informatica, SQL*Loader, Export/Import utilities.
- Good understanding of Star Schema and Snowflake Schema Methodology and using Data Modeling tool Erwin 4.0/4.2.
- Worked with PMCMD to schedule the Informatica jobs using UNIX Shell Scripting.
- Proficient in server side programming like stored procedures, stored functions, database triggers, packages using PL/SQL and SQL.
- Involved in Technical Documentation, Unit test, Integration test and writing the test plan.
- Highly adaptive to a team environment and proven ability to work in a fast paced teaming environment with excellent communication skills.
- Knowledge in Developing SSIS Packages to Extract, Transform and Load (ETL) data into the Data warehouse from Heterogeneous databases such as Oracle, DB2, Sybase and MS Access.
TECHNICAL SKILLS
ETL Tools: Informatica Power Center V8x/V9x, Power Exchange, Informatica Life Cycle Management(ILM tools), Data Archiving, Data Validation option.
Databases: Microsoft SQL Server 2005/2008, Oracle 9i/10g/11g, MySQL, MS Access
Data Modeling Tool: Erwin 3.5/4.0/4.2.
Languages: C, C++, SQL, Oracle, T-SQL/PLSQL.
Operating Systems: Windows 2000/2003/NT/XP/2007, UNIX.
BI Tools: Business Objects XI 3.1 (Web Intelligence & Desktop Intelligence), Report studio, MSSQL BI tools like SSIS, SSAS, SSRS.
Database utilities/Other tools: Toad 7.6/8.0, SQL Loader, MS Office.
PROFESSIONAL EXPERIENCE
Confidential, Teaneck, NJ
ETL developer
Responsibilities:
- Source data analysis, design and documentation.
- Parsed high-level design spec to simple ETL coding and mapping standards.
- Used Informatica designer for developing various mappings.
- Designed and developed ETL Mappings using Informatica to extract data from flat files and Oracle, and to load the data into the target database.
- Successfully created complex Informatica mappings to load data in to the data mart and monitored them. The mappings involved extensive use of transformations like Aggregator, Filter, Router, Expression, Joiner, Union, Normalizer and Sequence generator.
- Extensively used various transformations like Source Qualifier, Joiner, Aggregation, Connected and unconnected lookup, Rank and Filter.
- Extracted data from various sources like SQL server, Oracle, and relational databases.
- Defined Target Load Order Plan and Constraint based loading for loading data correctly into different Target Tables.
- Administrating User Privileges, Groups and Folders which includes creation, update and deletion.
- Migration of New and Changed Informatica objects across the environments using Folder to Folder and Deployment Group methods.
- Analyzed newly converted data to establish a baseline measurement for data quality
- Translated the business processes into Informatica mappings for building the data mart.
- Performed unit testing on the given tasks after performing the appropriate mappings.
- Worked on SQL tools like TOAD to run SQL Queries to validate the data.
- Created PL/SQL procedures to populate base data mart aggregation structure.
- Used PMCMD/PMREP commands for running Informatica from backend.
- Developed Batch Jobs using UNIX Shell scripts to automate the process of loading, pushing and pulling data from and to different servers.
- Involved designing and developing packages for a Data Warehousing and Data Migrations projects using Integration services (SSIS) on different Data Sources.
ENVIRONMENT: Informatica Power Center 8.6.1, SQL server 2005/2008, ILM-Data Archiving 6.1, Oracle10g, UNIX Shell Scripting, Erwin 4.5, Windows XP, Microsoft Visio, SQL Plus, TOAD, BO XI 3.1,SSIS.
Confidential, Norfolk, VA
ETL developer
Responsibilities:
- Interacted with business analyst and gathered requirements based on changing needs. Incorporated identified factors into Informatica mappings to build the Data marts.
- Developed a standard ETL framework to enable the reusability of similar logic across the board.
- Involved in System Documentation of Dataflow and methodology.
- Assisted in designing Logical/Physical Data Models, forward/reverse engineering using Erwin 4.0.
- Developed mappings to extract data from SQL Server, Oracle, Flat files and load into Data Mart using the Power Center.
- Developed common routine mappings. Made use of mapping variable & mapping parameters.
- Used Informatica Designer to create complex mappings using different transformations like Filter, Router, Connected & Unconnected lookups, Stored Procedure, Joiner, Update Strategy, Expressions and Aggregator transformations to pipeline data to Data Mart.
- Developed Slowly Changing Dimension for type I and type II (flag, date).
- Used mapplets for use in mappings thereby saving valuable design time and effort.
- Used Informatica Workflow Manager to create, schedule, execute and monitor sessions, worklets and workflows.
- Written procedures, Queries to retrieve data from DWH and implemented in DM.
- Worked on creating Views & Materialized views from the database perspective.
- Used shell scripts in UNIX to execute the workflow.
- Responsible for submitting DBA requests, following up with data base DBA’s and Informatica administrators, creating remedy ticket, handling all the signoff’s for the production, updating all changes with new versions using START team, creating test cases using Quality Center.
- Written SQL Queries, Triggers and Stored Procedures to apply and maintain the Business Rules.
- Developed Sub Reports, Matrix Reports, and Drill down reports, using SQL Server Reporting Services (SSRS) and worked on querying data and creating on-demand reports using Report Builder.
- Troubleshooting database, workflows, mappings, source, and target to find out the bottlenecks and improved the performance.
- Written Indexes, primary keys and checked other performance tuning at data base level.
- Conducted Database testing to check Constrains, field size, Indexes, Stored Procedures, etc.
- Created testing metrics using MS-Excel.
- Implemented various Performance Tuning techniques on Sources, Targets, Mappings, Workflows and database tuning.
- Involved in generating reports from Data Mart using Cognos.
- Defects were tracked, reviewed and analysed.
- Used Source Analyzer and Warehouse designer to import the source and target database schemas, and the Mapping Designer to map the sources to the target.
- Performed Configuration Management to Migrate Informatica mappings/sessions /workflows from Development to Test and to production environment.
- Worked on ILM data archiving tool.
- Used data discovery tool to view reports in ILM
ENVIRONMENT: Informatica Power Center 8.1.1, ILM-Data Archiving 6.1, SQL Server 2000/2005/2008, Oracle 10g, PL/SQL, UNIX Shell Scripts, Cognos, Erwin, STAR team, Business Objects 6.5.
Confidential, Evansville, IN
ETL developer
Responsibilities:
- Participated in the design team and user requirement gathering meetings and documentation.
- Involved in developing and testing multiple projects with Sprint Communications.
- Worked on Informatica Power Center 8.6 to transform the data for Postpaid, prepaid, flex pay, various kinds of the transformations were used to implement simple and complex business logic.
- Worked with various transformations like connected & unconnected lookups, Router, Expressions, source qualifier, aggregators, filters, sequence Generator, Joiner etc.
- Created and Configured Workflows, Worklets, and Sessions to transport the data to target using Informatica Workflow Manager.
- Extensively involved in performance tuning at source, target, mapping, session and system levels.
- Involved in preparing detailed Business Analysis documents, ETL design documents, unit test plans for the mappings.
- Involved in writing Unix shell scripts to archive the source files.
- Maintained Warehouse Metadata, naming standards and warehouse standards for future application development.
- Involved in the entire SDLC (Software Development Life Cycle) process that includes Implementation, testing, deployment, documentation, training and maintenance.
- Involved in designing and developing the data acquisition process for the data warehouse including the initial load and subsequent refreshes.
- Involved in Data Cleansing and Data Validation to validate the corrupted data and reorganize the existing data in the databases.
- Worked extensively with databases to write complex queries involving aggregates, Joins and Functions.
- Involved in Unit and Integration testing of the Informatica mappings and created Unit Test Documentation.
- Migrated Mappings, Sessions, Workflows from Development to Test and then to Production environment.
- Implemented slowly changing dimensions methodology to keep track of historical data.
- Extensively performed unit testing and system or integration testing.
- Used SQL Server Reporting Services with other team members to analyze and create required reports.
ENVIRONMENT: Informatica power centre 8.6, MS SQL Server 2005, MS SQL Server Reporting Services, MS SQL Server Integration Services Oracle 10g, SQL plus, flatfiles, BO XI/R2, Microsoft excel, TOAD 8.6, PL/SQL, SQL loader.
Confidential, Boston, MA
ETL developer
Responsibilities:
- Developed ETL programs using Informatica to implement the business requirements.
- Communicated with business customers to discuss the issues and requirements.
- Created shell scripts to fine tune the ETL flow of the Informatica workflows.
- Used Informatica file watch events to pole the FTP sites for the external mainframe files.
- Performance tuning was done at the functional level and map level. Used relational SQL wherever possible to minimize the data transfer over the network.
- Effectively used Informatica parameter files for defining mapping variables, workflow variables, FTP connections and relational connections.
- Effectively worked in Informatica version based environment and used deployment groups to migrate the objects.
- Used debugger in identifying bugs in existing mappings by analyzing data flow, evaluating transformations.
- Effectively worked on Onsite and Offshore work model.
- Pre and post session assignment variables were used to pass the variable values from one session to other.
- Designed workflows with many sessions with decision, assignment task, event wait, and event raise tasks, used Informatica scheduler to schedule jobs.
- Reviewed and analysed functional requirements, mapping documents, problem solving and trouble shooting.
- Performed unit testing at various levels of the ETL and actively involved in team code reviews.
- Identified problems in existing production data and developed one time scripts to correct them.
- Fixed the invalid mappings and troubleshoot the technical problems of the database.
ENVIRONMENT: Informatica 9.1, DB2 UDB, UNIX Shell scripts.
Confidential
Jr. ETL developer
Responsibilities:
- Involved in designing and building data marts for provider division.
- Loaded data to the interface tables in oracle from multiple data sources such as MS Access, Sybase, SQL Server, text files and excel spreadsheets using Informatica.
- Designed data transformation from staging to fact and dimension tables in the warehouse.
- Implemented aggregate, filter, join, expression, lookup and update strategy transformations.
- Implemented variables and parameters in transformations to calculate billing data.
- Developed Mapplets using corresponding source, targets and transformations.
- Created sessions, sequential and concurrent batches for the mappings using server manager.
- Test all the applications and transport the data to target warehouse oracle tables, schedule and run extraction and load process and monitor sessions by using Informatica server manager.
- Developing, executing & monitoring Autosys (Process Scheduler) jobs.
- Involved in designing logical and physical database designing using ERWIN tool.
- Involved in admin tasks like analyzing table space requirement, load balancing and performance.
- Involved in tuning memory, I/O bottlenecks, resource contention, sorts and free lists.
- Writing stored procedures, triggers, functions and packages to implement business logic.
- Created mappings between source and target using Informatica power center designer.
- Used mapping and mapplet designer to generate different mappings for different loads.
- Created transformations like source qualifier, joiner transformation, filter, update strategy, lookup transformation, rank transformations, expressions, aggregator and sequence generator to load the data from staging area to ODS and to DW in oracle.
- Created, scheduled and monitored sessions and batch process based on demand, run on time, run only once using Informatica server manager.
Environment: Informatica Power Center 6.1, Windows NT. Windows 2000 Server, MS-SQL Server 2000/7.0, Oracle 8i, UNIX Shell Scripts, MS Excel, Erwin 3.5, SQL Server Integration Services(SSIS), Visual Basic6.0, Server Analysis Services (SSAS), Reporting Services (SSRS 2005), Business Intelligence Development Studio (BIDS), Crystal Reports, Microsoft Access FTP Communication.
Confidential
Jr. SQL Server Developer
Responsibilities:
- Involved in installation and configuration of SQL server 2000 on Servers.
- Applied patches and service packs to keep the database at current patch level.
- Implemented database standards and naming convention for the database objects.
- Implement and maintain database security.
- Implemented trigger and stored procedures and enforced business rules via checks and constraints.
- Fine tuned Stored Procedures, using Execution Plan in T-SQL for better performance.
- Going through the clients' requirements and coming up with database design and application architecture.
- Troubleshoot and minimize production down issues.
- Designed new job process, new database maintenance plans, DTS programs and did Performance tuning of the existing processes.
- Created Scheduled maintenances and backup procedures to the database as a disaster recovery method.
- Data conversions and data loads from various databases and file structures.
- Generated reports using Crystal reports.
- Monitor failed and long running MS SQL Server jobs.
- Monitor, tune, and analyze database performance and allocate server resources to achieve optimum database performance.
- Maintaining User account administration for Different domains.
ENVIRONMENT: SQL Server 2000, DTS, T-SQL, Crystal reports7, Windows 2000 Server.