Etl Developer Resume
Bentonville, AR
SUMMARY
- Over 8 years of IT experience in analysis, design, modeling, development, implementation and testing of Data Warehousing and Client/Server applications.
- It includes around 5 years’ Experience in Data Warehousing Tool IBM Information Server Datastage8.1 and Datastage 6.x/7.X
- Efficient in all phases of the software development lifecycle, coherent with Data Cleansing, Data Conversion, Performance Tuning, Unit Testing, System Testing, User Acceptance Testing
- Experience in using various stages like Aggregator, Filter, Merge, Hash, Sort, Universe, Stored Procedure, DB2Load, Sybase Load, Folder, FTP, Pivot, and XML Input/output, Joins, Lookups etc .
- Extensively worked with Datastage Enterprise Edition, Server Edition, Information Analyzer and Quality Stage.
- Plenteous Knowledge of Information Server Quality Stage Methodologies forData cleansing and Standardizing.
- Designed, tested and migrated Datastage jobs from Development Systemto Test System and then to Production System for Operational Data Store and Data Warehouse.
- Created master sequence in Datastage to run jobs /exception handling/ email notificationetc which basically controlled the number of job runs in the server, success/failure reports etc.
- Expertise in dimensional data modeling, Star schema modeling, Snow flake modeling, fact and dimension table design, physical and logical data modeling using Erwin.
- Experience with relational databases likeOracle 11g/10g/9i, DB2,Teradata v2r6.0, SQL Server 2005, 2000 and bulk load utilities like Oracle SQL*Loader, DB2 Load, M load, Fast load, T Pump, Fast export. Handful experience in using Query Man.
- Proficient in SQL Server developingStored Procedures, Triggers, T - SQL Statements,User Defined Functions and Views.
- Excellent technical writing skills with hands on experience developing Functional Specifications, Business Requirements, Test Plan, Test Cases, Test Status Reports
- Experience in using testing tools and Job scheduling tools.
- Excellent communication, interpersonal, analytical skills and strong ability to perform as part of a team.
- Skilled in planning, coordination, and execution of applications and a Proficient in writing technical documents, presentations and presentation skills.
TECHNICAL SKILLS
ETL Tools: Datastage PX 8.1,7.5.3, 7.x, 6.0 (Designer, Director, Manager, Administrator), DS Server 7.5, Quality Stage and Profile Stage, Version Control 7.5, SQL server Integration services/ DTS
Database: Oracle 11g/10g/9i,Teradata v2r6.0, IBM-DB2/UDB 9.0, Informix, MS-SQL Server 2005/2000, My SQL 4.5, MS-Access
Data Modeling: Erwin 7.2/4.1.4, Microsoft Visio, Power Designer 12.5
Reporting Tools: Cognos Report 7.1/7.0, Crystal Reports
Operating Systems: UNIX (AIX, HP-UX), Linux, MS-DOS, Windows 9x/NT/2K/XP
Languages: SQL, PL/SQL, Unix Shell scripting, UML, C, C++
Web Technology: HTML, Java Script, XML
Database Tools: SQL plus, SQL Loader, Query Man, Toad
Other Tools: HP Quality Center, AutoSys, BMC Remedy
PROFESSIONAL EXPERIENCE
Confidential - Detroit, MI
Datastage Developer
Responsibilities:
- Developed Datastage parallel jobs and respective sequencer jobs with sequential files as source and Oracle as Target Database.
- Created PLSQL statements to join, update and insert in Datastage jobs.
- Created design and production support documents for every job, explaining the job flow and production support in case of failures.
- Converted Logical Mapping Document into Source to target Physical Mapping Document for ETL.
- Worked with various Partitioning (Round-Robin, Hash fields, Range, Random and etc.) and
- Collecting (Round-Robin, Ordered and Sorted Merge) techniques.
- Worked with File (Sequential, Data Set, File Set, Lookup File Set), Oracle, Processing (Transformer, Lookup, Sort, Aggregator, Funnel, Remove Duplicates, Copy, Filter, Switch and Etc.).
- Used FAST Export and MultiLoad utilities to load both transactional data and historical data into Teradata.
- Worked with Lookups, Modify stage, join, Pivot, Stored Procedure Stages.
- Worked with Data Sets and used Changes Capture and Changes Apply stages with them.
- Worked extensively with Parallel Stages like Row Generator, Column Generator, Modify, Funnel, Filter, Switch, Remove Duplicates and Transformer Stages etc extensively.
- Used Datastage inbuilt Functions (Date, Time, Logical, Null, String, Casting) and created DS Transforms and Routines to perform the required transformations.
- Created UNIX shell scripts for Mobile App’s application to handle three different source files and modified an existing script for Insurance feeds.
- Prepared Unit test, integration test, and Load test plan documents. Performed unit test, integration test, and performance test and documented test results. Involved in developing.
- Created Autosys JIL files for scheduling the Datastage Sequencers.
- Modified the existing jobs, for performance tuning to maximize the performance’s
- Performed various test conditions on Datastage jobs and submitted to the QA team.
- Created the deployment documents and successfully imported the developed applications on to the production BIS environment.
- Involved in All ETL Testing Process, Bug Fixing.
- Implemented and Maintained ETL jobs in production.
ENVIRONMENT: IBM Info Sphere Datastage 7.5.3/7.2/7.1, Oracle 10g, DB2 Teradata, Mainframe, PL/SQL, Autosys, Erwin 4.2, TOAD, SQL Developer, PVCS,Ms Visio, Query man, Business objects 5.1, Shell Scripts, Hummingbird 11.0, HP Unix, Windows XP.
Confidential, Deerfield, IL
Sr. Datastage Developer
Responsibilities:
- Expertise in application development with Full lifecycle implementation of large Data Warehouse including project Scope, Requirements gathering, Star Schema design, Snowflake Schema, Data modeling and ODS
- Involved as primary onsite technical lead during the analysis, planning, design, development and implementation stage of project using IBM Web Sphere IIS Suite( Parallel Extender, Quality stage, Web Service, Information Analyzer, Profile stage)
- Developed Relational model for OLTP system, Anchor model for Data Warehouse and Dimensional model (Star and Snow Flake) for different data marts using Visio.
- Identified and documented data sources and transformation rules required to populate and maintain data warehouse content and created source to target Logical Mapping Document
- Converted Logical Mapping Document into Source to target Physical Mapping Document for ETL
- Used Datastage Parallel Extender for improving the performance of jobs.
- Knowledge of configuration files for Parallel jobs.
- Created Datastage jobs using different stages like Transformer, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample, Surrogate Key, Column Generator, Row Generator, Etc.
- Extensively used Parallel Stages like Row Generator, Column Generator, Head, and Peek for development and de-bugging purposes
- Creation of re-usable components using shared containers for local use or shared use.
- Used the Datastage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis
- Developed complex store procedures using input/output parameters, cursors, views, triggers and complex queries using temp tables and joins
- Used the Datastage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis
- Created Indexes on the tables to improve performance of ETL and Reporting jobs.
- Worked with Data Sets and used Changes Capture and Changes Apply stages with them
- Created drill down though reports using Cognos.
Environment: IBM WebSphere IIS 8.1, Cognos 8.4, Micro strategy 8, Rational Software, Perl, Quality Center, Cognos, MVS Main frame, Teradata, DB2 UDB 9.0, MSOffice Suite, UNIX HPUX 11.23, Main Frame, Erwin 4.1, Visio, Oracle 10g, Toad, DB2, MS Access.
Confidential, Bentonville, AR
ETL Developer
Responsibilities:
- Understand business requirements from end users and data analysts interpret and design mappings from source to target data warehouse migration.
- Involved in preparation/modification of Technical Specification Document and Source to Target/Mapping Document Preparation.
- Used ETL tool Datastage to load data from different sources like DB2, Informix, Teradata and Flat Files, COBOL files to Flat Files and SAP BW Packs.
- Involved in creating complex jobs in project cycle.
- Dumped the Look-up data into Hash-files and accessed that data using Hash-file stage to drastically improve the performance of the jobs
- Involved in migration, error handling.
- Developed Datastage parallel jobs using Sequential File, Sort, Aggregator, Copy, Merge, Join, Filter, Funnel, Transformer, Peek, Lookup, Change Captureand several other stages.
- Implemented Extraction process from DB2.
- Wrote database source codes to create views, packages, stored procedures, functions, triggers, indexes and sequences in QueryMan for DB2 database to be used in the applications
- Used Datastage Director to monitor the Job run statistics.
- Used Datastage Designer to develop Datastage jobs, and run the jobs in the Datastage Server.
- Used UNIX scripts to run the ETL jobs, FTP, file manipulation, e-mail notifications, capturing reject records.
- Extensively working with NLS Settings.
- Worked in support team
- Developed Test Cases and tested in HP Quality Center.
- Given the production support.
- Worked closely with the Data Warehousing Admin and Data Modeling team in tuning the Extraction and Summarization process for better performance
Environment: IBM Information server 8.0.1, Windows XP, DB2, Informix, Teradata, Query Man, Putty, MS Office, HP Quality Center, BMC Remedy.
Confidential, Woodland Hills, CA
ETL/Datastage Developer
Responsibilities:
- Involved in design and development of Parallel and Server Jobs.
- Actively participated in business meetings with the business users in order to gather the business requirements.
- Developed the Technical Design and Unit Test Plans for Projects
- Created process flow diagrams using Microsoft VISIO.
- Developed the audit component to ensure the ftp source file has properly landed in the landing zone.
- Developed job sequence and implemented restartability using various checkpoints.
- Developed Server Side functionality by using PL/SQL, PERL and UNIX shell programming.
- Extensively worked on Datastage Director, Datastage Manager and knowledge of Datastage Administrator.
- Developed various Datastage jobs in Enterprise Edition (parallel Extender) using Datastage Designer.
- Used Parallel Extender for splitting the data into subsets and flowing of data concurrently across all available processors to achieve job performance.
- Used various stages like transformer, funnel, lookup, join, merge, remove duplicates, Change Capture, filter, Aggregator etc.
- Developed UNIX shell scripts to automate the Data Load processes to the target Data warehouse.
- Written Unix Shell Script for scheduling Datastage jobs, to handle Error Management and Audit Management.
- Involved in Unit Testing, SIT and UAT.
- Responsible for daily and weekly support of the data warehouse process (ETL, shell, SQL), as well as supporting ad-hoc requests for Marketing
- Involved in fine tuning, trouble shooting, bug fixing, defect analysis and enhancement of the multiple Datastage jobs
Environment: Ascential Datastage 7.5, Oracle 9i, SQL Server2000, TOAD, SQL, PL/SQL, Erwin 4.x, AIX-UNIX 5.2, Autosys, Microsoft Visio and Windows 2000.
Confidential, Newport, CA
ETL Developer/Analyst
Responsibilities:
- Extensively used Datastage as the data migration/transformation tool for Corporate Data Warehouse application.
- Gathered requirements from business and created source to target mapping sheets and modified existing data modeling.
- Designed the logical and physical data warehouse schema. Analyzed source systems and creating a mapping to the target database schema.
- Extracted data from Teradata applied Transformations and loaded in to Oracle Database.
- Involved in Design, Development and unit testing of Datastage jobs and migrating the code from one environment to the other.
- Extensively worked with Parallel Extender using Parallel Processing (pipeline and Partition Parallelism techniques).
- Involved in modifying existing Datastage Jobs for better performance.
- Extensively used Datastage Designer to design and develop Server and PX jobs to migrate data from transactional system (Oracle 9i) into the Data Warehouse.
- Worked closely with Business Analysts to understand business rules and developed Prototypejobs.
- Created many parallel jobs and parameterized the jobs for optimization.
- Setup folders, groups, users, permissions and performed Repository administration using Repository Manager
- Extensively developed Server/PX Shared Containers for Reusability.
- Extensively used Datastage Manager to Export/Import Datastage Job components and Import Plug in Table Definitions from Oracle database.
- Created Unix Shell Scripts as wrappers to automate the process of running Datastage jobs and to track Datastage Job logs and Script logs.
- Redesigned many existing ETL jobs (SQL scripts, Shell Scripts) in Datastage as per the Framework approach.
- Implementing the Partition Tables, Partition Indexes etc. Worked with huge tables with multimillion rows as needed.
- Provided Support to various groups to design and develop ETL job flow using Datastage and Shell Scripts.
- Worked closely with Data Analysts to make sure the data is accurate and consistent for table loads.
- Worked with TOAD to interact with Oracle and used the tool for testing
Environment: Datastage 7.5 (Server and Parallel Extender), UNIX, Erwin, DB2 UDB, Oracle 9i, Teradata V2R6, SQL, SQL* Loader, and Windows NT.
Confidential, DE
DW Developer
Responsibilities:
- Participated in recognizing source systems, devolve on scheduling client interviews to recognize commonalities in data residing on different source systems.
- Customized configuration files forParallel extenderby using Datastage Manager
- Broadly worked in improving execution of the jobs by avoiding as many transforms as we can.
- Drudged over environment variables likeAPT CONFIG FILE and APT DUMP SCORE.
- Performed job sequencers and implemented recapitulate using various check points.
- Used various stages liketransformer, funnel, lookup, join, merge, remove duplicate, change capture, filter, aggregatoretc.
- Good experience in handlingerror records.
- Prepared documentation for unit,regression, integration, and final end-to-end testing.
Environment: Ascential Datastage EE, Datastage 7.5 Parallel Extender, Oracle 9i, 10g, TOAD, SQL Loader, Windows XP, UNIX
Confidential
SQL Server Developer/DBA
Responsibilities:
- Designed and Created databases, tables, views, stored procedures and triggers
- Created groups, roles, users and assigning access privileges to users.
- Scheduling Backups, Backing up master and system databases and restoring them when necessary
- Monitored and scheduled existing/new jobs on production environment.
- Worked to tune the SQL Queries using SQL profiler
- Deploying database objects from development/testing environment to production environment
- Worked with SQL Server 2000 DTS.
- Imported Data from text files and excel spread sheets into SQL Server 2000 database using DTS
- Was available for support 24/7
Environment: SQL server 2000, Windows 2000, MS Office.