Sr. Data Warehouse Developer (datastage) Resume
Round Rock, TX
SUMMARY
- Highly competent Datastage Developer/Consultant with over 7 years of profound IT experience in Design, Development and Implementation of Relational Database and Data Warehousing Systems using IBM InfoSphere Information Server 9.x/8.x (DataStage, QualityStage), IBM DataStageEnterprise and AscentialDataStage7.x Client - Server environment.
- Experience in the Analysis, Design, Modeling, Development, Implementation and Testing of Data Warehousing applications.
- Good Knowledge about the principles of DW like Data marts, OLTP, OLAP, Dimensional Modeling, fact tables, dimension tables and star/snowflake schema modeling.
- Excellent in using highly scalable parallel processing infrastructure using parallel jobs with multi-node configuration files.
- Experienced in scheduling sequence, parallel and server jobs using DataStage Director, UNIX scripts and scheduling tools.
- Experience in using different types of stages like Transformer, Aggregator, Merge, Join, Lookup, Sort, copy, Remove duplicate, Funnel, Filter, Pivot, Shared containers for developing jobs.
- Experience in Working and Design and populated dimensional model (star and snowflake schema) for a Data warehouse and data marts and Reporting Data Sources.
- Excellent in using highly scalable parallel processing infrastructure using parallel jobs with multi-node configuration files.
- Experienced in scheduling sequence, parallel and server jobs using DataStage Director, UNIX scripts and scheduling tools.
- Diverse knowledge of data dependencies using Metadata of DataStage and preparing job sequences for existing jobs to facilitate scheduling of multiple jobs.
- Excellent work experience in AGILE project methodology and development.
- Hands on experience in creating Indexed Views, complex Stored Procedures, effective functions, and appropriate Triggers to assist efficient data manipulation and data consistency.
- Strong knowledge ofRelational Database Management Systems (RDBMS) conceptin several databases like SQL Server 2008/2005 and Oracle 10g/9i/8i.
- Worked on activities related to the development, implementation, administration and support of ETL process for large-scale Data Warehouses using SSIS, DataStage.
- Involved in complete Software Development life-cycle (SDLC) of various projects, including requirements gathering, system designing, data modeling, ETL development, production enhancement, support and maintenance.
- Creating data mappings and data dictionaries and understanding business data relationships.
- Experience in working with Server jobs, Parallel jobs, debugging, troubleshooting and performance tuning.
- Experience in various phases of IT projects Software Development Life Cycle (SDLC) such as analysis, design, construction and testing, deployment and production support.
- Implemented the complex business rules by creating reusable transformations and Mappings / Mapplets.
- DesignedDataStageJobs to extract data from XML files using XML input stage, Used XML transformer stage to cleanse and transform the data to load it into the Data Mart.
- Effective leadership skills with good written, verbal communication and presentation skills. Self-motivated with result oriented approach. Committed collaborator and team leader.
TECHNICAL SKILLS
Databases: MySQL, Teradata 12, DB2, MS SQL Server 2000/2005/2008
ETL: IBM WebSphere DataStage 8.5/ 8.0.1/7.5/ 7.1 (Designer, Director, Manager, and Administrator), MetaStage 6.0/ QualityStage, Parallel Extender 6.0, Orchestrate, Information Analyzer/ProfileStage, and Informatica 7.x/6.x..
Languages: SQL, PL/SQL, Unix Shell Scripting, HTML, VB, Java Script
Tools: Toad, Teradata SQL assistant, MS Office, Erwin 4.1
Operating Systems: Windows 98/NT/2000/XP/8, UNIX (Sun Solaris 5.9, HP-UX, LINUX)
Scheduling Tools: Autosys, Control-M
PROFESSIONAL EXPERIENCE
Confidential, Round Rock TX
Sr. Data Warehouse Developer (Datastage)
Responsibilities:
- Worked with the Business analysts and the DBA’s for requirements gathering, analysis, testing, and metrics and project coordination
- Successfully implemented the slowly changing dimensions. Involved in the Dimensional modeling of the Data warehouse. Involved in designing various jobs using PX
- Created and populated Data Warehouse structures using DataStage
- Developed documents like Source to Target mapping for developing the ETL jobs
- Populated Data Marts at different levels of granularity for the inside Customers using DataStage (being executed from shell scripts driven by Autosys)
- Worked with DataStage server stages like OCI, ODBC, Transformer, Hash file, Sequential file, Aggregator, Sort, Merge, Link Partitioner, Link collector, IPC and other stages
- Designed and coded high performance DataStage routines
- Imported the required Metadata from heterogeneous sources at the project level
- Developed Parallel jobs using Parallel stages like: Merge, Join, Lookup, Transformer (Parallel), Teradata Enterprise Stage, Funnel, Dataset, Oracle Enterprise Stage.
- Performed debugging on these jobs using Peek stage by outputting the data to Job Log or a stage
- Worked on programs for scheduling Data loading and transformations using Data Stage from legacy system and Data Warehouse to Oracle 9i.
- Wrote the SQL queries & PL/SQL code tables and Data Mart Staging Tables to validate the data results by counting the number of rows in both the tables.
- Developed UNIX shell script to run jobs in multiple instances by using a parameter file.
- Interacted with Solutions analysts, system staff, ETL, BO developers and the data load staff.
- Involved in Unit, Integration, System and User Acceptance Testing (UAT).
Environment: DataStage Parallel Extender 8.X (Designer, Manager, Director), Oracle 10g, SQL/PLSQL, Teradata SQL Assistance 7.0, Erwin 4.0 and Windows NT/2000
Confidential, Des Moines, IA
DataStageDeveloper
Responsibilities:
- Involved in all phases of Project Life cycle: Requirements gathering, Development, Testing, and Production Support.
- Coordinated with business users at the time of requirements gathering and helped in developing the Application Design Document.
- Created design, source to target mapping documents according to client standards.
- Developed DataStage code to process the customer membership feed from which comes in flat file format and change it in to XML and send it to downstream.
- Coded generic job that extracts data from flat file and creates standard XML formatted files and send it to the destination servers via Connect Direct and MQ connector.
- Developed Technical Design Documents that help developers to start coding.
- Extensively worked with Shared Containers for Re-using the Business functionality.
- Created job parameters and Environment variables to run the same job for different schemas.
- Involved in Unit testing of the code and coordinated with the testing team, Integration team and the User acceptance team.
- Involved in debugging of existing jobs that had different sources like Complex Flat Files, XML files and Databases.
- Export and Import jobs between different environments via packages and versioning the code using InfoSphere Information server Manager.
Environment: IBM InfoSphere Information Server 9.1/8.1,Unix, SQL Server, DB2, Flat Files, XML, Toad, ESP, Job Control and ALM
Confidential, Chicago, IL
IBM DataStage Developer
Responsibilities:
- Used the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Analyzed the performance of the jobs, project and enhance the performance using standard techniques.
- Designed several parallel jobs using Sequential File, Dataset, Join, Merge, Lookup, Change Apply, Change Capture, Remove duplicates, Funnel, Filter, Copy, Column Generator, Peek, Modify, Compare, Oracle Enterprise, Surrogate Key, Aggregator, Transformer, Decode, Row Generator stages.
- Extensively worked with Join, Look up (Normal and Sparse) and Merge stages.
- Extensively used the CDC (Change Data Capture) stage to implement the slowly changing Dimensional.
- Migrated projects from 8.5 to 8.7.
- Extensively worked with Job sequence stage such as Job Activity, Email Notification and Sequencer Wait for File activities to control and execute the Data stage Parallel jobs.
- Providing effort estimates depending on the design complexity.
- Creating server and parallel jobs using Data stage Designer to perform the ETL operations.
- Transfer of large volumes of data using Teradata Fast Export, Multi Load
- Maintaining and coordinate with off shore team. Migrated jobs from development to QA to Production environments.
- Performed Unit testing and Integration testing in testing environment
Environment: IBM Info Sphere Data Stage 8.7/8.5, Oracle 10g,Teradata, DB2 UDB, UNIX, MSOffice Suite, Erwin, MS Visio, PL/SQL, SQL Server, Toad, flat files.
Confidential, Dallas, TX
DataStage Developer
Responsibilities:
- Involved in the design and development of Data Warehouse.
- Worked closely with data modeler and database administrator to understand the business process and participated in gathering of business requirements to build the data warehouse model.
- Design the Data Mart model with Erwin using Star Schema methodology.
- Worked extensively with Parallel Extender using Parallel Processing (Pipeline and partition parallelism) techniques to improve job performance while working with bulk data sources.
- Extensively used Parallel Job Stages like Stored Procedure, Dataset/File set, Lookup File set, Aggregator, Join, Transformer, Sort, Merge, Filter, FTP, Lookup, Head, Tail and Pivot.
- Used Job Sequencer stages to link multiple jobs in Series/Parallel based on the requirement.
- Used partition key in Parallel Extender job for bulk loading of data and to get better performance.
- Used the DataStage Designer to develop processes for extracting, cleansing, transforms, integrating and loading data into data ware house database.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
- Implemented shared containers for multiple jobs, which have the same business logic.
- Extensively used Shell Scripts to trigger the DS jobs through a Master Sequencer.
Environment: IBM WebSphere Data Stage 8.0.1, Teradata, Oracle 9i/10g, PL/SQL, IBM DB2/UDB 8.x, UNIX Shell Scripts, SQL Developer, Teradata SQL Assistant.
Confidential
ETL DataStage Developer
Responsibilities:
- Involved in functional meetingswith business users to gather requirements and worked with business to sign-off the requirement.
- Extensively worked on designing the ETL process and creating source to target mapping.
- Extensively worked onbuilding dimension tableslike Customer, Store, Product, and Time etc.
- Extensively used DataStage Director to run, schedule, monitor and reset DataStage and QualityStage jobs.
- Worked on Change capture stage and Slowly Changing Dimension (SCD) stage.
- Extensively worked on extracting data from PeopleSoft HR data into EDW.
- Extensively worked onbuilding ETL jobsto extract and load data into PeopleSoft EMP (EMP OWS, OWE and MDW).
- Extensively worked with People Tools.
- Worked on customizing EPM ETL jobs as per the client requirements.
- Processed Sales and transaction counts to identify a primary store for commercial customers.
- Used DataStage Designed to create and compile jobs, importing/export objects.
- Worked on commercial customer data cleansing across the enterprise using Investigate
Environment: AscentialDataStage 7.5.2, IBM DB2 9.1,Oracle 9i, PeopleSoft HRMS, PeopleSoft EPM 8.9, Windows XP