Lead Data Stage Consultant Resume
San Antonio, TX
SUMMARY
- Seven Years of experience in Analysis, Design, Coding, Testing and Production support in Enterprise Data Warehouse and Data Conversion. Currently working as a Senior ETL Developer, specialized in IBM Information Server.
- Experience in IT industry with developing, testing and maintaining applications in Data Warehouse using ETL tool IBM Web Sphere Data Stage and Ascential Data Stage
- Experience in Strategic Analysis, Design, Development, Maintenance, Testing and Implementation of Client/Server, Relational and Dimensional Modeling, Data Marts/ Data Warehouses and Business Intelligence Technologies using Relational Database Management Systems like Oracle, DB2 and SQL Server.
- Area of expertise encompasses Database designing, ETL phases of Data Warehousing. This is achieved with an emphasis on relational data modeling and dimensional data modeling for OLTP and OLAP systems.
- Strong working experience on Data Warehousing applications, directly responsible for the Extraction, Transformation and Loading (ETL) of data from multiple sources into Data Warehouse.
- Experience in design and implementation of Star, Snowflake schemas and multi - dimensional modeling.
- Experience in integration of various data sources like SQL Server, Oracle, MS Access and Flat Files into staging area.
- Experience in writing, testing and implementation of the Packages, triggers, Procedures, functions at Database level using PL/SQL.
- Strong knowledge of Extraction Transformation and Loading (ETL) processes using UNIX shell scripting, SQL Loader.
- Responsible for interacting with business partners to identify information needs and business requirements for reports.
- Designed and developed complex mappings.
- Worked with varied Stages like Lookup, Join Merge, Sort, Copy, Filter, Transformer, Aggregator and Funnel Stage.
- Extensive knowledge in handling slowly changing dimensions.
- Strong in Data warehousing concepts using Star Schema and Snowflakes methodologies
- Execution of test plans for loading the data successfully into the targets.
- Implemented Various Performance Tuning techniques on Sources, Targets, Mappings and sessions.
- Experience in Database Management, Data Mining, Software Development Fundamentals, Strategic Planning, Operating Systems, Requirements Analysis, Data Warehousing, Data Modeling, Data Marts.
- A versatile team player with strong programming and problem solving skills.
- Excellent communication and interpersonal skills and strong ability to perform as part of a team and individually.
TECHNICAL SKILLS
ETL: Ascential Data Stage PX/EE 9.1/8.1/7.5.2/7.1. A/6.0/5.x (Manager, Designer, Director, Parallel Extender, Quality Stage7.5/Integrity, SSIS
Business Analysis: Functional Requirements Gathering, User Interviews, Business Requirements Gathering, Process Flow Diagrams, Data Flow Diagrams, Data Analysis, Requirements Analysis, Design, Data Modeling, Data Architecture, Data Flow, Data Cleansing
Dimensional Data Modeling: Dimensional Data Modeling, Data Modeling, Star Join Schema Modeling, Snowflake Modeling, FACT and Dimensions Tables, Physical and Logical Data Modeling, ERWIN 6.1.0/4.5/4.0/3.5 , Oracle Designer.
Data Cleansing: XML,SQL Scripts, PERL scripting and Unix Scripts
Data Modeling: Erwin 4.0, Designer 2000, Star Schema, Snowflake Schema
Reporting Tools: OBIEE 10.1.3.4/.3 , .2, BI Apps 7.9.6/7.9.5
RDBMS: Oracle 10g/9i/8i/8.0/7.x, IBM DB2 UDB 8.0/7.0, MS SQL Server 2005/2000/7.0/6.0 ,, Teradata V2R6/V2R5/V2R3, MS Access.
Operating Systems: Sun Solaris 2.6/2.7, HP-UX 10.20/9.0, IBM mainframe Environment, IBM AIX 4.2/4.3, MS DOS 6.22, Win 3.x/95/98, Win NT, Red Hat Linux, Sun-Ultra,, SCO Unix, HP9000, RS6000, Win 3.x/95/98, Win 2000, Win XP. MS-Dos
PROFESSIONAL EXPERIENCE
Confidential, San Antonio, TX
Lead Data Stage Consultant
RESPONSIBILITIES:
- Interacted with Business Analysts to finalize the requirements and documented the technical design document for Coding.
- Developed Data Stage Parallel Jobs using required stages, and the data obtained from different sources is formatted, Cleansed, summarized, aggregated, transformed and loaded into data warehouse.
- Involved in design and development of parallel jobs, sequences using the Designer.
- Work on creating mapping documents from the business requirements and designed the ETL Specification Documents.
- Design and develop Data Stage jobs for Loading Data from different sources like Flat Files, and various data bases like MS SQL server and complex flat files into Data Warehouse applying business rules and standard validations.
- Design and develop Data Stage jobs for cleansing incoming data into Common data specifications and used Quality Stage for matching different data applying business rules which consisted of data loads and data cleansing.
- Design and develop Data Stage jobs to load Dimension and Fact Tables for different Data Marts based on the granularity of the data extracted from different sources.
- Develop Data Stage jobs to extract, transfer and load the data to populate different dimension tables, fact tables in the daily and monthly marts.
- Extensively used all the stages of Data Stage like Column Import, Transformer, Copy, Modify, Peek, Sort, Row Generator and Remove Duplicates.
- Deploy Data Stage Jobs and fine-tuned them by implementing best practices, Environment Variables, parameters and following Naming Standards, Parameterize the variables from Global Environment to stage level.
- Monitoring the daily batch process and fixing any issues that arise during the process.
- Working on return to business work by implementing any new business rules to provide data for the business users.
- Working on data integration and migration from IBM Data Stage to Microsoft SSIS.
- Responsible for off shore delivery team, coordinating with 3 off shore resources on a day to day basis and make sure they deliver on time.
Environment: IBM Web Sphere Data Stage 8.5, SSIS, Windows XP, MS SQL Server 2012 R2/2008 R2, JD Edwards (JDE 9.0), Flat Files, Active Batch V9, Windows Server 2008, Micro Strategy.
Confidential, San Antonio, TX
Sr. Data Stage Developer
RESPONSIBILITIES:
- Participate in all phases including Requirement Analysis, Design, and Coding, Testing, production support and Documentation.
- Worked on creating mapping documents from the business requirements and designed the ETL Specification Documents.
- Design and develop Data Stage jobs for Loading Data from different sources like Flat Files, and various data bases like Oracle, Netezza, DB2, MS SQL server and complex flat files into Data Warehouse applying business rules and standard validations.
- Design and develop Data Stage jobs for cleansing incoming data into Common data specifications and used Quality Stage for matching different data applying business rules which consisted of data loads and data cleansing.
- Design and develop Data Stage jobs to load Dimension and Fact Tables for different Data Marts based on the granularity of the data extracted from different sources.
- Develop Data Stage jobs to extract, transfer and load the data to populate different dimension tables, fact tables in the daily and monthly marts.
- Develop Data Stage jobs for the different Vendors like LMS, Success Factors, My Helper and also provide Audit files for data integrity and some extract files for the end users.
- Extensively used all the stages of Data Stage like Column Import, Transformer, Copy, Modify, Peek, Sort, Row Generator and Remove Duplicates.
- Deploy Data Stage Jobs and fine-tuned them by implementing best practices, Environment Variables, parameters and following Naming Standards, Parameterize the variables from Global Environment to stage level.
- Extensively used Borland star team to migrate Data Stage objects from development to test, prodQA and eventually Prod environments.
- Using ControlM for running and scheduling the Data Stage jobs using the Pre and Post scripts.
- Monitoring the daily batch process and fixing any issues that arise during the process.
- Working on preventative, adaptive and small modification work by implementing any new business rules to provide data for the business users.
- Worked on data stage migration from 8.1 to 9.1.
Environment: IBM Web Sphere Data Stage 7.5/8.1/9.1, PeopleSoft HRMS 9.1, PeopleSoft EPM 8.9, Red Hat Linux 4.0, Windows XP, Oracle 10g/11g, TOAD, SQL Developer, Flat Files, Borland Star Team, Windows Server 2008, MS SQL Server, DB2.
Confidential, Topeka, KS
Sr. Data Stage Developer
Responsibilities:
- Involved in understanding the scope of application, present schema, data model and defining relationship within and between the groups of data.
- Interaction with the business users to better understand the requirements and document their expectations, handling the current process, modifying and created the jobs to the updated requirements, handle the load process to data mart and eventually data warehouse.
- Used the Ascential Data Stage 8.1 extensively to transfer and load data into the staging area and eventually into Warehouse.
- Worked with various Stages like LOOK UP, JOIN, SLOWLY CHANGING DIMENSION, FUNNEL, FILTER, ROW GENERATOR, COLUMN GENERATOR, REMOVE DUPLICATES, and COMPLEX FLAT FILE etc.
- Extensively used the Sequential File Stage, Dataset Stage, File set Stage, Modify Stage, and Look-up, transformation and other Database plug-ins and the stage provided by the Data Stage to perform transformation and load the data.
- Participated in Unit testing, Functional testing and Integration testing and provided process run time
- Designed Mappings between sources to operational staging targets, using Star Schema, Implemented logic to Slowly Changing Dimensions.
- Provide the staging solutions for Data Validation and Cleansing with Quality Stage and DataStage ETL jobs.
- Designed Quality Stage Jobs in order to perform data Cleansing using Investigate Stage, Standardize Stage, Match Frequency, Survive, Reference match Stage.
- Designed a job template that provides the Environmental parameters for the subsequent use in the projects.
- Extensively worked with DataStageJob Sequences to Control and Execute DataStage Jobs and Job Sequences using various Activities and Triggers.
- Extensively used Microsoft Visio for documentation and control m to schedule the jobs.
- Worked with Business users to fix defects and implemented the best practices for conducting best UNIT TESTING and INTEGRATION TESTING and documenting the test results for USER ACEPTENCE.
Environment: IBM Data Stage Web Sphere 8.1, IBM-AIX, DB2, Oracle 11g,UNIX, Control-M, SQL plus.
Confidential, Rayleigh, NC
Data Stage Consultant
Responsibilities:
- Interacted with Business Analysts to finalize the requirements and documented the technical design document for Coding.
- Developed DataStage Parallel Jobs using required stages, and the obtained data from different sources were formatted, Cleansed, summarized, aggregated, transformed and loaded into data warehouse.
- Involved in design and development of parallel jobs, sequences using the Designer.
- Designed several parallel jobs using Sequential File, Dataset, Join, Merge, Lookup, Change Apply, Change Capture, Remove duplicates, Funnel, Filter, Copy, Column Generator, Peek, Modify, Compare, Oracle Enterprise, Surrogate Key, Aggregator, Transformer, Row Generator stages.
- Extensively worked with all the new features in IBM information Server.
- Worked with SCD stage for implementing slowly changing dimensions.
- Involved in the installation of IBM Information Server.
- Tuned DataStage jobs for better performance by creating DataStage Lookup files for staging the data and lookups.
- Used the Manager to import, export jobs and routines.
- Created Shared Containers to increase Object Code Reusability and to increase throughput of the system.
- Extensively worked with subject areas like “Location”.
- Experience developing complex transformations, surrogate keys, routines, dimension tables and fact tables.
- Used Environment Variables, Stage Variables and Routines for developing Parameter Driven Jobs and debugging them.
- Data staging of the ETL solutions from different source systems to target database.
- Involved in the identification of Facts and dimensions table for developing logical design of the data marts.
- Performed extraction, transformation and loading of data using different types of stages and by performing derivations over the links connecting these stages.
- Designed the job templates and created new jobs from existing templates.
- Enhanced the Job Performance by using proper Partitioning methods and analyzing the resources utilized using Job Monitor.
- Created Master Job Sequencers to control sequence of Jobs using job controls.
- Used Data Stage Director for running and monitoring performance statistics.
- Created Test Plans for Unit Testing for designed jobs.
Environment: IBM-Ascential Data Stage 8.0.1 (E.E), Erwin 4.2, Oracle 9i/10g, TOAD, UNIX- AIX, MS Word, Excel, Citrix, Clear case, Autosys, Clear Quest.
Confidential, Des Moines
Data Stage Developer
Responsibilities:
- Used Parallel Extender for distributing load among different processorsby implementing pipeline and partitioning of data in parallel extender.
- Involved in Designing Parallel Extender Jobs.
- Worked with Business customers to identify the different sources of data in operational systems and developed strategies to build data warehouse.
- Preparation of technical specification for the development of Extraction, Transformation and Loading (ETL) jobs to load data into various tables in Data marts.
- Used Parallel Extender for distributing load among different processors by implementing pipeline and partitioning of data.
- Used COBOL programs to extract and transform data from the mainframes and create a load ready file.
- Developed JCL Jobs and scheduled jobs to execute COBOL programs to extract data from Mainframe
- Developed several complex Data Stage jobs for loading Participants to the data warehouse.
- Provide technical support to team members for Design and developing Data stage Jobs.
- Extensively used Parallel Stages like Join, Merge, Lookup, Filter, Remove Duplicates, Funnel, Row Generator, Modify, Peek etc. for development and de-bugging purposes.
- Used DataStage Director and the runtime engine to schedule running the server jobs, monitoring scheduling and validating its components.
- Used Quality Stage to profiling, standardization, matching and survivorship.
- Used Basic Routines to pass values from Sequencer to jobs in runtime.
- Coded Parallel Routines in C++ to cleansing and format data in Transformer.
- Extracting data from legacy mainframe operation systems, transferring the data to AIX platform, loading the data into Data Marts using complex flat file Stage.
- Worked with Business users to fix defects and implemented the best practices for conducting best UNIT TESTING and INTEGRATION TESTING and documenting the test results for USER ACEPTENCE.
- Created Oracle Stored Procedures for create partition on target table and Rebuild index for performance tuning.
- Used Control-M to Schedule jobs in SAT, PERFORMANCE and PROD Environments.
- Developed korn Shell scripts to automate file manipulationand FTP files.
Environment: IBM Web Sphere Data Stage 8.1/7.5.2 EE (Parallel Extender, Designer, ManagerDirector), Oracle 10g, DB2UDB, SQL, PL/SQL, Shell Scripting, COBOL, MVS, DB2, UNIX, Control-M, PVCS
Confidential, Cleveland, Ohio
Data Stage Developer
Responsibilities:
- Attended development phase meetings for Business Analysis and Requirements Gathering.
- Created Data Stage jobs, batches and job sequences.
- Developed Architecture for building a Data warehouse by using data modeling tool Erwin.
- Worked on programs for scheduling Data loading and transformations using Data Stage from legacy system to Oracle 10g using SQL* Loader and PL/SQL.
- Designed and Developed PL/SQL Procedures, functions, and packages.
- Worked with Data Stage Manager for importing metadata from repository, new job Categories and creating new data elements.
- Wrote shell scripts for Data Acquisition as a part of ETL process.
- Created jobs and analyzed scope of application, defining relationship within & between groups of data, star schema and more.
- Identified suitable dimensions and facts table for schema.
- Created and loaded data warehouse tables like dimensional, fact and aggregate tables using Ascential Data Stage.
- Used Job Control routines and Transform functions in the process of designing the job.
- Scheduled the jobs via the Autosys.
- Wrote Extensive UNIX scripts for running the Data Stage jobs.
- Tuned Data Stage jobs to enhance their performance.
- Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions.
Environment: Data Stage 7.5, Oracle 10g, UNIX, Data Stage Version Control, Oracle Developer.
Confidential, Phoenix, AZ
Data stage Developer
Responsibilities:
- Participated in all phases including Requirement Analysis, Design, Coding, Testing, Support and Documentation.
- Worked on creating mapping documents from the business requirements and designed the ETL Specification Documents.
- Designed and developed Data Stage jobs for Loading Data from different sources like COBOL Files, Flat Files, VSAM files and complex flat files into Data Warehouse applying business rules and standard validations.
- Designed and developed Data Stage jobs for cleansing incoming data into Common data specifications and used Quality Stage for matching different data applying business rules which consisted of data loads and data cleansing.
- Designed and developed Data Stage jobs to load Dimension and Fact Tables for different Data Marts based on the granularity of the data extracted from different sources.
- Developed Data Stage jobs for the different Dimension Tables such as Practitioner, Institution, Payer dimensions, Prescriber, Territory Manager.
- Developed Data Stage jobs for the different Vendor Files in the Facts Tables.
- Extensively used the Confidential built customized stages such as Parallel Reader, Parallel Writer, Concurrent Reader and Logger Read for developing the Data Stage jobs.
- Extensively used all the stages of Data Stage like Column Import, Transformer, Copy, Modify, Peek, Sort, Row Generator and Remove Duplicates.
- Designed, developed and deployed Data Stage Jobs and fine-tuned them by implementing best practices, Environment Variables and following Naming Standards, Parameterize the variables from Global Environment to stage level.
- Used Orbiter for running and Nexus for scheduling the Data Stage jobs using the Pre and Post scripts.
- Maintained the Designs, Code Modifications, Enhancements and tracking of the Metadata using Source Forge.
Environment: Data Stage 7.5,IBM Web Sphere (Formerly Ascential) Data Stage 7.5, Parallel Extender, Red Hat LINUX 7.3,Oracle 10g, Windows XP.