We provide IT Staff Augmentation Services!

Sr . Datastage Consultant Resume

5.00/5 (Submit Your Rating)

SUMMARY:

  • Total 8 years of experience in Data warehouse Design, Development and Testing using ETL and Data Migration life cycle using IBM WebSphere DataStage 8.x/7.x
  • Extensive ETL tool experience usingIBM Infosphere/Websphere DataStage, Ascential DataStage.
  • Worked on DataStage tools likeDataStage Designer, DataStageDirector and DataStage Administrator.
  • Efficient in all phases of the development lifecycle, coherent with Data Cleansing, Data Conversion, Performance Tuning and System Testing.
  • Worked extensively withDimensional modeling,Data migration,ETL Processes for data warehouses.
  • Developed parallel jobs using different processing stages likeTransformer, Aggregator, Lookup, Join, Sort, Copy, Merge, Funnel, CDC, Change Apply and Filter.
  • UsedEnterpriseEdition/Parallel stageslike Datasets, Change Data Capture, Row Generator and many other stages in accomplishing the ETL Coding.
  • Experience in working in Dimensional Database modeling, Star Schema modeling, Snowflake modeling, Fact tables, Dimension tables, OLAP, Performance tuning.
  • Efficient in in corporation of various data sources such as Oracle, MS SQL Server, and DB2, Sybase, XML and Flat files into the staging area.
  • Experience in Mapping Server/parallel Jobs in DataStage to populate tables in Data warehouse and Data marts
  • Proven track record in addressing production issues like performance tuning and enhancement.
  • Strong in Data warehousing concepts, dimensional Star Schema and Snowflakes Schema methodologies
  • Expert in unit testing, system integration testing, implementation, maintenance and performance tuning Experience in different Scheduling tools like AutoSys for automating and scheduling jobs run.
  • Experience in writing shell scripts.
  • Involved in providing production support to various Data warehouse projects and Extensive experience in ETL source to target mapping.
  • Detail oriented with good problem solving, organizational, analysis, highly motivated and adaptive with the ability to grasp things quickly.
  • Ability to work effectively and efficiently in a team and individually with excellent interpersonal, technical and communication skills.

TECHNICAL SKILLS:

ETL Tools: Datastage XE 11.3/9.1/8.5/8.1/7.5/7.1 (Datastage Designer, Datastage Director, Datastage Manager Parallel Extender/Orchestrate, Quality Stage, Information Analyzer)

OLAP Tools: Business Objects 6.1/5.1/5.0/4.1 (Supervisor, Designer, BO Reporter, WEBI, BCA, Info View)

Databases: Oracle 10g/9i/8i, IBM DB2/UDB, Teradata, SQL Server 2003/2005/2008.

Tools:: SQL*Plus3.3/8.0, SQL*Loader

Operating Systems: Windows 7x/NT/XP, UNIX, LINUX, Solaris, MS - DOS,MS Access

ProgrammingLanguages: SQL, PL/SQL, Unix Shell Scripting

Testing/Defect Tracking: HPQualityCenter, Test Director, Bugzilla

PROFESSIONAL EXPERIENCE:

Confidential

Sr . DataStage Consultant

Responsibilities:

  • Loading Members related data for various applications into the DB2 Enterprise Data Warehouse and MS SQL server is the goal of the project. This involved, pulling in data from various source systems like Flat Files, Oracle, DB2 and loading the target to data warehouse.
  • Involved in designing the simple to complex DataStage jobs.
  • Involved in Design Development and Deployment of DataStage Server jobs.
  • Used stages like sort, aggregator, transformer, link collector, link partitioner, pivot, FTP stage, etc.
  • Involved in building the base fact tables, aggregate fact tables, dimension tables, Data mart tables, change requests and defect issues related to the Data Warehouse project.
  • Involved in the technical development delivery strategy packages that include technical design, development and testing phase.
  • Effectively used DataStage Manager to Import/Export projects from development server to production server and implemented Slowly Changing Dimension techniques.
  • Created and executed SQL queries for validating transformation rules used in source to target mappings.
  • Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on a scheduled basis.
  • Developed Job Sequences, job activities, execute commands, user variable activity and implemented logics for job sequence loops, recovery and restart.
  • Identified performance bottlenecks and suggested improvements.
  • Used Quality Stage to ensure consistency, removing data anomalies and spelling errors of the source.
  • Responsible for daily verification that all scripts, downloads, and file copies were executed as planned, troubleshooting any steps that failed, and providing both immediate and long-term problem resolution.

Environment: IBM Web Sphere DataStage 8.7 Parallel Extender, Web Services (Designer, Director, Manager), Oracle,DB2, UNIX, Windows, IBM Tivoli, SVN.

Confidential

Sr. DataStage Consultant

Responsibilities:

  • Worked closely with data modeling team to prepare the mapping documents and database team to understand the business process of the data warehouse model.
  • Worked with various subsystems of Medicaid and Medicare Information System such as Claims, Client, Provider, Drug Rebate, TPL, EPSDT, Managed Care and PA.
  • Analyzed the given source and target table structures to create Surrogate Key for required dimensions as per Type 1 and Type 2 scenarios.
  • Developed DataStage jobs, sequencers, routines and mentored developers on DataStage.
  • Dealt with different Stages, which includes Sequential File, Dataset, Complex Flat File, XML Input, XML Output, Copy, Peak, Lookup, Join, Transformer, Sort, Aggregator, Remove Duplicate, Filter, Column Export, Row Generator, SK Generator, SCD, CDC, Funnel, Oracle OCI, and RDBMS Stages.
  • Extensively worked with Quality stage to standardize data by trimming the spaces, removing nonprinting characters, incorrect spellings using transfer, parse, collapse, select, unijoin and build stages.
  • Prepared Unit test plans and performed unit testing.
  • Involved in release process, which include exporting jobs, preparing release notes, uploading the code to Rational Clear case, importing jobs to test environment and compiling using multi job compiling option in the DS Manager.
  • Used Clear quest for repository, reporting bugs, tracking bugs and updates on resolved bugs.
  • Used Clear case for Version Control. Each version of the application is stored in Clear case and necessary modifications, updates and analysis had been done.
  • Worked on analyzing the tickets from the QA and reassigning to the concerned developers
  • Involved in troubleshooting, Performance tuning and Performance monitoring.
  • Effectively worked with tuning SQL queries and Procedures in order to improve the performance of the jobs
  • Involved in writing UNIX shell scripts to automate the business process.
  • Worked with IBM support to fix various bugs by applying the patches in the DataStage Client machines.
  • Extensively worked in bug fixing with various issues during Integration and User Acceptance Testing and worked for on call support to provide immediate fixes.
  • Participated in Daily &Weekly status meetings, and conducting internal and external reviews as well as formal walkthroughs among various teams, and documenting the proceedings.

Environment: IBM Information Server Websphere DataStage 11.3/8.01/EE 7.5.2(Ascential DataStage), Oracle 10g/11i, Toad 9.1, Flat Files, XML, SQL, PL/SQL, Rational Clear Case &Clear Quest, Sun Solaris 5.10

Confidential

ETL Consultant

Responsibilities:

  • Designed and developed various new processes, Fixed the existing process with new business requirements, and meetings with users for Input.
  • Designed and developed jobs for extracting, transforming, integrating, and loading data into data mart using DataStage Designer
  • Developed, executed, monitored and validated the ETL DataStage jobs in the DataStage designer and Director Components.
  • Worked with DataStage Director to schedule, monitor, analyze performance of individual stages and run DataStage jobs.
  • Worked on Teradata database used Teradata API stage with user defined SQL, Teradata Enterprise stage and Teradata Multiload stage.
  • Responsible for UNIT, System and Integration testing. Developed Test scripts, Test plan and Test Data.
  • Extensively used change capture, Transformer, Modify, copy, Join, Funnel, Aggregator, Lookup Stages and development stages to develop the parallel jobs.
  • Generated Surrogate Keys for composite attributes while loading the data into Data Warehouse using Key Management functions.
  • Involved in writing scripts for loading data to target data warehouse for Bteq, fastload, and multiload.
  • Developed Job Sequencer and batches and have edited the job control to have jobs run in sequence.
  • Developed user defined Routines and Transformations for implementing Complex business logic.
  • Imported Metadata from Oracle database. Imported metadata definitions into the repository. Exported and imported DataStage components.
  • Involved in the preparation of ETL documentation by following the business rule, procedures and naming conventions
  • Performed Troubleshooting and Tuning of DataStage Jobs for better query performance.
  • Reviewing the developed jobs based on the build review checklists.

Environment: IBM Infosphere DataStage 8.1/8.5Citrix, Director, Control-M Scheduling, Oracle, Teradata and UNIX, HP QC

Confidential, Wilmington, DE

DataStage Developer

Responsibilities:

  • Involved in the analysis, data modeling, detailed system design, development and technical documentation.
  • Used DataStage Designer to develop various jobs to extract, transform, integrate and load data into data warehouse database.
  • Developed several transformations in the process of building Data warehouse database.
  • Worked on retrieving data from different legacy systems such as Oracle, DB2.
  • Used Lookup transformations to manipulate the information.
  • Interacted with User Groups/ Corporate Testing Groups/Business people.
  • Developed shell scripts to automate file manipulation and data loading.
  • Involved in Performance Tuning of Parallel Jobs using Performance Statistics.
  • Extensively worked with database objects including tables, views, indexes, schemas, stored procedures, functions, and triggers.
  • Used the Director to schedule running the job, testing and debugging its components, and monitoring.
  • Used Autosys to schedule jobs.
  • Involved in Unit Testing of the jobs.
  • Created Shell scripts for scheduling various Batch jobs.
  • Used configuration management tools like Clear Case/Clear Quest for version control and migration.
  • Ran jobs using Parallel Extender for splitting bulk data into subsets and dynamically distribute to all available nodes to achieve best job performance
  • Used Quality Stage to ensure consistency, removing data anomalies and spelling errors of the source.
  • Created Data Model using Erwin from data sources and defined the dimensions, levels and measures in the model.
  • Actively participated in the Team meetings to gather the business requirements and developing the Specifications & Unit Test Cases
  • Used SQL Loader, Bulk Loader, and DB2 Auto Loader for dealing with bulk data loading to the database
  • Used WINSQL to access DB2 database

Environment: IBM Web sphere DataStage 8.0.1, IBM AIX 5, Oracle 9i, MS Visio, MS Project, SQL Server Management Studio, Business Intelligence Integration Services and Analysis Services.

Confidential

Application Systems Engineer

Responsibilities:

  • Data Analysis, to study the data base data that is required for the different source system.
  • Data model review with the client, because the model was given by the client.
  • Erwin was used to create the Logical and physical data model
  • Involved in understanding the scope of application, which was already implemented, and for new development.
  • Involved in the Architecture review.
  • Involved in the high level design (ETL design Plan) & low level design (Mapping Docs).
  • Used DataStage designer to create mappings to load various dimensions that include Products, Product Categories, Coverage Type, Coverage Level, and Risk Level Dimensions.
  • Involved in Creating Jobs, Hash files, sort, and transformer, Lookups, Run, and Monitor Using the DataStage director.
  • Used XML Input stage for the extracting the data and XML transformer to load the data to the staging area.
  • Used Version Control to back up the source code.
  • Quality Stage was used to standardize/integrate the data from different sources.
  • Reviewing the Report design and improving the query for the performance.
  • Used the Broadcast agent to broadcast the report.
  • Used Control M for scheduling the jobs.
  • Unit testing of the Jobs developed.
  • Use Quality stage to Standardize match and correct the data.
  • Coordinating with all onsite technical professionals and Project Manager.

Environment: Data Stage 7.x, HP UNIX, Oracle 9i, Control M

We'd love your feedback!