We provide IT Staff Augmentation Services!

Senior Data Stage Consultant Resume

0/5 (Submit Your Rating)

SUMMARY

  • 9 years of IT Experience in the analysis, design, development, implementation and testing of client/server applications. 9 years of experience implementing Confidential Websphere/Ascential Datastage as ETL tool in a Data warehouse environment.
  • Extensively involved in the development of Datastage ETL process for extracting data from different data sources, data transformation and loading the data into data warehouse for data mart operations.
  • Extensively worked on Confidential Infosphere Data Stage 9.1/8.7/8.1/8.0.1/7.5.2/7.1/6.0
  • In depth experience in dealing with Datastage stages (hash, ftp, merge, sort, aggregator, lookup etc.)
  • Worked and extracted data from various database sources like Oracle 11i/10g/9i/8i, DB2, Sybase, Sequential files and Flat files.
  • Extensive experience in Data Stage Job Sequence.
  • Strong knowledge in Software development life cycle.
  • Strong Knowledge in IT infrastructure.
  • Created table definitions and custom transforms using Datastage Manager.
  • Used Datastage Director to validate and run the Datastage jobs.
  • Used built in transforms and created custom transforms in Datastage.
  • Good Experience in Oracle, DB2, Sybase and Teradata.
  • Experience in writing, testing, and implementation of the triggers, procedures, functions at Database level and form level using PL/SQL.
  • Well versed with understanding/grasping complex table hierarchies and business models.
  • In depth knowledge of Dimensional Data Modeling, Star Schema, Snowflake.
  • Good Experience with Version Controls in Data Stage.
  • Involved in maintaining logical and physical models.
  • Experienced in UNIX Shell scripting (Korn, BASH, and CSH) as part of file manipulation, Scheduling and text processing.
  • Excellent Communication and Interpersonal skills. Versatile team player with proven problem solving skills.
  • Demonstrated strong technical writing skills. Proven ability to quickly learn new technologies.
  • Extensively worked on writing Jil Scripts to schedule Data stage jobs using Unix Scripts in Autosys.

TECHNICAL SKILLS

ETL Tool: Ascential Datastage V 9.1/8.7/8.1/8.0.1/7.5/7.1/7.0/6.0 , Quality Stage 8.0.1, SAPBW 3.1

RDBMS: Oracle 11i/10g/9i/8i, SQL Server 2005, SQL Server 2008, Confidential MDM, Sybase11, DB2UDB 9.1, SSIS, SSRS, SSAS, TeradataV2R5/V2R4.

Reporting Tools: Business Objects XI

Programming: SQL, PL/SQL, SQL *LOADER, SQL*Plus, Korn Shell Scripting.

Operating Systems: UNIX (HP - UX, Sun Solaris), Linux, Confidential - AIX, XP/2000/NT, Mainframe (MVS - OS/390)

Utilities: FastLoad, MultiLoad, Erwin, Toad, People soft, Edit plus.

PROFESSIONAL EXPERIENCE

Confidential

Senior Data Stage Consultant

Responsibilities:

  • Installed Confidential Info Sphere Data Stage version 9.1 in Windows Environment.
  • Created the Development, Test and Production Projects as well as Users for Data Stage.
  • Worked with Business Analysts to prepare ETL Mapping Documents and design documents.
  • Extensively Used Data Stage 9.1 to extract data from sources like Lawson, Huris and PeopleSoft through flat files and pipe delimited files, Transform it and Load into SAP.
  • Developed jobs in Parallel Extender PX using different stages like Transformer, Aggregator, Lookup, Join, Merge, Modify, Remove Duplicate, Funnel, Sort, Peek, Row Generator, Column Generator, Change Capture Stage, Pivot, Sequential File, Data Set, Oracle Enterprise and Oracle Connector and Sequence activities like UserVariables, Job Activity, Routine Activity, Execute Command, Nested Condition, Notification Activity, EndLoop Activity, StartLoop Activity and Terminator Activity.
  • Involved in Performance tuning to reduce the Process time of long running jobs.
  • Involved in Data validation, Peer code review and Document Updates.
  • Worked on modifying peer codes e.g. data stage codes, SQL scripts to meet the business requirements.
  • Extensively worked the role of Admin like Maintenance of server, Restarting the server, creating Projects and creating Users.
  • Having Good Knowledge on SAP Tables, Transactions as logged in to SAP and used some Transactions like SE16 to Access SAP tables and download.
  • Performed rigorous testing and created Test cases with all the scenarios that might occur with the incoming data and business logics implemented. Created new jobs in QA Environment to automate the process of Scheduling according to the requirements.
  • Provided End-Users Support including business queries and requests.
  • After UAT, responsible for installing these jobs into Production and creating trouble-shooting documentation, also responsible for carrying out any of the process upgrades required.
  • Worked on creating Technical Design documents for future use which included all the Technical information of the Data Stage Jobs Developed.

Environment: Confidential InfoSphere Data Stage 9.1, Oracle 11.6, SAP 4.6C, Jeera, Toad for Oracle 11.6.

Confidential

Data Stage Tech Lead

Responsibilities:

  • Designed Data Stage ETL jobs for extracting data from various source systems, transform it and create XML Files.
  • Developed Unix Scripts to ftp the files for Outbound and Inbound from ETL to RDM and Vice Versa.
  • Involved in development phase meetings for Business Analysis and Requirements document reviews.
  • Extensively worked on Dataset, Sequential File, Join, Merge, Look Up, Change Capture, Filter, Aggregator, Funnel, Column Generator, Peek, Remove Duplicates, Copy and Modify stages.
  • Was involved in fullintegrationtest of all jobs within each sequence beforemigratingthe sequences to the test project from dev project.
  • Responsible for the detailed design documentation. Responsible for specifications document that describe the functionality and design of each subject area.
  • Used Serena Dimensions Version Control and segregated the latest versions of updated jobs, sequences and unix scripts.
  • Worked with Autosys team to schedule the DS jobs using scripts on the Production Server.
  • Created different Config apt file for different jobs and used them as and when needed for different jobs by using job parameters.
  • Developed Error Logging and Auditing strategies for the ETL jobs.
  • Co-ordinated the deployments of code across test and production environments with the deployment teams.
  • Created shared containers to use in multiple jobs.
  • Written Unix Shell scripts to execute DataStage jobs on Unix Production servers.
  • Involved in Performance tuning of the ETL process and performed the data warehouse testing.
  • Worked on setting up the ssh keys between different servers to moves the files through sftp.
  • Created Autosys jil Scripts to call shell scripts with different parameters based on scenarios, which internally call Datastage jobs.
  • Worked on HP Quality Center for opening the Defects, tracking those and specifying the purpose of the defect.

Environment: Confidential Web sphere Data Stage 8.7, Confidential Info sphere Master data management, Autosys, UNIX, HP Quality Center 10 and Serena Dimensions.

Confidential

Data Stage Tech Lead

Responsibilities:

  • Extensively used DataStage Designer to extract, transform and load data from various operational sources like relational databases, application systems, temp tables, fixed width flat files.
  • Developed Scripts to ftp the files for Outbound and Inbound from SAP and to other interfaces.
  • Developed UNIX shell scripts to automate the Data Load processes to the Confidential .
  • Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions.
  • Developed jobs in Confidential InfoSphere Parallel Extender using different stages like Transformer, Aggregator, Lookup, Join, Merge, Modify, Remove Duplicate, Sort, Peek, Filter, Copy, Sequential File, Data Set, Surrogate Key Generator etc.
  • Involved in understanding the Requirements of the end Users/Business Analysts and developed Strategies for ETL processes.
  • Extensively wrote SQL Queries to get the required data from Abstraction Layer Tables.
  • Design, Develop and Unit Test Complex ETL jobs. Performance tuning of ETL jobs.
  • Worked with the Business partners to ensure the business requirements are met for specific data integration GIFT R2/3 projects.
  • Worked on BPMS Decommissioning to improve the performance of the batch which involves assigning the Business partners directly by SAP rather than going through BPMS System.
  • Restructured the Data stage jobs to enhance the Performance and clarity of the job and also sent the exact data to the downstream systems.
  • Worked on setting up the ssh keys between different servers to moves the files through sftp.
  • Extensively worked on running the Batch jobs for Policy Insured and Claims Master data as well as Premiums and Claims Transactions.
  • Lead the team of five developers and involved in the Development and Production support for GIFT R2/3 Projects.
  • Created Autosys jil Scripts to call shell scripts with different parameters based on scenarios, which internally call Datastage jobs.
  • Extensively worked with SAP Pack plug-ins: BAPI and ABAP which enable DataStage to communicate with SAP source systems.
  • Developed jobs and scripts which update the SAP Control Tables using BAPI for tracking the file systems.
  • Used PVCS which allows the users to extract the latest edition of the source code from a PVCS repository and to maintain the Versions.
  • Worked on HP Quality Center for tracking the Defects and specifying the Requirements.

Environment: Confidential Web sphere Data Stage 8.1, SAP Solution Manager, SAP R/3 Pack 5.1, Autosys, Sybase 11, UNIX, HP Quality Center 10, PVCS.

Confidential, Southbury, CT

Senior Data Stage Developer

Responsibilities:

  • Worked closely with Business analysts in requirements gathering, reviewing business rules and identifying data sources. Worked on analyzing the systems and gathering of requirements.
  • Extensively worked with DataStage Enterprise Edition/Parallel Extender stages like Datasets, Sort, Lookup, Peek, Row Generator, Remove Duplicates, Filter, Aggregator, FTP, Funnel, Modify, Change Capture and Change apply stages in accomplishing the ETL Coding.
  • Developed DataStage Sequence Jobs by using the Email Notification, User Variable Activity, Job Activity, Wait for File stages, Execute Command, Loop Activity and Terminate Stages.
  • Worked with SAP stages like IDOCS, BAPI and ABAP when working with some of the interfaces like Mini mater ED to BH and Fints0029 DCAT.
  • Worked on mapping, transforming, and transferring data between varieties of data formats using different files.
  • Extensively worked on Performance tuning and improved the performance of the jobs to the vast extent.
  • Developed UNIX shell scripts for data files processing and process integration tasks.
  • Worked on unit test, integration test, and performance test plan documents. Performed unit test, integration test, and performance test per the approved technical design document and documented all the test results.
  • Used XML Stages to parse the XML Data and loaded it into Relational database.
  • Created xml files based on the user requirements using xml output stage.
  • Developed Routines for Error handling and also developed before/after job subroutine.
  • Was involved in importing and exporting the jobs/sequences to the QA environment from Development environment and Vice Versa.
  • Created User defined Environment Variables and new Projects in Datastage Administrator.
  • Extensively worked on Source, Confidential, Error logging in the Arms Logging System.
  • Used Websphere MQ stage for receiving messages and also for sending acknowledgment and error messages back.
  • Used DataStage Director to schedule running the jobs, monitoring and debugging its components.
  • Checked in and checked out the technical design documents, interface documents in the SAP Solution Manager.
  • Used Rational ClearQuest to work with change requests, create and run queries to view records and to view defect status when tracking projects.

Environment: Confidential Web sphere Data Stage 8.1(Parallel Extender), DB2UDB 9.1, UNIX AIX, SAP R/3 Pack 6.5.0.1, SAP Solution Manager, Confidential Rational Clear quest 7.1.2.

Confidential, NY

Data Stage Lead/Admin

Responsibilities:

  • Was involved in writing shell scripts for ftp the Agency files from Agency FTP server to IIS server.
  • Developed Data Stage jobs for HHS CONNECT project which involves maintaining data of all Agencies like HRA, ACS, DHS, NYCHA, DFTA, DCMGM.
  • Extensively worked with Shared Containers for reusable calculations.
  • Extensively used Email Notification, Nested Condition, Sequencer and Terminator activities in Job Sequences.
  • Extensively worked with Confidential Web sphere Data stage to develop jobs in Parallel Extender using different stages like Transformer, Aggregator, Lookup, Join, Pivot, Dataset, Filter, Row generator.
  • Worked Extensively with Quality stages like Investigation, Standardization, Matching, and Survivorship.
  • Developed Routines for Error handling and also developed before/after job subroutine.
  • Generated Surrogate Keys for composite attributes while loading the data into Data Warehouse using Key Management functions.
  • Extensively involved in writing User defined Routines and Transformations for implementing business logic.
  • Worked extensively with Scp, Awk, Sed commands in Unix.
  • Performed the Match pairs result using the Match designer by applying the matching rules using Quality Stage.
  • Worked with Confidential in solving issues related to Data stage and Quality stage by creating PMR.
  • Performed the character concatenate, character discrete and Word investigate using Quality stage Investigate stage.
  • Extensively used Standardize stage to standardize the address, person name, phone number .
  • Created Parameter sets and extensively involved in adding Environment variables.
  • Used Director for executing, analyzing logs and Scheduling, Monitoring the jobs.
  • Extensively worked with Team to design complex Data stage jobs for all Agencies.
  • Scheduled and ran Production jobs for ACS, DFTA, NYCHA, HRA and DHS Agencies.
  • Worked on Match Frequency to generate frequency data independent from executing a match that is taken as inputs in match designer.
  • Exported and Imported all the jobs related to Agencies into Test, Training, Stage and Production using Import and Export options in Data stage.
  • Involved in a role of a Data stage Administrator and created projects, enabled and disabled WISD Jobs from Confidential Web console.
  • Automated the Informatica jobs using the Unix scripts and Autosys Scheduler Tool.
  • Involved in removing locks, clean up resources, reindexing as a Data stage Administrator.
  • Extensively worked on restarting IIS and MDM Servers in Unix as a Administrator.
  • Used the Data Stage Administrator to assign privileges to users or user groups (to control which Data Stage client application or jobs they see or run), move, rename or delete projects and manage or publish jobs from development to production status.
  • Performed Unit, System and Integration testing on the Jobs for all Agencies.
  • Was involved in full integration test of all jobs before migrating the sequences to other environments.

Environment: Confidential Web sphere Data Stage 8.0.1(Parallel Extender), Quality Stage 8.0.1, Informatica Power Center 8.6, DB2UDB 9.1, Oracle 10g/11i, SQL, UNIX Korn Shell Script, Sun Solaris and Confidential Master Data Management.

Confidential, Minneapolis, MN

Data Stage Developer/Migration Lead

Responsibilities:

  • Worked extensively in the Migration of 80 Data stage Applications from Sun Solaris to AIX Environment.
  • Extensively worked on Upgrading software version, tool Administration, Development and Support.
  • Created Change Management documentation for assigned implementations and ensured a successful implementation.
  • Extensively Participated in the creation and execution of the Project plan.
  • Extensively worked on Migration analysis document which provides complete information of Migration Project.
  • Worked on creating Tickets with Confidential for resolving Data stage Application Issues.
  • Followed Analysis, Design, Implementation and Verification process while Migrating Data stage applications from Sun Solaris to AIX.
  • Worked on Setting up Security, assigning roles, project permissions for the application Teams.
  • Worked on Creating and Deleting Data stage projects, Environmental parameters.
  • Monitored the Data Stage server for I/O usage, memory usage, CPU usage, network usage, storage usage.
  • Identified the Facts and Dimensions using Erwin Data modeling tool to represent the Star Schema Data Marts.
  • Responsible for using different types of Stages such as FTP, Hashed File, Sequential File, Sort Aggregator, Transformer, RTI and ODBC to develop different jobs.
  • Used Data Stage Designer for developing various jobs to extract, cleansing, transforming, integrating and loading data into Data Warehouse.
  • Used Data Stage Director to schedule running the server jobs, monitoring scheduling and validating its components.
  • Used Data Stage Manager for managing Data Stage repository (view and edit), define custom routines & transforms, Import and export items between different Data Stage systems or exchange Metadata with other data warehousing tools.
  • Extensively worked on Killing or removing the file locks, job locks, shared memory locks, specific processes or users.

Environment: Confidential Web sphere Data Stage 7.5.2(Parallel Extender), DB2UDB 9.1, Oracle 10g, SQL, PL/SQL, UNIX Korn Shell Script, AIX, Sun Solaris, Erwin, Control M, Confidential (Remedy Change Management).

Confidential, OH

Senior Data Stage ETL Developer

Responsibilities:

  • Used Confidential Web sphere Data Stage as an ETL tool to extract data from sources like DB2 and flat files and loaded to Confidential tables.
  • Developed Data Stage Server jobs for Daily Policy project which involves maintaining data of all Policy holders for Confidential Corporation.
  • Created Shared Containers for reusable calculations in various strings.
  • Extensively used Data Stage Designer stages such as ODBC, Aggregator, Transformer, Filter, Join, Pivot, FTP and Merge.
  • Extensively worked with Flat files using sequential file stage.
  • Used Data Stage Software Development Kit (SDK) Transforms like Date Transforms, functions Like DSJobInfo, ICONV and OCONV etc.
  • Designed the data stage Integrity check jobs which check that each Dimension ID in a Fact table has a corresponding ID in a Dimension table.
  • Extensively used Email Notification, Nested Condition, Sequencer and Terminator activities in Job Sequences.
  • Having good knowledge in working with FTP using UNIX.
  • Worked extensively in writing Korn Shell scripts.
  • Worked Extensively with Quality stages like standardization, matching, and survivorship.
  • Developed Routines for Error handling and also developed before/after job subroutine.
  • Updated the current design specs based on the changes that occurred during development process and was involved in writing new design specs.
  • Was involved in full integration test of all jobs within each sequence before migrating the sequences to the test project from development project.
  • Extensively worked with Data Acquisition and Data Integration.
  • Extensively used Quality Stages like Investigate, Match and Survivorship.
  • Extensively used Autosys scheduler tool to schedule Data stage jobs.
  • Used the Data Stage Administrator to assign privileges to users or user groups (to control which Data Stage client application or jobs they see or run), move, rename or delete projects and manage or publish jobs from development to production status.
  • Used Director for executing, analyzing logs and scheduling the jobs.
  • Developed Hash files for performance improvement by reducing the reference lookup time.
  • Extensively worked with Team to design complex Data stage jobs.
  • Developed Unit Test Cases and conducted Peer Code Review for the developed jobs.
  • Worked with People Soft for change requests to solve the Production issues.
  • Worked Extensively on BMC Remedy change management software to get approval from higher officials to migrate all the Jobs and Scripts to Production.

Environment: Confidential Information Server Web Sphere Data Stage 8.0 (Server and Sequence jobs), Quality Stage, DB2UDB 9.1, SQL, PL/SQL, UNIX Korn Shell Script, AWK, Erwin, Autosys, People Soft EPM, BMC (Remedy Change Management).

Confidential, Fullerton, CA

Data Stage Developer

Responsibilities:

  • Worked on Error Handling, Creating Hashed Files and Performing Lookups for Faster access of Data.
  • Created Tables, indexes, synonyms in Oracle Database to Load Data.
  • Used Version Control to get latest versions of updated jobs and sequences
  • Extensively used parallel extender to extract, transform and load data into data warehouse and Data Mart with partitioning in MPP environment.
  • Worked on different stages in PX like Join, Lookup, Funnel, Stored Procedure, Filter, Merge, Aggregator and Transformer.
  • Extensively worked with Flat files and Hash files.
  • Designed ODS to quickly perform relatively simple queries on small amounts of data.
  • Defined reference lookups, aggregations, constraints and derivations.
  • Created and used Data Stage Shared Containers, Local Containers for Data Stage jobs and retrieving Error log information
  • Designed Workflow model to represent real work for further assessment.
  • Provided support including off-hour on Data Stage issues. Developed parallel Shared Containers and re-used in multiple jobs.
  • Performed Import and Export of Data Stage components and table definitions using Data Stage Manager.
  • Worked extensively with different Data marts like Accounts, Receivables etc.
  • Extensively used the Hash file Stage, Aggregator Stage, Sequential File Stage, Oracle OCI stage.
  • Extensively worked with Dimensional Data Modeling, Star Schema and Snowflake Schema.
  • Maintained the Data Stage server processes.
  • Worked on Migration of Data Stage from Version 7.5.2 to 8.0
  • Created new projects and associated data directories on the Data Stage Server Node.
  • Created Business Objects reports, Queries with constant interaction with the end users.
  • Wrote Routines for Data Cleansing.
  • Created master controlling sequencer jobs using the Data Stage Job Sequencer.
  • Performance tuning of ETL jobs.
  • Used Data Stage Director and its run-time engine to schedule running the jobs, testing and debugging its components, and monitoring the resulting executable versions.
  • Worked with other technical teams to set-up and configure the Data Stage environments.
  • Good Experience in Oracle and Teradata
  • Designed many Sequence jobs in data stage.
  • Extensively used Ascential Data Stage Manager, Designer, and Director for creating and implementing jobs.
  • Tuned the Data Stage server processes.
  • Developed UNIX shell scripts for scheduling the jobs and for automation of ETL processes.

Environment: Confidential Web sphere Data Stage 8.0/ 7.5.2(Server Edition and Parallel Extender), ODS, Sql Server 2005, BusinessObjects6.5.1, SQL Loader, Erwin, Oracle 9i, Teradata, DB2UDB 8.1, SQL, PL/SQL, UNIX Shell Scripts.

We'd love your feedback!