We provide IT Staff Augmentation Services!

Senior Datastage Developer Resume

0/5 (Submit Your Rating)

Charlotte, NC

SUMMARY

  • Around 13 years of experience in Analyzing, designing, developing, testing, maintaining and supporting applications in Data Integration/Migration for Financial, Insurance, Retail and Banking Industry
  • Experience in Data analysis and design using IBM WebSphere DataStage 11.5/8.7/8.1/7.5.2
  • Experience in Design, development, Testing and support using Datastage 7.5.2/8.1/8.7/11.5 to create and maintain Jobs, Job Sequences, Routines, And Transforms which is focused on analyzing and reporting the entire business process
  • Have knowledge on data warehousing concepts like Star schema, Snowflake schema, OLTP, OLAP etc.,
  • Extensive experience with Data Extraction, Transformation, and Loading (ETL) from disparate Data sources like Multiple Relational Databases, Oracle, SQL Server, Netezza, Teradata, and DB2.
  • Worked in Waterfall and Agile (Agility tool) methodology
  • Worked Analysis, Design, Development and Implementation of Relational Database (OLTP) and Data Warehousing Systems (OLAP) using DataStage, Quality Stage, Oracle, Teradata, DB2, Erwin and Unix
  • Integrated data from flat files, CSV files, Message queue, web services, Salesforce, Mainframe files and XML files into a common reporting and analytical Data Model.
  • Extensively worked on DataStage parallel jobs using Various Stages like Join, Lookup, Change Capture, Check Sum, Filter, Funnel, Copy, Sort, File set, Sequential File, XML Input, XML Output, WebSphere MQ connector, Data set, Oracle/DB2 Enterprise, Teradata, Merge, Aggregator, and Remove Duplicate Stages.
  • Experience in migrating jobs from Datastage 7.5.2 to 8.1, 8.1/8.5 to 8.7, 8.7 to 11.5
  • Experience in Performance Tuning, Backup and Recovery process, and product support on various platforms.
  • Good experience on various databases like Oracle 11g/10g/9i/8i, DB2 9.5/9.7, MQ, Teradata V2R5/V2R6.
  • Very good knowledge on handling Mainframe EBCDIC and XML files
  • Extensive experience in using Built - in, Plug-in and Custom Stages for Extraction, transformation and loading of the data.
  • Good experience on multiple Operating Systems (Windows NT/2000/9x, UNIX, AIX), Unix Shell Scripting.
  • Have done POC using Hyperion Essbase 9.2 and Pentaho Data Integration
  • Have knowledge on Informatica, Microsoft SQL Server
  • Having knowledge on AWS, Apache Hive, Sqoop, Big bucket and bamboo

TECHNICAL SKILLS

Software: IBM Web Sphere DataStage 11.5/8.7/8.1/7.5.2 Parallel Extender, Server Jobs, Job Sequence and Datastage 390, Informatica, Hyperion Essbase 9.2

Database: Oracle 10g/9i/8i, DB2 9.5/9.7, MS SQL Server, Teradata V2R5/V2R6.2, Netezza

Programming/Others: IBM Mainframe Express 3.1, IBM Data Studio 4.1.1, Control-M 7.0/9.0, UNIX Shell Script, Serena Business Manager, Kanban, Agility, UNIX

Operating Systems: Win 98, UNIX, Linux, MS-DOS

PROFESSIONAL EXPERIENCE

Confidential, Charlotte, NC

Senior Datastage Developer

Responsibilities:

  • Involving in understanding the existing system process and providing a suggestion for redesigning the existing process and, finding an opportunity for Performance tuning in ETL jobs
  • Requirements gathering from business analyst and creating technical specifications
  • Active participation in decision making and QA meetings and regularly interacted with the Business Analysts &development team to gain a better understanding of the Business Process, Requirements & Design.
  • Creating a standard architecture to serve customer efficiently to achieve the strategic business goal
  • Developed jobs with Enterprise Edition stages like Transformer, Data Set, Lookup, Merge, Remove Duplicates, Sort, Join, Funnel, Filter, Sequential File and DB2 Enterprise Stage in Parallel jobs
  • Worked with EBCIDIC files to extract data in required format.
  • Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
  • Developed jobs using DataStage Designer to develop processes for extracting, transforming, integrating, and loading data from Mainframe COBOL, DB2 into desired target.
  • Creating Common module and routines to get better performance and reusability
  • Service Now is used to raise Change Record, Incident and problem ticket and track it down too close
  • Confluence page is used to store and update the project documentation like daily decomp, project Milestone, Development, business and testing
  • Working on JIRA (agile methodology) which helps in tracking the project road map and achieve the milestones as planned and identify the issue earlier than later
  • Involving in code review, Unit /UAT test Cases preparation and maintained the data validation
  • Creating standard process document to future reference of the project
  • Documentation of all developed modules in the project

Environment: IBM Information Server 11.5, IBM Mainframe Express 3.1, IBM Data Studio 4.1.2, Control-M 9.0, UNIX Shell Script, DB2 9.7, SQL, Service Now, Confluence, Sub Version, Jira (Agile)

Confidential, Charlotte, NC

Senior Datastage Developer

Responsibilities:

  • Involved in understanding the existing system process and providing a high-level estimation for datastage 11.5 upgrade
  • Created a road map for the datastage upgrade
  • Worked on setting up the environment for Development, Integration, SAT, CAT and Production
  • Worked with datastage admin/environment team to fix the issues related to 11.5 migration
  • Strategy planned for migrating the ETL jobs, integration, SAT and CAT testing
  • Migrated the ETL jobs for 38 client process
  • Re-architecture the datastage design helps to allow the multiple client changes
  • Created a Control-M jobs and scheduled to trigger the ETL jobs
  • Used Datastage Director to debug the error, warning related to migration and monitoring the resulting executable versions
  • Compared the output files and validated the results from both the servers
  • Worked in agile methodology which helps in tracking the project road map and achieve the milestones as planned and identify the issue earlier than later
  • Involving in code review, Unit /UAT test Cases preparation and maintained the data validation
  • Creating standard process document to future reference of the project
  • Documentation of all developed modules in the project

Environment: IBM Information Server 11.5/8.7, IBM Mainframe Express 3.1, IBM Data Studio 4.1.1, Control-M 9.0, UNIX Shell Script, DB2 9.7, SQL, Serena Business Manager, Service Now, Agility, Sub Version

Confidential, Charlotte, NC

Senior Datastage Developer

Responsibilities:

  • Involving in understanding the existing system process and providing a suggestion for redesigning the existing process and, finding an opportunity for Performance tuning in ETL jobs
  • Requirements gathering from business analyst and creating technical specifications
  • Active participation in decision making and QA meetings and regularly interacted with the Business Analysts &development team to gain a better understanding of the Business Process, Requirements & Design.
  • Creating a standard architecture to serve customer efficiently to achieve the strategic business goal
  • Developed jobs with Enterprise Edition stages like Transformer, Data Set, Lookup, Merge, Remove Duplicates, Sort, Join, Funnel, Filter, Sequential File and DB2 Enterprise Stage in Parallel jobs
  • Worked with EBCIDIC files to extract data in required format.
  • Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
  • Developed jobs using DataStage Designer to develop processes for extracting, transforming, integrating and loading data from Mainframe COBOL, DB2 into desired target.
  • Creating Common module and routines to get better performance and reusability
  • Serena Business Manager is used to raise ticket and track it down too close
  • Working on Kanban methodology to control the logistical chain from a production point of view, and is an inventory control system a Management
  • Involving in code review, Unit /UAT test Cases preparation and maintained the data validation
  • Creating standard process document to future reference of the project
  • Documentation of all developed modules in the project

Environment: IBM Information Server 8.7, IBM Mainframe Express 3.1, IBM Data Studio 4.1.1, Control-M 7.0, UNIX Shell Script, DB2 9.7, SQL, Serena Business Manager, Sub Version, Kanban, Agility

Confidential, Syracuse NY

Technical Lead

Responsibilities:

  • Involved in understanding the scope of application, Complexity and diversity of the systems involved, Requirements gathering and creating technical specifications
  • Developed jobs in IBM Web Sphere Parallel Extender PX using different stages like Transformer, Aggregator, Lookup, Join, Merge, Modify, Remove Duplicate, Sort, Peek, Change capture, Filter, Copy, Sequential File, and Data Set.
  • Used DataStage Enterprise Edition for splitting the data into subsets and to load data, utilized the available processors to achieve job performance, configuration management of system resources in Orchestrate environment
  • Extensively used DataStage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into desired target.
  • Created user defined transforms and routines for handling special cases
  • Extracted data from various sources, transformed according to the requirement and Loaded data using various stages like sequential file, RDBMS, ODBC, Aggregator, Transformer stage
  • Created jobs using RCP and schema files to dynamically assign the source and target metadata
  • Used the DataStage Director and its run-time engine to schedule running the job, testing and debugging its components, and monitoring the resulting executable versions
  • Developed jobs with Enterprise Edition stages like Data Set, LookUp, Merge, Join, Funnel, Filter, Sequential File and Oracle Enterprise Stage in Parallel jobs
  • Involved in the integration and Production support
  • Analyzing and understanding business requirements for each service request and production issues
  • Coding per business requirements according to standard process
  • Performance tuning done in SQL query, ETL Jobs and Sequences
  • Educating the team with the design approaches, performance monitoring techniques, bug fixing and timely responses for issues
  • Performing basic level of administrator activity
  • Involved in code review, Unit /UAT test Cases preparation and maintained the data validation
  • Extensively used mainframe CA7 scheduler in job scheduling and monitoring the ETL process.
  • Performed basic Secure FTP support
  • Documentation of all developed modules in the project

Environment: IBM Information Server 8.7, Ascential Datastage 7.5.2, Microsoft Visio, Oracle 11g, UNIX Shell Script, SQL server 2000, Mainframe CA7 Scheduler, DB2 9.5, SQL, Secure FTP and Toad.

Confidential, Syracuse, NY

Senior Software Developer, Technical Lead

Responsibilities:

  • Used the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into various application systems.
  • Project Planning and Monitoring
  • Designing system technically and Writing Technical Specifications of project
  • Creating High Level and Low-level ETL Flow Diagram in Visio
  • Designing concept template jobs, Common jobs, routines and shared containers to help reduce the development time.
  • Created POCs for extracting data from complex source XML repeating tags
  • Created POCs to load data into MQ through MQ connector stage and designed common job to push messages to the message queue.
  • Created and handled larger EBCDIC files
  • Worked in developing ETL jobs and sequences in accordance with the control tables, directory structure, development and integration environment setup in UNIX and database
  • Have created routines for different functionality
  • ETL Development for Control Architecture, Common Modules, Sequence Controls and major critical interfaces.
  • ETL Jobs and Sequences performance tuning
  • Documentation of all the developed modules of the project
  • Educating the team with design approaches, performance monitoring techniques, bug fixing and timely responses for issues.
  • Create master controlling sequence jobs using the DataStage Job Sequence.
  • Used Data Stage Parallel Extender parallel jobs for improving the performance of jobs.
  • Used Parallel Extender Development/Debugging stages like Row generator, Column Generator, Head, Tail and Peek.
  • Dealt extensively with data from Mainframe, MQ connector, XML, Flat file and Oracle sources.
  • Used Data Stage Director to validate schedule run and monitor the data stage jobs.
  • Developed user defined Routines and Transforms by using Universe Basic.
  • Used Before/After Job-Subroutines in Job Properties.
  • Better utilization of Hashed files and dataset.
  • Responsible for performance tuning.
  • Used Data Stage for developing, programs for scheduling data loading and transformations
  • Developing shell scripts to automate file manipulation and data loading procedures
  • Error Logs/Audit Trails were maintained
  • Used Administrator to administer the locks on the jobs and other Administration activities for DataStage Server.

Environment: IBM Information Server 8.5/8.7, SQL, Oracle 10g, TOAD, Oracle 10g, UNIX Message queue, CA7 scheduling.

Confidential, Syracuse NY

DataStage Developer

Responsibilities:

  • Prepared Data Mapping Documents and Design the ETL jobs based on the Business requirement
  • Extracted data from source systems transformed and loaded into Oracle database according to the required provision.
  • Involved in system analysis, design, development, support and documentation.
  • Designed and Developed Data stage Jobs to Extract data from heterogeneous sources, Applied transform logics to extracted data and Loaded into Data Warehouse Databases.
  • Created Datastage jobs using different stages like Transformer,Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML etc.
  • Created Datastage jobs using different server stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector
  • Extensively worked with Join, Look up (Normal and Sparse) and Merge stages
  • Extensively worked with sequential file, dataset, file set and look up file set stages
  • Extensively used Parallel Stages like Row Generator, Column Generator, Head, and Peek for development and de-bugging purposes
  • ETL Development for Control Architecture, Common Modules, Sequence Controls and major critical interfaces
  • Made the changes as per the requirements in the CR
  • Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance
  • Created Job Sequencers to automate the job.
  • Created shared container to in corporate complex business logic in job.
  • Developed shell scripts, which Datastage uses to recognize the source files
  • Implemented user defined routines to satisfy the business needs
  • ETL Jobs and Sequence performance tuning
  • Used DataStage as an ETL tool to extract data from sources systems, loaded the data into theORACLEdatabase
  • Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis.
  • Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
  • Developed Test Plan that included the scope of the release, entrance and exit criteria and overall test strategy. Created detailed Test Cases and Test sets and executed them manually
  • Effective usage of TOAD/DATA LOADER to load test data to the oracle database
  • Participated in weekly status meetings
  • Documented all the Developed modules of the project and created traceability matrix

Environment: IBM Infosphere Datastage 8.1, MSSQL Server, Oracle 9i, IBM AIX UNIX, Toad9.5, DB2 9.5, Unicenter

Confidential

DataStage Developer

Responsibilities:

  • Extensively used DataStage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into desired target
  • Used Director for executing the jobs, root cause identification using the logs
  • Involved in the integration and Production support of the project.
  • Made the changes as per the requirements in the Change request.
  • Responsible in moving the datastage jobs from development to integration and production.
  • Delivering the daily job run status to the users.
  • Fixing up and troubleshooting the issues according to the priority.
  • Unit test the developed jobs based on testing conditions.
  • Created DataStage jobs, batches and job sequences and tuned them for better performance.
  • Regular periodic maintenance for datastage production server.
  • Responding to the user in 24/7 basis support.

Environment: IBM Data Stage 8.1, Oracle 9i, UNIX.

Confidential

DataStage Developer

Responsibilities:

  • Involved in understanding the scope of application, Complexity and diversity of the systems involved, Requirements gathering and creating technical specifications
  • Developed jobs in IBM Web Sphere Parallel Extender PX using different stages like Transformer, Aggregator, Lookup, Join, Merge, Modify, Remove Duplicate, Sort, Peek, Change capture, Filter, Copy, Sequential File, and Data Set.
  • Used DataStage Enterprise Edition for splitting the data into subsets and to load data, utilized the available processors to achieve job performance, configuration management of system resources in Orchestrate environment
  • Extensively used DataStage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into desired target.
  • Created user defined transforms and routines for handling special cases
  • Extracted data from various sources, transformed according to the requirement and Loaded data using various stages like sequential file, RDBMS, ODBC, Aggregator, Transformer stage
  • Created jobs using RCP and schema files to dynamically assign the source and target metadata
  • Used the DataStage Director and its run-time engine to schedule running the job, testing and debugging its components, and monitoring the resulting executable versions
  • Developed jobs with Enterprise Edition stages like Data Set, LookUp, Merge, Join, Funnel, Filter, Sequential File and Oracle Enterprise Stage in Parallel jobs
  • Created the project in datastage administrator
  • Understanding the architecture of Teradata and query execution in the system
  • Have done POC on different types of loads like FastLoad, Multiload and TPUMP
  • Converted oracle datastage jobs using Oracle enterprise stage to Teradata enterprise stage
  • Converted oracle SQL to Teradata SQL without impacting the functionality and performance of the job.
  • Converted oracle procedures to Teradata Procedures
  • Involved in Preparing Unit Test and UAT test Cases.
  • Involved in reviewing the code and maintained the validated data.
  • Documentation of all developed modules in the project

Environment: Ascential Datastage 7.5.2, Oracle 9i, Teradata V2R6.2, UNIX

Confidential

DataStage Developer

Responsibilities:

  • Learned to use data stage client tools - Data stage Designer, Director, and Manager
  • Developed ETL jobs as per the Business requirement document
  • Involved in preparing Design Document
  • Designed jobs in datastage designer, store and manage reusable metadata in datastage Manager, Monitored the job execution in datastage director
  • Involved in Preparing Unit Test Cases for the designed jobs
  • Unit test the developed jobs based on testing conditions.
  • Documentation of all developed modules in the project

Environment: Ascential Datastage 7.5.2, Oracle 9i

We'd love your feedback!