Datastage Lead Developer Resume
Marlborough, MA
SUMMARY
- Around 10 years of experience in the field of Information Technology and consulting with specialization in Data Warehouse/Business intelligence applications, ETL (Datastage), Data integration and Mainframes.
- Having Proven Experience in Analysis, Design, Development, Testing, Reviewing, Verification and Validation, Quality management and Implementation of various Banking, Retail Projects
- Expertise in building Data warehouse and have strong experience in Dimensional data modeling ( Star schema & Snow - Flake schema), Identification of fact and dimension tables, Normalization, Physical and Logical data modeling
- Experience in Type1,Type2,Type3,Type4 Dimensions implementation
- Experience with ETL Datastage(8.1,8.5,8.7 & 9.1) and Quality stage(11.0) tool and ETL data stages like Transformer, Sequential File, Datasets, DB2 UDB connectors, Oracle Connectors, ODBC, Netezza connector,Teradata connector, Join, Aggregator, Remove Duplicates, Sort, CDC,CFF, External source, Checksum, Pivot, Surrogative key Generator, Filter, XML stage and routines.
- Extensive experience in parallel Enterprise Edition and Server Engine
- Extensive experience in development, debugging, troubleshooting, monitoring and performance tuning of Datastage Parallel jobs using Datastage Designer, Datastage Director, Datastage Manager and Datastage Administrator
- Experience in Datastage Administrator to create/modify/delete projects and cleanup projects
- Expertise in Platform migration projects like migration of mainframe jobs functionality to Datastage jobs.
- Expertise in Data integration and Data Migration of multiple data sources like Mainframe, DB2, Oracle, Netezza and Teradata into ODS and DW
- Experience in Scheduling tools using Autosys, CA7, ESP.
- Experience in Data modeling using MSVisio
- Extensive Experience in fine tuning of SQL queries, incorporating them in ETL.
- Expertise in Unix Commands and Korn shell scripting
- Experience in Migration tasks from Version 8.5 to 9.1
- Experience in technical leadership and management for large projects from requirement gathering through implementation,
- Have guided teams on tasks throughout the SDLC, and ranging from data modeling through ETL and Reporting. Played key roles in Business Enablement by developing technical POCs,
- Played key roles in initiating and enabling new projects. Technical consultant/ advisor to multiple projects - providing inputs from solution architecture to data model to reporting layer - to enhance the efficiency of a solution.
TECHNICAL SKILLS
Operating Systems: RED HAT Linux, WINDOWS XP/9X, MVS OS-390
Data Warehouse/ETL Tool: IBM Info sphere suite 8.1,8.5,8.7,9.1 (Datastage, Quality stage, Fast Track, Business Glossary,,Information analyzer, Metadata workbench )
Data Bases: DB2 10, IMS-DB, Oracle 9i,10g, TeraData V13,Netezza 7.0.2
Data Base Tools: Toad for DB2, Toad for Oracle10g, Tera Data SQL assist, Toad Datapoint, Aginity workbench
File Systems: Sequential files, Datasets, VSAM, GSAM, XML
Languages: Unix Shell Programming(Ksh), PLSQL, COBOL, JCL
Text Editing Tools: Ultra edit, Notepad++
Scheduling Tools: Autosys, CA7, Datastage Director, ESP
Defect Reporting Tool: Quality Center 11.0
Web Technologies: HTML, XML
Editor: Vi editor, ISPF Dialog Manager
Mainframe Tools: File Aid, FileAid-DB2, File aid-IMSDB, Change man, Expeditor, REXX, Easytrieve
Version Control: PTC Integrity, PPM
PROFESSIONAL EXPERIENCE
Confidential, Marlborough, MA
Datastage Lead Developer
Responsibilities:
- Analyzing the Business Requirements
- Translate requirements into system solutions and develop implementation plan and schedule.
- Participate in S2TM (Source to Target Mapping) documents review.
- Participate in identification and analysis of the source data for performing ETL operations
- Prepare High Level ETL Design, UTP (Unit Test Plan) & Build Notes documents.
- Study and understand the technical documents required for implementation (ex: EDW Technical Directive document - Naming standards, ETL columns etc.)
- Converting E-R data model into Dimensional data modelling.
- Preparing Dimensional data modelling using MS Visio
- Working with DBA for creating Dimensions and Fact tables
- Working with Datastage Administrator to create new project
- Involved in design and development of sequencer and parallel jobs using Designer
- Importing table definitions using the Datastage Manager.
- Performed extraction, transformation and loading of data using different types of stages Netezza connector,DB2 Connector, SCD, CDC, Diff, Copy, join, lookup, Row generator, Column Generator, Funnel, Transformer, XML, Checksum, Pivot and Websphere MQ connector .
- Datastage Manager for importing, exporting and packaging Datastage jobs
- Developing Unix scripts to execute Datastage Jobs,
- Creating Technical Design Doc.
- Work with DBA for fine tuning of SQL queries
- Creating Unit Test Plan and Unit test scenarios
- Review SIT test plan and SIT test scripts
- Migration of code using PTC Integrity, PPM tools
- Work with Datastage Architect for fine tuning of Datastage parallel jobs performance improvement
- This responsibility includes migrating data mapping to testing and monitoring, troubleshooting, bug fixing and restarting workflows at different intervals.
- Scheduling ESP (Enterprise Staging Platform - Mainframe) jobs by creating appropriate property files
- Preparing/reviewing production implementation plan.
- Extensive use of sequence job stages like Job Activity, User Variables Activity, Start & End Loop Activity, Execute Command Activity, Sequencer, Wait for File Activity, Notification Activity, Exceptional Handler and Terminator Activity.
Confidential, Charlotte
Datastage Lead Developer
Responsibilities:
- Participate in JAD sessions for requirement gathering
- Analyzing the Business Requirements
- Translate requirements into system solutions and develop implementation plan and schedule.
- Developing and modifying any changes in data mappings.
- Participate in identification and analysis of the source data for performing ETL operations
- Converting E-R data model into Dimensional data modelling.
- Preparing Dimensional data modelling using MS Visio
- Prepare High-level design and Low Level design and get approval from work group meetings
- Working with DBA for creating Dimensions and Fact tables
- Working with Datastage Administrator to create new project
- Involved in design and development of sequencer and parallel jobs using Designer
- Importing table definitions using the Datastage Manager.
- Performed extraction, transformation and loading of data using different types of stages DB2 Connector, SCD, CDC, Diff, Copy, join, lookup, Row generator, Column Generator, Funnel, Transformer and Pivot stage, TeraDataMload connector
- Used the Datastage Manager for importing, exporting and packaging Datastage jobs
- Developed Unix scripts to execute Datastage Jobs
- Developed Autosys JILs for scheduling datastage jobs
- Creating Technical Design Doc.
- Used stage variables in performing the derivations for the transformer stage.
- Work with DBA for fine tuning of SQL queries
- Migration of components to version 9.1
- Work with Datastage Architect for fine tuning of Datastage parallel jobs performance improvement
- Reviewing code with Datastage Architect for code approval
- Responsible in part of production support for the ETL process.
- This responsibility includes migrating data mapping to testing and monitoring, troubleshooting, bug fixing and restarting workflows at different intervals.
- Scheduling and monitoring sessions and batches.
- Used Fast track, Business glossary
- Implementing the Change requests
- Creating Unit Test Plan and Unit test scenarios
- Review SIT test plan and SIT test scripts
Confidential, Charlotte
Datastage Developer
Responsibilities:
- Analyzing the Business Requirements
- Translate requirements into system solutions and develop implementation plan and schedule.
- Created re-usable components using shared containers for local usage/shared usage.
- Worked extensively with almost all Parallel Stages like Copy, Join Merge, Lookup, Row Generator, Column Generator, Modify, Funnel, Filter, Switch, Aggregator, Remove Duplicates and Transformer Stages etc.
- Reading XML data, parsing XML data and writing into XML file using XML input and XML output stages
- Writing XML data into both Database and also into MQ connector
- Enabled proper selection of the hash table design parameters for faster table look-up.
- Worked with DBA team for better production support and performance.
- Using CFF stage to read data from Mainframe sourced Datasets
- Developed the custom routines, transformations and functions in BASIC using Manager/Designer.
- Used the Datastage Designer to develop processes for extracting, cleansing, transforming, integrating and loading data into data warehouse.
- Experience Working with Autosys for scheduling daily and monthly ETL’s Jobs.
- Setup dependency between Autosys jobs and CA7 Mainframe jobs
- Created Design Documents and Unit Test cases with test Results Documents.
- Developed automated notification of Emails, using UNIX shell script, to the users in case of failure in the process from time to time.
- Using NDM script to transfer files from one system to other system
- Wrote the SQL queries & PL/SQL code on tables and Data Mart Staging Tables to validate the data results by counting the number of rows in both the tables.
- Documentation as to facilitate the personnel to understand the process and in corporate the changes as and when necessary.
- Developed reports from the Universe based on the underlying fact and aggregate tables
- Worked on Unit testing, developing Test Cases as per the requirement.
- Reviewed and approved SIT test plan and SIT test scripts documents
- Involved in preparing the prod support documents, hand over take over documents
Confidential, Charlotte
Datastage Developer
Responsibilities:
- Responsible for analyzing the business requirements for the migration of data from the legacy
- Responsible for Data mapping using Fast Track
- Responsible for updating business terms in Business Glossary
- Responsible for performing data conversion design and for data conversion development
- Data Conversion is implemented using source sequential files, datasets DB2 tables, oracle tables and the target oracle tables
- Worked extensively with almost all Parallel Stages like Copy, Join Merge, Lookup, Row Generator, Column Generator, Modify, Funnel, Filter, CDC, Switch, Aggregator, Remove Duplicates and Transformer, Stages etc.
- Involved in the Performance Tuning of the Datastage jobs using different methodologies like configurations of Environment variable file, designing and editing configurations, increasing the read/write speed while fetching or loading data to files or databases.
- Ensuring all data is converting from EBCIDIC to ASCII format
- Worked with DBA’s to create Indexes on Source and Target tables
- Created Design Documents and Unit Test cases with test Results Documents.
- Generating surrogative keys using Surrogative key stage
- Using stage variable, system variables and constraints
- Involved in creation of parallel jobs using parallel extender to improve the performance of jobs.
- Extensively used IBM info server (8.1) designer for developing the code.
- Used the Datastage Designer to develop processes for extracting, cleansing, transforming, integrating and loading data into data warehouse.
- Worked with IBM support to fix various bugs by applying the patches in the Datastage Client machines.
- Involved in partitioning data in for fast performance of a query and also used various partitions in the Datastage for better operations.
- Worked with DBA for improving DB2 and Oracle query performances
- Worked with Datastage Architect to improve performance of Datastage jobs
- Preparing JILs and scheduling jobs in Autosys
- Creating and deleting temporary tables using Truncate in Oracle and Truncate immediate in DB2
- Worked on Unit testing, developing Test Cases as per the requirement.
- Reviewed and approved SIT test plan and SIT test scripts documents
- Involved in preparing the prod support documents, hand over take over(HOTO) documents
Confidential, Phoenix
Responsibilities:
- Analysing the Business Requirements
- Impact analysis of existing and new components
- Preparation of Low level Design
- Coding and reviewing
- Development of reusable components
- Involved in test scripts preparation along with Testing team
- Documenting the test results
- Generation of reports for validation
- Involvement in Scheduling of jobs using Ca7 and monitoring