Sr.datastage Developer Resume
Erie, PA
SUMMARY
- Over 6 years of experience in IT Industry with extensive knowledge in Developing, Designing, and implementing of Client - Server in various industries such as Financial, Banking, and Insurance.
- Over 6 years of experience in IBM InfoSphere Datastage, IBM WebSphere Datastage and Ascential DataStage version 8.x/7.x/6.x Using components like Administrator, Manager, Designer and Director.
- Extensively worked with Parallel Extender for Parallel Processing to improve job performance.
- Expertise in all phases of the Software Development Life Cycle (SDLC) including analysis, Physical and Logical design, Resource Planning, code development, testing, implementation and maintenance.
- Expertise in writing complex SQL queries and PL/SQL, including the use of stored procedures, functions and triggers to implement business rules and validations in the situation of Oracle 11g/10g/9i/8i.
- Experience in Database Design and Database Modeling (Erwin) and architecture skills.
- Expertise in developing Stored Procedures, Functions, Packages, Views, Cursors, Collections (Nested Tables and Varrays), Records, Object Types and Database Triggers.
- Extensive experience in analysis and design of database including ER Diagrams and Normalization techniques.
- Experience with Star and Snowflake Schema, Data Modeling, Fact and Dimensional Tables and Slowly Changing Dimensions
- Extensive experience working with Datastage Designer and DataStage Director to run, debug and validate DataStage Jobs and DataStage Manager to view/edit repository, create/import metadata.
- Designed Parallel jobs using various stages like join, merge, lookup, remove duplicates, filter, dataset, lookup file set, modify, aggregator, Transformer.
- Experience in integration of various data sources like Oracle, DB2, SQL Server, MS Access and Flat files into the Staging Area. Extensively worked with materialized views and TOAD
- Working experience in interacting with Business Analysts and developers to analyze the user requirements, functional specifications and system specifications.
- Ability to work autonomously and also as part of a team under tight deadlines so as to meet any project expectations.
TECHNICAL SKILLS
Databases: Oracle 11g/10g/9i/8i, SQL Server 2008/2005, DB2, MS Access, Teradata V2R6.
Programming Language: SQL, PL/SQL, UNIX shell scripting, C.
ETL Tools: Datastage 8.5/ 8.1/8.0/7.5.2/7.5.1/7.5/7.0/6.0 , Parallel Extender, SSIS
Data Modeling Tools: Erwin 6.0/5.5/4.0, MS Visio 2003, ER/Studio 6.0
RDBMS Tools: TOAD 8.5/ 7.6, SQL*Loader (Oracle), SQL*Plus
Operating Systems: Windows NT (4.0), Windows XP, Windows 2000, UNIX, Red Hat LINUX
PROFESSIONAL EXPERIENCE
Confidential, Erie, PA
Sr.DataStage Developer
Responsibilities:
- Played active role in the development of Data warehouse (D.W ) 1.7
- Involved in both designing and development in server jobs i.e. adding new field to the job and making some changes in the stage variables & constraints.
- Worked with IBM Insurance Information Warehouse model.
- Extensively used DataStage client tools. Extracted data from different databases such as SQL Server, flat files to load finally into a single data warehouse repository, which was in Oracle.
- Performed various operations while processing the data using Sort, Copy, Remove duplicates, Funnel, Transformer and Aggregate Stages.
- Created and executed SQL queries to fetch data from an ORACLE to validate and compare expected results with those actually obtained.
- Worked with Datastage Administrator to create projects, user rights and restart jobs.
- Imported Sources and Targets, Created Mappings and developed Transformations using Datastage designer
- Involved in migration of jobs from the earlier versions i.e. from Datastage 7.5 to Datastage 8.5.
- Worked with the changing of the path of the source and Confidential in the scripts before running the given job.
- Active participated in meetings with the team and project managers.
- Used the Datastage Director for running the monthly and weekly jobs in both production and test servers.
Environment: DataStage 8.5/ 7.5 (Designer, Director, Manger, Administrator), Oracle 11g, MS Visio 2010, Red Hat LINUX, PL/ SQL, sequential files, and complex flat files, Windows XP.
Confidential, Raleigh, NC.
Sr.DataStage Developer
Responsibilities:
- Created high level design documents for extract, transform, validate and load ETL process and flow diagrams.
- Participated in business meetings with vendors and clients in finalizing the enhancements.
- Designed logical and physical models using Erwin data modeling tool.
- Involved in designing and development of both server jobs and parallel jobs to extract data.
- Wrote SQL and PL/ SQL queries for aggregation and outer joins for better performance.
- Wrote shell scripts for job scheduling.
- Created job sequencers.
- Involved in system and performance testing.
- Took part in code review and performance analysis of new jobs.
- Involved in production support along with designing and development of jobs.
- Involved in tuning of server jobs for performance using Hash File stage, Orabulk stage and others.
- Worked with DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Preformed code migration, and used normalization techniques to improve performance..
- Scheduled jobs using UNIX, DataStage Scheduler.
- Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad-hoc or scheduled basis).
Environment: DataStage 8.1/ 7.5.2 (Designer, Director, Manger, Administrator), Oracle 11g, DB2, MS Access, UNIX, PL/ SQL, sequential files, and complex flat files, Erwin 6.0, SQL Server 2008.
Confidential, Swiftwater, PA
Data stage Developer/SQL Developer
Responsibilities:
- Analyzed, Designed and Developed High-Level Design documents and Technical Specifications based on the given user requirement
- Used the Datastage Designer to develop jobs for extracting loading and transforming data into data warehouse.
- Extensively used Merge stage, Lookup stage, Transformer stage, Join stage, Change capture stage, Aggregator stage during ETL development.
- Involved in identifyingthe changes in a front end application through which users input the data.
- Interacted with business team in order to track the changes to be made to the business applications.
- Involved in scheduling and maintaining the Nightly batch jobs using Crontab job scheduling tool.
- Involved in uploading the data from backend to the business applications and unit tested the changes made to the user specific functionalities.
- Migrated oracle database with new implementation scripts to the user acceptance testing environment.
- Provided support/maintenance to the implemented changes.
- Written UNIX shell scripts for various database activities like space cleanup, snapshot refresh, file transfer.
- Creation of database objects like tables, views, stored Procedures, functions, packages, DB triggers, Indexes and Collections.
- Finely tuned the SQL queries using TKPROF, STATSPACK, EXPLAIN PLAN, SQL Trace.
- Replicated the materialized views, procedures and functions.
- Created and used Table Partitions to further improve the performance while using tables containing large number of columns and rows.
- Involved in Unit testing, System testing of each module.
- Provided Test Data to QA team to validate front end application.
- Involved to prepare user level maintenance documentation.
Environment: Oracle 10g/9i, PL/SQL, DataStage 8.0/7.5.1, DB2, Teradata V2R6, TOAD 8.5, Win 2000, Red Hat LINUX, Erwin 5.5 Unix Shell Scripting .
Confidential, Minneapolis, MN
Data stage ETL Developer
Responsibilities:
- Analyzed the present data warehouse data model and participated in investigation of data subject areas and document data flows.
- Interacted with data modelers and data base administrators to make modifications in the data model according to the requirements.
- Used technical specifications document to design and develop the ETL jobs. Also modified the technical documents to accommodate the changes in specs.
- Designed, developed and tested the Data stage jobs using Designer and director based on business user requirements and business rules to load data from heterogeneous data sources like Sybase, Oracle 9i, text files and MS SQL Server.
- Developed Data Stage Jobs using Transformer, Aggregator, lookup, stored procedure stage, Join, merge, sort.
- Developed several Parallel jobs to improve performance by reducing the runtime for several jobs.
- Extensively used SQL coding for overriding the generated SQL in DataStage and also tested the data loading into the database.
- Extensively used DataStage built-in transforms and created user defined subroutines to implement some of the complex logic to meet the business requirements.
- Implemented overall best practices, tips and techniques in the design, development, testing and deployment of DataStage jobs to the Confidential Oracle environments.
- Prepared documentation for addressing the referential integrity relations in between the tables at ETL level. Used DataStage manager to import table definitions from various databases, import and export the datastage jobs between development, testing and production environments.
- Used DataStage director to validate, monitor, schedule and execute the jobs.
- Used DataStage version control to version the designed datastage jobs.
- Created DataStage sequencers using Job Activity, triggers, routine activity, execute command, notification activities to ensure the sequential run of all the designed jobs.
- Created stored procedures, functions, packages, views and triggers using PL/SQL.
- Extensively used Oracle Exception handlers and created user defined exceptions to capture the errors in the designed PL/SQL functions and procedures.
- Involved in manual testing of the designed jobs, UAT, integration testing and production process.
- Developed UNIX shell scripts to automate file manipulation and data loading process.
Environment: DataStage 7.5.2 (Parallel Extender), SQL Server 2005, Oracle 10g, PL/SQL, UNIX Shell Scripting, Windows XP, MS Visio 2003.
Confidential, Englewood Cliffs, NJ
Data stage Developer
Responsibilities:
- Work with functional unit staff to write user cases and develop process flow and diagrams.
- Work with functional unit staff to capture query requirements, design and implement business reports and data management interfaces.
- Developed Oracle PL/SQL, DDL's, and Stored Procedures. Performance and fine Tuning of SQL & PL/SQL stored procedures.
- Developed various Mappings with the collection and gathering of all the Sources, Targets and Transformations.
- Created Datastage jobs using Designer and extract data from various sources, transformed the data according to the requirement and loaded into data warehouse.
- Used various stages such as transformer, ODBC, Link Partitioner, Aggregator, Merge, Join stages.
- Designed Datastage jobs with environmental variables to process initial /daily batch data and prepare errors response files.
- Design specifications and develop automated data retrieval and extraction programs and data sets for data management and analysis systems.
- Review Designs and test data system enhancements (Write test specifications, perform system testing, document test results).
- Built mappings by using SQL Override, Connected/Unconnected Lookup, Lookup Override, Normalizer, Expression, Joiner, Router, Update Strategy, Stored Procedure transformation, Sequence Generator transformation, etc.
- Create ad hoc SQL queries to extract and develop reports for various levels of users/customers.
- Created Stored Procedures by using PL/SQL and call stored procedures from Datastage.
- Prepare feasibility studies, proposals, cost/benefit analysis documents and other documentation under the direction of Project Manager.
- Utilize ASD-established Software development life cycle process and control procedures.
- Create and modify database entities (tables, views, stored procedures packages, database links and ODBC connections).
- Developed UNIX Shell scripts for running the pre/post processes and PL/SQL procedures for performing different database tasks.
- Document entities, relationships, and expected access patterns.
Environment: Oracle 9i, PL/SQL, UNIX Shell Scripting, Windows NT 4.0/2000, SQL *Loader, UNIX, SQL *Plus SQL *Loader, TOAD 7.6, DataStage 7.0, Windows XP.
Confidential
ETL Developer
Responsibilities:
- Involved in extracting the data from different data sources like DB2, Oracle and flat files.
- Involved in extracting the data from staging to Relational.
- Involved in designing to different stages using complex mappings.
- Involved in the designing delta load using automated Batch jobs.
- Creating ETL Job flow design.
- Developing ETL jobs for extraction of data from DB2, Oracle, Flat File sources, and cleansing, transforming, and loading data into the Confidential database using DataStage Designer.
- Creating local and shared containers to facilitate ease and reuse of jobs.
- Using built-in and user defined transforms and routines.
- Involved in creating and maintaining Sequencer and Batch jobs.
- Involved in data cleansing in key process.
- Involved in writing shell scripts and calling the scripts in Batch jobs.
- Involved in production monitoring and analysis of findings.
- Performing Unit Testing and integration.
Environment: DataStage 7.0(Administrator, Designer, Manager, Director), Oracle 9i, DB2, IBM, Windows 2000, Red Hat LINUX.
Confidential
Data Warehouse Developer
Responsibilities:
- Business Analysis and Requirements Gathering.
- Involved in creating logical and physical database design-using Erwin.
- Implemented various strategies for Slowly Changing Dimensions.
- Involved in developing process for Extracting, Cleansing, Transforming, Integrating and loading data into data warehouse database using the database designer.
- Wrote Triggers and Stored Procedures using PL/SQL.
- Created Batches to run several Sessions sequentially and concurrently.
- Designed lookup strategies using Hash file stage.
- Used Datastage as an ETL to extract Data from sources like Oracle, Mainframes and DB2 and loaded to Confidential database.
- Developed parameter driven ETL process to map source systems to Confidential data warehouse with Datastage complete source system profiling.
- Extensively used debugger to test the Data Flow and Fix jobs.
- Generated UNIX shell scripts for creating, dropping tables and scheduling the jobs.
Environment: DataStage 6.0, DB2, PL/SQL, UNIX Shell Scripting and Windows NT 4.0,Orcale 8i, Erwin 4.0.