Sr. Datastage Developer Resume
FL
SUMMARY
- Experience in software systems Development client/server Business systems wif 7 years of strong Data Warehousing experience on Extraction, Transformation and Loading (ETL) processes using IBM Information server 9.1/8.7/8.5 and Information Analyzer (Profile stage) and Quality Stage.
- Strong Knowledge of Business Intelligence (BI), Data Warehousing, ETL, and OLAP.
- Efficient in all phases of the software development lifecycle (SDLC), coherent wif Data Cleansing, Data Conversion, Performance Tuning, Unit Testing, System Testing, User Acceptance Testing (UAT).
- Experience in analyzing Star Schema/Snowflake Schema, Dimensional Data Modeling, Logical and Physical Data Modeling using Erwin 4.0/3.5 and UML.
- RDBMS experience wif TeraData v2r6 / v2r12, Oracle 10g/9i/8i, SQL Server, DB2 including database development, developed Stored Procedures, Triggers, Functions, Packages, Views, Materialized Views and Partitioning tables, Nested Tables.
- Extensively worked wif Parallel Extender for splitting bulk data into subsets to distribute the data to all available processors to achieve best job performance.
- Extensively worked on DataStage client Components Designer, Director, Administrator & Console.
- Extensively worked on various databases like Oracle, Teradata, DB2 and SQL Server.
- Over 2+ years’ experience in SAP BW Pack BAPI (Staging Business API) for loading into BW& extract data from BW.
- Experience in Data integration wif SAP systems, extensively used Datastage plug - ins for SAP R3 and SAP BW.
- Data migration, synchronization, consolidation and cleansing of operational systems, such as legacy, ERP and CRM applications, to enable strategic, tactical and operational business intelligence.
- Strong in IBM Datastage ETL, SQL, Teradata Scripts, Unix/Linux, FTP, SDLC (System Development Life Cycle), DB2, UAT Testing, and mainframe utilities.
- Worked wif Metadata Definitions, Import and Export of Datastage jobs using Data stage Designer.
- Hands on experience in Enterprise Scheduling tools like Control-M and Autosys.
- Strong background in ETL tools, such as Data stage parallel Extender.
- Implemented quality stage for data cleansing, data standardization and matching process.
TECHNICAL SKILLS
ETL: II IBM IIS Datastage & QualityStage 9.1/8.7/8.5/8.1 (Designer, Director, Administrator)FastTrack, Information Analyzer.
Data Modeling: S Star Join Schema, Snow-Flake Schema, Dimensions & Fact Tables, Physical and Logical Data Modeling, Erwin (Forward & Reverse) engineering
BI Tools: C Business Objects XI, OBIEE 3.1
Databases: O Oracle 10g/9i, DB2 9.x, MS SQL Server 2005, Teradata V2R12/V2R6, Netezza Twinfin.
ERP / CRM: SAP R/3 ABAP 4.7, SAP CRM5.0, SAP BW3.5, Siebel 8.0, Salesforce.com
Environment: Windows 2003/2000NT 4.0, Sun Solaris 2.x/5.x, AIX 5.2/4.3, HP-UX, Linux
Languages: S C, Java, XML, SQL, T-SQL, PL/SQL
PROFESSIONAL EXPERIENCE
Confidential, FL
Sr. DataStage Developer
Responsibilities:
- Worked wif Project Lead, Technical Lead and Functional analysts to understand the functional requirements and from there designed the Technical specifications.
- Involved in meetings wif the Business Analysts to collect the requirements, analysis and implementation of it and prepared Specification documents for EDW process.
- Developed complex extraction, transformation, and load (ETL) processes for data conversions and construction of data warehouse using IBM IIS DataStage & Quality Stage 9.1/8.7.
- Extensively used DataStage designer to develop Jobs for extracting, transforming, integrating and loading data into data warehouse tables.
- Worked wif the upgrading of IIS DataStage & QualityStage 8.7 to IIS DataStage & QualityStage 9.1.
- Worked wif the migration of ETL jobs from IIS Data Stage & Quality stage 8.7 to IIS DataStage & QualityStage 9.1.
- Used DataStage Director and Console to run, debug and monitor the DataStage jobs.
- Developed transformations using various jobs including Webshphere MQ connector, Xml, Hashed file, Aggregator, Transformer, Filter, Join, Lookup, Merge, Dataset, Funnel and Sequential file stages.
- Extensively worked on Oracle and Greenplum Connector Stages to extract, transform and load data.
- Extensively worked on Parallel Stages like Row Generator, Column Generator, Head, and Peek for development and debugging purposes.
- Responsible for analyzing and preparing dependencies and sequence in which job/processes should be scheduled in Enterprise Scheduling tools using Autosys.
- Creating validation and loading the rejected records into the relevant tables and send to the users for re-submitting.
- Sequences were developed to support the flow of data from staging area into the target area on the Database.
- Maintained Data Warehouse by loading dimensions and facts as part of project. Also worked for different enhancements in FACT tables.
- Developed complex store procedures using input/output parameters, cursors, views, triggers and complex queries using temp tables and joins.
- Fine tuning of jobs by following best design practices, configuration changes and best data partitioning/collecting methodologies to meet the project requirement.
- Implemented performance-tuning techniques along various stages of the ETL process.
- Extensively used Data Stage Designer to import/export metadata, jobs, and routines from repository, and also created data elements.
- Extracted data from Oracle database transformed and loaded into Green Plum database according to the Business specifications.
- Designed Mappings between sources to operational staging targets, using Star Schema.
- Wrote UNIX shell Scripts for file validation and scheduling Data Stage jobs.
- Also used UNIX scripts in file moving, scheduling jobs, removing null from the Flat files.
- Extensively worked on Error handling, cleansing of data, Creating Hash files and performing lookups for faster access of data.
- Good knowledge in Business Intelligence Concepts for building custom reports.
Environment: IBM InfoSphere Information Server 9.1/8.7 (IIS Designer, IIS Director, IIS Administrator, IIS Console), HP UNIX, Oracle 11g, C/C++, PVCS, Secure CRT 6.6,Red hat Linux AS, PG Admin III, Autosys.
Confidential, Hartford, CT
Sr. DataStage Developer
Responsibilities:
- Work closely wif Business analysts and Business users to understand the requirements and to build the technical specifications.
- Responsible to create Source to Target (STT) mappings.
- Responsible to design, develop and build datastage parallel jobs using DataStage designer.
- Worked on the migration of ETL jobs from IBM Data stage 8.1 to Web Sphere Data Stage 8.7
- Developed and supported the Extraction, Transformation and Load process (ETL) for a data warehouse from various data sources using DataStage Designer.
- Designed and developed Parallel jobs to extract data, clean, transform, and to load the target tables using the DataStage Designer
- Designed, developed job sequences to run multiple jobs
- Used DataStage Designer for importing the source and target database schemas, importing and exporting jobs/projects, creating new job categories and table definitions.
- Designed and developed the Routines and Job Sequence for the ETL jobs
- Prepared Technical Specification Documents for DataStage Jobs.
- Involved in Unit testing and integration testing.
- Responsible for running jobs using Job Sequencers, Job Batches.
- Developed Parallel jobs using various stages like Join, Merge, Funnel, Lookup, Sort, Transformer, Copy, Remove Duplicate, Filter, Peek, Column Generator, Pivot and Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems
- Implemented logical and physical data modeling wif Star and Snowflake techniques using Erwin in Data warehouse.
- Extensively worked on Teradata MLoad, Teradata Enterprise Stage, and Teradata API Stage to extract, transform and load data.
- Good understanding of Teradata Load Utilities like BTQ, Multiload, Fastload, BTEQ, TPump in order to work wif Teradata stages in DS Designer.
- Understanding of source code control concepts.
- Extensively used Reject Link, Job Parameters, and Stage Variables in developing jobs
- Used the DataStage Director to run, schedule, monitor, and test the application on development, and to obtain the performance statistics.
- Developed Packages and customized functions and Triggers based upon the business logics
- Involved in Performance tuning of complex queries
- Developing Oracle PL/SQL stored procedures, Functions, Packages, SQL scripts to facilitate the functionality for various modules.
- ERP development and implementation.
- Responsible for analyzing and preparing dependencies and sequence in which job/processes should be scheduled in Enterprise Scheduling tools like Control-M scheduler
- Used Business Objects to Custom Reports
Environment: IBM InfoSphere DataStage & QualityStage 8.7 (Designer, Director and Administrator), Balance Optimizer, PL/SQL, Teradata V2R12 & V2R6, AIX 5.3, SQL Server, SQL Assistant, Control-M Desktop Manager 6.3.01, Control-M 6.3.01, Windows XP, Visio, Erwin, Business Objects
Confidential, Murray Hill, NJ
Sr. DataStage Developer
Responsibilities:
- As a Data Warehousing team member, Involved in designing, developing and testing of the ETL (Extract, Transformation and Load) strategy to populate the finance, HR, client, vendor, manufacturing Data from various source systems into Enterprise Data Warehouse using DataStage ETL Programs.
- Involved in Data Profiling to understand the patterns, completeness, and quality of source data.
- Involved in data modeling.
- Worked on design and developing data extraction programs using DataStage client component Designer.
- Experience using DataStage Directory component to run, monitor jobs and to clean up the logs and manage the parallel datasets.
- Used DataStage as an ETL tool to extract data from sources systems and aggregate the data and load into the Oracle database.
- Built ETL jobs in using various stages like Transformer, Remove Duplicates, Sort, Join, Merge, Lookup, Data Set, Funnel, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample and Surrogate Key.
- Worked on Extracting data from Mainframe legacy VSAM data sets to Data Mart Application.
- Extensively used stages like Transformer, Join, Funnel, Join, Merge, and Lookup stages etc. to process and merge the data.
- Extensively worked on SAP Extract PACK (SAP R3 Plug-in) to extract data from various SAP modules such as MM,SD,FICO and COPA.
- Good Understading of SAP R/3 architecture and well versed wif SAP transaction tools.
- Involved in performance tuning of the ETL process and performed the end-to-end testing.
- Created Master Job control Job to run jobs based on dependencies.
- Designed server jobs for migrating data from staging area to warehouse to data marts
- Extensively worked in writing SQL scripts (Sub queries and Join conditions, correlated sub queries)
- Used the Data stage Administrator to assign Privileges to users or user groups (to control which Data Stage client applications or jobs they see or run), move, rename, or delete projects, and manage or publish jobs from development to production status.
- Performing Unit Testing and integration testing
- Extensively used SQL Loader to load Oracle database
- Defined test scripts, test specs & testing methodologies.
- Modified existing Control-M jobs for scheduling the DataStage jobs wif new parameters.
Environment: IBM InfoSphere DataStage & QualityStage 8.5, Oracle 10g, XML Plug-Ins, Version control, Control-M, PL/SQL, SQL Server, AIX 5.1 and Windows NT, Toad for Oracle, Micro strategy.
Confidential
Responsibilities:
- Created Business Objects Universe dat caters to Customer profitability, Product profitability and branch performance.
- Created canned reports using OLAP techniques like Slice & Dice, Drill Down features and designed cross tab and Master Detail reports.
- Assisted in finalising the ad hoc reporting requirements of the user and creating reports having Drill Down, Slice and Dice and Alert features.
- Coded a number of PL/SQL stored procedures and data base trigger functions.
- Involved in the Runtime Improvements and tuning and optimization of the critical queries of the application.
Environment: Business Objects, Oracle 8i, Forms 4.5, Reports 2.5, SQL and PL/SQL on Window95, SQL*Plus, SQL*Loader, MS SQL Server 7.0, UNIX.