Datastage/qualitystage Developer Resume
Professional Summary:
- Over 7 years of career reflecting experience and high performance in System Analysis, Design, Development and Implementation in Relational Database and Data Warehousing Systems using IBM DataStage.
- Experienced in designing, developing, documenting, and testing of ETL jobs and mappings in Server and Parallel jobs using DataStage 8.1/7.x/6.x (Information Server, WebSphere, Ascential DataStage) to populate tables in Data Warehouse and Data marts.
- Experience in Requirement Gathering and Analysis, System Design, and Developments phases of Software Development Life Cycle (SDLC).
- Proficient in developing strategies for Extraction, Transformation and Loading (ETL) mechanism.
- Expert in using stages, Standardization, Scrubbing, Matching and Survivorship rules using QualityStage.
- Expert in designing parallel jobs using various stages like Transformer, Join, Merge, Lookup, Remove duplicates, Filter, Dataset, Complex flat file, Modify, Aggregator, XML.
- Expert in designing Server jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
- Experienced in coding using SQL, SQL*plus, PL/SQL stored procedures/functions, triggers and packages.
- Excellent understanding of the DBA functions including creating tables, table spaces, databases, indices and clusters. Also worked with Cubes and Metadata.
- Experienced in Data analysis, Data modeling concepts, Database design and Data migration.
- Strong understanding of the principles of Data Warehouse using Fact Tables, Dimension Tables, Star Schema modeling and Snowflake Schema modeling.
- Extensive experience in Financial, Retail and Health Care Sectors.
- Extensive experience in UNIX shell scripting to run datastage jobs.
- Excellent experience in scheduling and monitoring the production jobs using Autosys and Appworx.
- Expert in Data Warehousing techniques for Data Cleansing, Slowly Changing Dimension phenomenon (SCD), surrogate key assignment and CDC (Change Data Capture).
- Excellent knowledge of different RDBMS like Oracle 8i/9i/10g/11g, MS SQL Server, DB2, Sybase and Teradata.
- Worked on Framework Manager and Report Studio for Model and Report design in Cognos BI 8.
- Effective in cross-functional and global environments to manage multiple tasks and assignments concurrently.
Education Qualifications:
Master’s in Computer Science
Skillset:
IBM Infosphere DataStage 8.1(Designer, Director), Ascential DataStage 7.x/6.x (Designer, Manager, Director), Ascential Datastage Parallel Extender, Cognos 8.0(Framework Manager and Report Studio), ERWIN 4.1/7.2, UNIX, Linux, Windows 9x/NT/2000/XP, Sun Solaris, SQL Server 2000/2005/2008, PL/SQL, UNIX Shell Scripting, XML, Oracle 8i/9i/10g/11g, MS-Access, DB2, Teradata, Sybase, Oracle SQL* Plus, SQL*Loader, TOAD, Oracle Forms 10g, Oracle Reports 10g.
Project Summary:
Confidential, Morris Plains, NJ 02/2009- Present
DataStage/QualityStage Developer
Confidential is a leading global manufacturer of major drugs and health products. It is world’s eighth largest pharmaceutical company and a premier consumer health company. The project objective was to validate the data and make it available for end user reporting, analysis and decision support and to improve the client services by preventing errors, providing real-time data and updating records as the transactions are completed.
Hardware/Software:
IBM Infosphere DataStage 8.1 (Designer, Director), Quality Stage, IBM Cognos8.0, Oracle 11g, SQL Server 2008, DB2 UDB, Flat files, Sequential files, Appworx, TOAD 9.6, SQL*Plus, UNIX, Windows XP.
Responsibilities:
- Involved in design phase meetings for Business Analysis and Requirements gathering.
- Designed the ETL processes using DataStage to load data from SQL Server 2008 and DB2 to staging database and from staging to the target Oracle Data Warehouse database.
- Developed and designed Data marts extensively using Star Schema.
- Project Life Cycle - from analysis to production implementation, with emphasis on identifying the source and source data validation, developing particular logic and transformation as per the requirement and creating mappings and loading the data into different targets.
- Used QualityStage to coordinate the delivery, consistency, removing data anomalies and spelling errors of the source information
- Designed, developed DataStage mappings, enabling the extract, transport and loading of the data into target tables.
- Understood functional documents for new business source systems and applications and their integration into the existing data warehouse.
- Wrote Extensive Unix scripts for running the DataStage jobs for validating data.
- Identified source systems connectivity, related tables and fields and ensure data suitably for mapping.
- Extensively analyzed the Data Sources in identifying data anomalies, patterns, value ranges.
- Used DataStage stages namely Datasets, Sort, Lookup, Peek, Standardization, Row Generator stages, Remove Duplicates, Filter, External Filter, Aggregator, Funnel, Modify, and Column Export in accomplishing the ETL Coding.
- Undertook Change and Enhancements request.
- Tuned DataStage jobs to enhance their performance.
- Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions.
- Wrote Release notes, Deployment documents and scheduled the jobs via the Appworx Scheduler.
- Used Business Objects for the reporting purposes.
Confidential, Richmond, VA 08/2007 – 01/2009
ETL Designer/DataStage Developer
Confidential is a diversified bank that offers a broad array of financial products and services to consumers, small businesses and commercial clients. The bank’s initial goal is to build the capability to better analyze the bank accounts. The project objective was to collect, organize and store data from different operational data sources and load into a single source of integrated and historical data for the purpose of reporting, analysis and decision support to improve the client services.
Hardware/Software:
DataStage 7.5.1 Enterprise Edition/Parallel Extender, Quality Stage, Flat files, DB2, Oracle10g, MS SQL, XML, Erwin 4.3, PL/SQL, Business Objects 6.5/6.1, UNIX, Windows NT, Autosys.
Responsibilities:
- Interacted with End user community to understand the business requirements.
- Prepared the required application design documents based on functionality required.
- Designed the ETL processes using DataStage to load data from Oracle, MS SQL, Flat Files (Fixed Width) and XML files to staging database and from staging to the target Oracle Data Warehouse database.
- Implemented dimensional model(logical and physical)data model in existing architecture using Erwin
- Used DataStage Parallel Extender stages namely Datasets, Sort, Lookup, Change Capture, Funnel, Peek, Row Generator stages in accomplishing the ETL Coding.
- Used QualityStage to coordinate the delivery, consistency, removing data anomalies and spelling errors of the source information.
- Studied the PL/SQL code developed to relate the source and target mappings.
- Designed and developed the jobs for extracting, transforming, integrating, and loading data using DataStage Designer.
- Developed job sequencer with proper job dependencies, job control stages, triggers.
- Used the DataStage Director and its run-time engine to monitor the running jobs.
- Involved in performance tuning and optimization of DataStage mappings using features like partitions and data/index cache to manage very large volume of data.
- Documented ETL test plans, test cases, test scripts, test procedures, assumptions, and validations based on design specifications for unit testing, system testing, expected results, preparing test data and loading for testing, error handling and analysis.
- Hands on experience on Autosys job scheduler.
- Involved in Unit testing, System testing to check whether the data is loading into target, which was extracted from different source systems according to the user requirements.
- Extracted the data from the data warehouse using Cognos for reporting purposes.
- Involved in production support working with various mitigation tickets created while the users working to retrieve the database.
Confidential, Minneapolis, MN 01/2006–07/2007 ETL Developer
Confidential Corporation is Fortune 500 Company with its headquarters located in Minneapolis, MN. It is the fifth largest retailer in the United States offering its services through a huge chain of retail stores and online services. The aim of the project was to migrate its Enterprise Data Warehouse (EDW) from Oracle 8i to Oracle 10g for better performance, maintenance and also for providing more reliable data to decision makers.
Hardware/Software:
Ascential DataStage 7.5(Designer, Manager, Director), Oracle 10g/8i, MS SQL Server 2005, DB2, Flat files, Sequential files, ERwin4.2, Sun Solaris Unix, Windows NT, QualityStage, MetaStage, Appworx, Business Objects.
Responsibilities:
- Involved in design phase meetings for Business Analysis and Requirements gathering.
- Worked with business functional lead to review and finalize requirements and data profiling analysis.
- Developed conversion and migration strategy in collaboration with functional business lead.
- Designed various Mappings (Source-to-Target) using DataStage to link between different source systems and Data warehouse for loading data into Warehouse.
- Created Hash tables referencing the Surrogate Key tables for quicker and more efficient lookup to Dimensions.
- Extracted data from source systems SQL Server and Sequential files, Flat files.
- Created DataStage jobs, batches and job sequences and tuned them for better performance.
- Extensively used Built-in (Sort, Merge, Aggregator), Plug-in Stages for extraction, transformation and loading of the data.
- Extensively used parameters in job properties for entering default values while loading.
- Used MetaStage for synchronization and integration of Meta data from various data Warehouse related tools and also used for automatically gathering process data from operational systems.
- Used QualityStage stages such as investigate, standardize, match and survive for data quality and data profiling issues during the designing
- Used Shared Containers for code reuse and implementing complex business logic.
- Used Appworx Scheduler to schedule the jobs.
- Developed test data and conducted performance testing on the developed modules
- Taking the regular backups of the jobs developed using DataStage Manager Export/Import utility.
- Worked on performance tuning and enhancement of DataStage job transformations.
- Participated in weekly status meetings, and conducting internal and external reviews as well as formal walkthroughs among various teams, and documenting the proceedings.
- Involved in creation and maintenance of several custom reports for various clients using Business Objects.
Confidential, Warren, NJ 05/2004 – 12/2005 DataStage Developer
Confidential offers a wide range of Checking, Savings, CD and Retirement products and all come with many free services including online banking, convenient account access, and 24/7 support. The aim of the project was to build an Enterprise Reporting System to support the portfolio management and performance analysis of the credit card business with various reward offerings. The whole application processes were comprised of ETL process for transactional data, Filter process to identify valid transactions, Calculation process for transaction and reward fee calculation, and data integration into the Data Warehousing System.
Hardware/Software:
DataStage 7.0/6.1 Parallel Extender, (Designer, Director, Manager), ERwin 4.0, Unix, Windows 2000, Oracle 8i, SQL Server 2000, IBM DB2, Sybase, PL/SQL, MS Access, Flat files.
Responsibilities:
- Responsible for understanding the requirements, analysis, design, development and implementation into the system.
- Involved in designing of data models using ERwin.
- Developed SQL Scripts to modify the existing database objects and packages.
- Created PL/SQL procedures, triggers and functions for processing portfolio management information.
- Executed complex SQL statements using joins, date functions, inline functions, and sub-queries to generate reports.
- Identified source systems, connectivity, related tables and fields and ensure that data is suitable for mapping.
- Involved in the testing of the forms against checklist, preparing problem reports and fixing the problems to have the correct functionality of all the forms.
- Created jobs in DataStage to extract from heterogeneous data sources like DB2, Sybase, Access, Flat files and Text files to Oracle.
- Scheduled and monitored the jobs in DataStage Director to load data into target database.
- Used server components (DataStage Repository, DataStage Server, and DataStage Package Installer).
- Evaluated the consistency and integrity of the model and repository. Created DataStage scripts for data transformation, conditioning, validation and loading.
- Developed, automated and scheduled load processes using UNIX shell scripting.
Confidential 03/2003–04/2004 Database Developer
The company is the world\'s leading supplier of information management software and the world\'s second largest independent software company.
Hardware/Software:
Oracle 8i, SQL, PL/SQL, ERwin4.0, TOAD, UNIX, Java, Oracle8i, LINUX, Windows XP.
Responsibilities:
- Tested manually the customized GUI software package which configured, monitored and controlled different databases and application servers.
- Developed and Executed Test Cases manuallythat tested the functionalities of CRS, various database instances, database functionalities like startup, shutdown, view, modified parameters, memory parameters etc.
- Wrote test script to automate the test cases using Web tester and ran the test scripts against the RAC 8i database and triaged the same as part of regression testing.
- Published bug reports, regression reports, performance testing results and test scenarios.
- Performed Functional, Regression (both SRG and LRG) and performance testing on the environment of Java, Oracle8i, LINUX, Windows XP.
- Upgraded an existing RAC database to the current release using the software tool called Database
- Upgrade Assistant ( DBUA).
- Successfully upgraded in the RAC setup, using DBUA, all the databases and configuration files on all the nodes in the cluster across different platforms and tested manually upgrade parameters, upgrade cancel, restore option etc.