Senior Datastage Developer Resume
Erie, PA
SUMMARY
- 7+ years of total IT experience in the Analysis, Design, Modeling, Development, Implementation and Testing of Data Warehouse applications using DataStage and Client/Server Applications
- Experience in ETL methodologies in all the phases of the Data warehousing life cycle
- Experience in DataStage (Server and Enterprise Edition) using Components like Administrator, Designer, and Director
- Experience in DataStage Parallel Extender (Formerly known as DataStage PX) for Parallel Processing to improve job performance while working with bulk data
- Strong experience in the Administration, Implementation of Extraction, Transformation & Loading (ETL) Life Cycle using DataStage 11.5/9.1/8.5/8.0.1/7.5 X2/7.5.1.
- Extensive experience in database design for data warehouses with strong understanding of Star and Snowflake Schemas
- Developed the Technical Requirement Specifications with ETL design flow
- Expertise in using the different types of stages like Transformer, Aggregator, Merge, Join, Lookup, Sort, remove duplicate, change data capture (CDC), XML, Pivot, Filter, Funnel, Copy, Sort, Row/Column Generator, Peek, Dataset, Sequential File stages for jobs development
- Strong understanding of data warehousing concepts and dimensional data modeling
- Good Knowledge with Stage Variables, Parameter Variables and Environmental variables
- Used DataStage Director extensively to run, schedule, monitor, debug and test the application on development and to obtain the performance statistics
- Extensive knowledge in preparation of ETL design documents and mapping documents
- Developed Data Stage jobs to implement STAR schema and Snowflake schema modeling and Data Warehouse concepts like fact tables and dimension tables
- Experience on UNIX and extensively developed UNIX shell scripts
- Extensive experience in loading high volume data and performance tuning
- Good knowledge on Performance Enhancement and Trouble Shooting of DataStage jobs
- Efficient in all phases of the development lifecycle, coherent with Data Cleansing, Data Conversion, Performance Tuning, System Testing
- Expert in unit testing, system integration testing, implementation, maintenance and performance tuning
- Knowledge on Banking and Insurance Domain particularly in Customer Data management
- Worked on Production support
- Involved inProduction deployment activitiesand post production support activities
- Strong writing and documentation skills for the management, development and control of documentation
- Excellent team player with good organizational, communicational, interpersonal & analytical skills
- Participated in discussions with Project Manager, Business Analysts and Team Members on any technical and/or Business Requirement issues
- Worked in an Onsite - Offshore business model
- Knowledge of data warehouse principles and Kimbal, Inmon methodologies
- Knowledge of ETL and Database best practices
- Experience working with relational or OLAP database: Oracle, SQL Server, DB2
TECHNICAL SKILLS
Data Warehousing: IBM DataStage 7.5/8.1, 9.1 and 11.5(Designer, Director, Administrator, Sequence, Parallel & Server jobs)
Databases: Oracle 10g/9i/8i, DB2 UDB, SQL Server, Teradata, SQL Loader
Tools: Visual Basic 6.0, Excel, Power Point, QC, Autosys, TWS, Indesca
Dimensional Data Modeling: Data Modeling, Star Schema, Snowflake schema
Programming: XML, HTML, SQL and Unix shell scripts
Operating Systems: Linux, Windows-9x/NT/2000/XP, UNIX
PROFESSIONAL EXPERIENCE
Confidential, ERIE, PA
Senior DataStage Developer
Responsibilities:
- Analyzed Functional and Business Requirements
- Analyzed Source to Target mapping documents
- Developed the Technical Requirement Specifications with ETL design flow
- Created parallel and sequence jobs for all the phases
- Prepared detailed design documentation and develop the ETL jobs as per the requirement.
- Involved in Unit testing of individual components and Integration testing of final components
- Created source to target mapping diagrams and the logical flow diagrams to make the ETL design simpler
- Writing SQL statements to improve the performance of the jobs and tuning the SQL statements
- Exporting the jobs to Testing Environment from Development and then to Production
- Prepared Specification Documents and process documents for DataStage Jobs
- Developed Parallel jobs using various stages like Join, Merge, Lookup, Sort, Transformer, Remove Duplicate, Filter, Column Generator, Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems
- Involved inProduction deployment activitiesand post production support activities
- Created DataStage process design documents and run book for production support
- Worked on Validation of Data with Business Team and fixing the issues
Environment: IBM Infosphere Information Server 11.5, UNIX, SQL server, Indesca, Oracle SQL Developer
Confidential, Cincinnati, Ohio
Senior DataStage Developer
Responsibilities:
- Analyzed Functional and Business Requirements
- Developed the Technical Requirement Specifications with ETL design flow.
- Worked on parallel and sequence jobs
- Created jobs which loads the data from source systems to production and comparing with the current production load to validate the DataStage load with current production load
- Involved in Production support and worked on Production issues
- Created source to target mapping diagrams and the logical flow diagrams to make the ETL design simpler
- Working on performance issues in the new DataStage jobs and comparing the performance metrics against the current production
- Worked on creating Technical design document, DataStage job flow designs and rollout instructions to hand off the jobs to reporting group
- Writing SQL statements to improve the performance of the jobs and tuning the SQL statements
- Developed Parallel jobs using various stages like Join, Merge, Lookup, Sort, Transformer, Remove Duplicate, Filter, Column Generator, Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems
- Involved inProduction deployment activitiesand post production support activities
- Involved in DataStage migration from 8.1 to 9.1 versions for few projects
- Created DataStage process design documents, Specification Documents and process documents for DataStage Jobs and run book for production support
- Worked on Validation of Data with Business Team and fixing the issues
Environment: IBM Information Server DataStage 9.1, IBM Websphere Data stage 8.1, UNIX Server, SQL server, DB2
Confidential, Windsor, CT
DataStage Developer
Responsibilities:
- Involved in requirements gathering
- Worked on parallel and sequence jobs
- Experience on Datastage8.1 and Data Stage Administrator
- Computed extensive transformation logic within the ETL jobs using stages like (Sequential file, Dataset, Copy, Aggregator, Join, Look up, Funnel, Filter, Remove Duplicates, XML input, XML output, Oracle, Change capture, Shared Container and Transformer
- Tuned DataStage jobs for better performance to bring design parallelism
- Involved in Unit testing of individual components and Integration testing final components
- Working on performance issues in the new DataStage jobs and comparing the performance metrics against the current production
- Worked on creating Technical design document, DataStage job flow designs and rollout instructions to hand off the jobs to reporting group
- Exporting the jobs to Testing Environment from Development and then to Production
- Designed and developed Parallel jobs to extract data, clean, transform, and load the target tables using the DataStage Designer
- Designed and developed job sequencers and batches to run multiple jobs
- Prepared Specification Documents for DataStage Jobs
- Extensively used SQL coding for overriding the generated SQL in DataStage and also tested the data loaded into the data base
- Created DataStage process design documents and run book for production support
- Worked on Validation of Data with Business Team and fixing the issues
- Worked on Test case execution. (Initial and Delta) and fixing defects
- Supported QA testing by placing the files on the server
Environment: IBM Web sphere Data stage 8.1, UNIX Server, SQL, Oracle SQL developer, Job Control and ALM
Confidential
DataStage Developer
Responsibilities:
- Worked from development phase of the application by participating in documentation of HLD and LLD as per the Requirements from the architect and Reviewed FFD Data Model
- Involved in design, source to target mappings between sources to operational staging targets, using DataStage Designer
- Analysis and design of ETL processes
- Involved in the all the activities like testing, certifying and implementation of the data models in production
- Performed ETL coding using Sequential file, Transformer, Sort, Merge, Lookup, Hash file, Aggregator stages compiled, debugged and tested
- Extensively used stages available to redesign Data Stage jobs for performing the required integration
- Design and implementation of Job flows using Autosys for the functionalities supported
- Participated in Data conversion from other applications and loading the initial Data to FFD
- Executed jobs through sequencer for better performance and easy maintenance
- Used Data Stage Director to run and monitor the jobs for performance statistics
- Created the Control Plan, Technical Recovery Plan and other Quality Control documents for the production support teams
- Data conditioning in the Test environments to allow testing teams to perform the testing and Certification
- Involved in Unit, Integration and Performance testing of Mainframe jobs
- Used the Quality center to load the scripts, execute them, log the defects and track them until they are closed
Environment: IBM DataStage 7.5, Autosys, DB2, Quality Stage, SQL and UNIX
Confidential
DataStage Developer
Responsibilities:
- Involved in the design of an efficient, reliable ETL mechanism for updating the Data Warehouse, Data Marts and downstream systems
- Identifying the functionality gaps between Confidential Corporation and MBNA bank and develop the same functionalities in Confidential
- Converting the credit card information from MBNA to Confidential
- Involved in designing architectural diagrams and developing logic flow charts
- Developed UNIX shell scripts to automate file manipulation and kicked off the Data Stage Jobs
- Defined the program specifications for the data migration programs, as well as the necessary test plans used to ensure the successful execution of the data loading processes
- Involved in troubleshooting, Performance tuning and Performance monitoring
- Extensively worked with DataStage Designer for developing various DataStage parallel jobs using Sequential file, ODBC, Oracle Enterprise, Teradata Enterprise, Teradata API, Teradata Multiload, Aggregator, Join, Lookup, Pivot, Funnel, Filter, XML output, XML input and Transformer Stage
- Extensively used the transformer stage to implement business logic
- Performed unit testing of all monitoring jobs manually and monitored the data to see whether the data is matched
- Used Log in DataStage Director and Peek stage for debugging
- Used the Teradata Enterprise stage to extract and load data
- Was involved in ETL production support. Prepared the Operational documents & troubleshooting documents
Environment: IBM Data stage, Shell scripts, Autosys, DB2, SQL, UNIX, and Windows NT/XP