Sr Datastage Consultant Resume
Columbus, GeorgiA
SUMMARY
- Experience as working with various Relational Data Bases (RDBMS) as Oracle, Teradata, Netezza, MS SQL Server, and ODBC stages dealing as both source and target systems.
- Around 4.2 years of experience in system analysis, design, development and implementation of Data Warehousing Systems using DataStage, application development and Production Support.
- 1.6 years of experience as graduate research assistant in University of South Alabama performing research on Android platform application.
- Hands on Experience in Designing and Building Enterprise Data Warehouses using IBM Info Sphere DataStage (v11.3, v9.1, v8.7, v 8.5, v8.1, v7.5).
- Experience in working with Banking/Financial, Healthcare and Retail Industries.
- Experience as working with onsite - offshore model projects while working closely with clients and team members.
- Experience in gathering, documenting and analyzing the Business Requirement Documents, Software.
- Highly knowledgeable in concepts related to Data Warehouses schemas, Star Schema modeling and Snowflake modeling and processes.
- Proficient in data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon, surrogate key assignment and CDC (Change Data Capture).
- Extensive knowledge and experience in Parallel job stages (Datasets, Sequential file, Aggregator, Funnel, Filter, Look-Up, Surrogate Key, Remove Duplicate, Transformer, Column/Row Generator and Peek) along with Complex Flat Files and XML formats.
- Experience in loading high volume data, debugging, troubleshooting and performance tuning.
- Experience in UNIX environment as working with (Korn) Shell Scripts to automate file manipulation and data loading process.
- Worked on different scheduling tools like TWS and Control-M and knowledge on Autosys.
- Excellent communication skills and analytical skills and ability to perform as part of the team.
TECHNICAL SKILLS
ETL Data Warehousing: IBM Info Sphere DataStage v 11.3, v9.1, v8.7, v8.5, v8.1 and Ascential DataStage 7.5, ABINITIO GDE 1.12 & Co>operating System 2.1
Databases: Oracle, DB2, MS SQL Server, Teradata, Netezza
DB Tools: SQL Developer, SQL Navigator, SQL Loader
Programming Languages: C, C#, JAVA, SQL, PL/SQL and Python
Data Modelling: Dimensional Modelling, Star Schema, Snow flake Schema
Operating Systems: Windows 7/XP /2000/NT/98, UNIX
PROFESSIONAL EXPERIENCE
Confidential, Columbus, Georgia
Sr DataStage Consultant
Responsibilities:
- Interacted with the business to gather the requirement and prepared source to target mapping documents.
- Extensively implemented slowly changing dimensions phenomena for various modules.
- Created SQL validation scripts to perform the validation between the source and target after data loading.
- Worked on DataStage v11.3 to develop ETL jobs that loads the data from staging to target tables in SQL server as database.
- Involved in performance tuning for DataStage jobs and converted data loading SQL server scripts into high performance DataStage jobs.
- Created Unit Testing Documents covering the positive and negative test cases.
- Experience in working IBM EDW data models and loading data from source to staging and then staging to EDW and EDW to Mart.
Environment: DataStage v11.3, Oracle, SQL, MS SQL Server, Windows 7.
Confidential, Schaumburg, Illinois
DataStage Consultant/Lead
Responsibilities:
- Reviewed the project scope, requirements, architecture diagram, proof of concept (POC) design and development guide lines.
- Created S2T documents also done the data profiling and data scrubbing for Test data management (TDM).
- Dealt with various development/debug stages like row generator to create the test data for the jobs.
- Extensively used Dataset, Aggregator, Sort, Join, Funnel, Lookup, Merge, Filter and other parallel stages in developing the solution.
- Dealt with various database stages (Oracle, DB2 stages) as a source and target systems.
- Worked with DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into target files.
- Dealt with hash files for internal data flow across the jobs also for removing duplicates in server jobs.
- Performed various kinds of joins using join stage for the expected results.
- Created Job parameter sets for reusing the parameters.
- Writing Shell Scripts and scheduling Jobs using TWS.
- Executed the batch processes by using Server jobs frame work with (csv and ini) files as arguments.
- Worked with UNIX environment to execute (Korn) shell scripts along with basic tasks.
- Extensively used Resource Estimation feature of DataStage to implement ETL solutions with good performance.
- Performed various DataStage performance tuning techniques along with available performance analysis feature.
- Monitored the jobs/processes by utilizing the Director Logs and various Environment variables.
- Involved in weekly Code Review meetings to ensure the code deliverables meet the standards.
- Developed and unit tested ETL jobs according to requirements in the Technical Specifications.
- Involved in weekly project plan meetings to track the progress of work and to reach the mile stones.
- Achieved the project success within the committed timelines and quality of work as a great working experience with off-shore team of developers and with the client.
Environment: DataStage v9.1 and v8.7, Oracle, Teradata, Netezza, SQL, MS SQL Server, UNIX, Windows 7, WinScp, Putty.
ConfidentialSr Project Engineer
Responsibilities:
- Reviewed the project scope, requirements, architecture diagram, proof of concept (POC) design and development guide lines.
- Created S2T documents also done the data profiling and data scrubbing for Test data management (TDM).
- Dealt with various development/debug stages like row generator to create the test data for the jobs.
- Extensively used Dataset, Aggregator, Sort, Join, Funnel, Lookup, Merge, Filter and other parallel stages in developing the solution.
- Dealt with various database stages (Oracle, DB2 stages) as a source and target systems.
- Worked with DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into target files.
- Dealt with hash files for internal data flow across the jobs also for removing duplicates in server jobs.
- Performed various kinds of joins using join stage for the expected results.
- Created Job parameter sets for reusing the parameters.
- Writing Shell Scripts and scheduling Jobs using TWS.
- Worked with UNIX environment to execute (Korn) shell scripts along with basic tasks.
- Performed various DataStage performance tuning techniques along with available performance analysis feature.
- Monitored the jobs/processes by utilizing the Director Logs and various Environment variables.
- Involved in weekly Code Review meetings to ensure the code deliverables meet the standards.
- Developed and unit tested ETL jobs according to requirements in the Technical Specifications.
- Involved in weekly project plan meetings to track the progress of work and to reach the mile stones.
- Achieved the project success within the committed timelines and quality of work as a great working experience with off-shore team of developers and with the client.
Environment: DataStage v8.5, Oracle, Teradata, UNIX, Putty, Win SCP, TWS, and Windows XP.
Confidential
Project Engineer
Responsibilities:
- Analyzed the data and gathered the requirements for building a data warehouse.
- Actively involved in analyzing the old database system and mapping tables, relationships, columns
- Enforced the Business Rules by creating constraints.
- Successfully managed Extraction, Transformation and Loading (ETL) process by pulling large volume of data from various data sources.
- Tested to optimize the Stored Procedures and Triggers to be used in production.
- Created Database Objects Tables, User defined functions, Triggers, Stored Procedure, Constraints.
- Successfully implemented indexes on tables and views for optimum performance tuning.
- Debugging / editing the existing SQL Scripts.
- Optimized the performance of various SQL scripts.
- Documented all process and Data Flow involved in the database for future reference.
Environment: DataStage v8.5 and v8.1, SQL Server, UNIX, Teradata, Control-M, Putty, Windows XP.
Confidential
Project Engineer
Responsibilities:
- Extracting, Transforming and Loading data into Oracle tables using DataStage as ETL tool by applying various business rules.
- Prepared the detailed definition documentation of requirements, design, and development for the sources.
- Used DataStage Designer for extracting data from Flat files, UNIX file system (data as flat files).
- Used DataStage Manager for importing metadata from repository, creating new job categories and new table definitions.
- Created table definitions and look-up reference data from Revenue Management and Contract Accounts.
- Wrote transformation logic by using different functions like Field, Trim etc., for formatting data from source systems.
- Aggregated the borrower’s data and loan data for loan sales.
- Extensively involved in analyzing the data for each load (Weekly/Monthly) and working with the Business group to modify or re-define the transformation rules due to discrepancies in the data.
- Creating and using the data sets for testing and debugging the jobs.
- Creating Sequencers for executing the jobs in batch and combining different job interfaces.
- Creating email notifications in Sequencers for emailing the error logs, exceptions and job status.
- Using the DataStage Director and the log files for monitoring the errors and results, resolving the DataStage jobs locking by using clean up resources in DataStage Director.
- Tuning SQL statements in existing programs and creating new SQL queries (by effectively using them) to analyze the performance of queries.
- Involved in preparing and executing test for unit and integration testing.
Environment: DataStage v8.1 and Ascential DataStage v7.5, SQL, TWS, Oracle, Teradata, UNIX, Putty,