Sr. Data Stage Developer Resume
Bentonville, AR
SUMMARY
- More than 10+ years of experience in using IBM Information Server DataStage 11.5, 9.1, 8.7, 8.1.
- Expertise in Enhancements and Evaluation of Banking, retail and Financial Applications.
- Experience in Dimensional Data Modeling, Star/Snowflake schema, FACT & dimensions tables.
- Strong design experience to independently turn Physical Data Model into DataStage job design.
- Strong DataStage implementation skill to complete implementation within tight project schedule.
- Experienced in Full Life Cycle Development of building a Data Warehouse for large technology projects including Analysis, Design, Development, and Maintenance.
- Very strong experience with various versions of Datastage and IIS suite components.
- Expert level knowledge of relational databases (especially DB2 and Oracle) and worked on Flat files,
- Used Quality stages for enrich data to meet business objectives and data quality management standards.
- Strong Unix shell scripting skills, worked on Citrix installation and implementation.
- Expert level experience for performance troubleshooting and enhancement for large volumes of data and Strong analytic skill of debugging existing DataStage applications.
- Hands on experience in Migration Projects and Data Migration projects.
- Complete team co - ordination involving task allocation among team members and holding frequent discussions to monitor progress of project work.
- Complete co-ordination with different stakeholders (Business users, UNIX team, Scheduling Team, Release Management, Change Management, Citrix team and Application teams in IIS platform).
- Involved in analyzing in business requirements and involved in performance tuning.
- Responsible for bringing new members of the team up to speed through knowledge sharing sessions.
- Extensively worked on Parallel Jobs using Various Stages like Join, Lookup. Lookup File Set, Change Capture, Filter, Funnel, Copy, Sort, File set, Sequential File, Data set, Oracle Enterprise, Merge, Aggregator, Remove Duplicate Stages.
- Strong interpersonal, written and verbal communication skills. Multilingual, highly organized, detail-oriented professional with strong technical skills.
- Extensive experience on DataStage Designer, DataStage Director and knowledge on DataStage Administrator.
- Experience in working with RDBMS like, DB2, TERADATA, ORACLE and SQL Server.
- Self-starter, highly motivated individual who works well independently and in a team.
- Experience in working onshore-offshore business model.
- Knowledge across all aspects of Workflow-documenting business processes, analyzing processes, recommending improvements.
- Experience working with message handlers and parallelism techniques.
- Strong analytical and problem solving skills with the ability to quickly adapt to new environments and learn new technologies.
- Excellent problem-solving and trouble-shooting capabilities. Quick learner, highly motivated, result oriented and an enthusiastic team player.
TECHNICAL SKILLS
Operating Systems: WINDOWS 2000/NT/XP, IBM-AIX 5.3, HP UX, Linux
RDBMS: ORACLE 8i/9i/10g/11, DB2/AIX 64 8.2.3/9.5.3 , MS SQL Server, Teradata
ETL Tools: Data Stage 11.5, 8.7/8.1 Quality Stage 7.x/8.x
Scripting: WSAdmin, Unix Shell scripts, Java Scripts
Data Model Tools: Erwin 4.1, Microsoft Visio
Database Tools: Toad 7.6/9/10g, AQT 8.1, PL/SQL Developer, DB2 Load Utility, SQL * Loader
Version Control Tools: SharePoint, Rational Clear Case, Datastage Version, CVS, Test Directory
Scheduling: Tivoli Workload Scheduler, Job sequencer, Crontab, Autosys, Batch program
PROFESSIONAL EXPERIENCE
Confidential, Bentonville, AR
Sr. Data Stage Developer
Responsibilities:
- Involved in unit testing for the prepared graphs and wrapper script.
- Worked as an ETLdeveloperfor migrating the code from ETL (Datastage) 9.1 to 11.5.
- Involved in Production support of the jobs build and for the team.
- Involved in understanding of the business process and coordinate with business analysts and SME's to get the application requirements.
- DevelopedDataStagejobs according to the requirements as part of initial migration.
- Developed theDataStagejobs that include Extract, Transformation and loading of customer data in to the databases and transmit the files to the down streams.
- Supported for existing project, which use Clear-case tool for version controlling and migrating the code that was checked in Clear-case to the next higher environment.
- Worked on developing and projects from scratch for a new project and created script for making the job automated that were checked in into Clear-case by thedevelopersand deploy those packages in to other environment.
- Worked in Platform support team, which is responsible to work on any platform related issues.
- Extracted and loaded data from/to various sources like DB2 database, Oracle Database, Flat Files and loaded to target warehouse.
- Used IBM Fast Track and Metadata Workbench for data mapping and data lineage purpose.
- Build a robust and high performance grid platform which can process huge volume of data in minimal time. And reduce number of processes accessing mainframe database for accessing information.
- Designed jobs using different parallel job stages such as Join, Merge, Lookup, Filter, and Dataset, Lookup file Set, Remove Duplicates, Change Data Capture, Modify, and Aggregator and file stages such as sequential file, datasets and Complex Flat files.
- Involved in Unit Testing and system testing for the jobs.
- Involved in onsite and offshore coordination to resolve the issues and project tracking with monitoring the tasks to be completed within the project scope.
Environment: IBM Information server (DataStage) 9.1,11.5 (parallel and server Jobs), IBM Clear Case, Unix Shell Scripting, Windows, SQL Server 2008, DB2, PL/SQL, Oracle 10/11g and Putty.
Confidential, SFO, CA
Data Stage Developer
Responsibilities:
- Provided effort estimates for the design and development.
- DevelopedDataStagecustom jobs as per the business requirements for each module.
- UsedDataStagecustom routines, shared containers and open/close run cycles to load the data as per the client standards.
- Performed system testing, integration and UAT.
- Wrote the SQL queries for extraction of data.
- Coordinated with client managers, business architects and data architects for various sign offs on data models, ETL design documents, testing documents, migrations and end user review specifications.
- The scope of the project Involved working on the data that needed to be extracted from the flat files received from Obama HealthCare and loading into the staging (IDS) database and performing ETL on the data which would be further processed before loading it into the (EDW) data warehouse.
- Worked on Facets database extensively.
- Participated in Sprint planning meetings and daily Scrum calls to determine the best architectures, requirements, and designs emerging for the team and then tuned to adjust the target dates.
- Participated in the Confidential analysis to resolve business and technical issues and resolve conflict, timeline, delivery plans, and other standard project artifacts and deliverables required by the project.
- Arranged meetings with BDAs, BAs and created technical design document for developing DataStagejobs.
- Performed requirements collection, analysis and design of database, documented the same and uploaded to SharePoint.
- Defined various mappings and usedDataStageto access different source systems and generated XML files.
- Used Sybase Enterprise stage to extract data from Facets. Scrubbed the data usingDataStage Designer Stages such as ODBC, Native plug-in, Sequential File, remove duplicates, Filter, Aggregator, Transformer, Join, Lookup, XML input, XML output, Sort, Funnel, Dataset, Copy, Modify, Row generator and Merge Stages to generate XML files.
- Updated theDataStagejobs based on the user request.
- Created sequencers to sequentially execute the designed jobs. Used Execute Command Activity Stage, Notification Activity Stage, job activity, routine activity and sequencer stages to implement these sequencers.
- Involved in optimization of jobs and followed the IBM standard best practices in ETL.
- ImportedDataStagejobs from Production and modified based on updated business requirements.
- Responsible for successful management and facilitation of test plan execution, test case development, end-to-end integration testing, and UAT.
Environment: IBMDataStage8.7, UDB/DB2, Flat files, CSV files, XML files, SQL Server 2008, SQL, PL/SQL, UNIX, Teradata, Putty
Confidential, Peoria, IL
Sr. Data Stage Developer
Responsibilities:
- Identified business needs, evaluated business and technical alternatives, recommended solutions and participated in their implementation.
- Adapt ETL processes to accommodate changes in source systems and new business user requirements.
- Used the IBM Information server 8.5 to develop processes for extracting, cleansing, Transforming, integrating, and loading data into data warehouse database.
- UsedDataStageParallel Extender parallel jobs for improving the performance of jobs.
- Implementing Industry ETL standards and standard practices, performance tuning during designing theDataStageJobs.
- Extensively worked on building ETL interfaces to read and write data from DB2 database and SQL Server database using ODBC Stage.
- Extensively worked on Connector Migration Tool to convert 8.1 jobs to 8.5.
- Extensively worked on IBM Info Sphere Connector migration tool.
- Developed Parallel jobs using Parallel stages like: Dataset, Sequential file, FTP, Funnel, Filter, Modify, Merge, Join, Lookup, Transformer and Remove Duplicate Stage.
- Extensively used processing stages like the Join and Lookup stages to perform lookup operations based on the various target tables.
- Worked on Change Data Capture (CDC) stage.
- UsedDataStageDirector to validate schedule run and monitor the data stage jobs.
- Used Before/After Job-Subroutines in Job Properties.
- Designed Job sequencers to automate the process and Created sessions and batches to run the mappings and set the session parameters to improve the load performance.
- Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions.
- Resolved issues occurred during regular testing and BLT Testing.
- Modified the DS jobs to improve performance.
- Used Autosys scheduling tool to automate the ETL jobs.
- Involved in unit, performance, Regression and integration testing of data stage jobs and prepared technical design Documentation.
Environment: IBM Information ServerDataStage& Quality Stage 8.5.1, 8.1.1(Designer, Director and Administrator), IBM DB2 9.1, SQL Server 2005 AIX 5.1, Shell Scripting, SQL, PL/SQL, WinSql for DB2, Autosys 11.0, Clear Case, Microsoft Visio.
Confidential
Data Stage Developer
Responsibilities:
- Analyzing the specifications and identifying the source data that needs to be moved to the data warehouse.
- Developed jobs Using Parallel Extender for Extraction, Transformation and Loading (ETL) the data into the data warehouse.
- Designed the Jobs using the DB2 enterprise stage, Look up Stage, Merge Stage, Join Stage, Data Sets, Sequential Stage, Row Generator Stage, Transformer Stage and Modify Stage.
- UsedDataStageManager for importing metadata from repository, new job categories and creating new data elements.
- Used theDataStageDesigner to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts.
- Defined the data definitions and created the target tables in the database.
- Mapped the source and target databases by studying the specifications and analyzing the required transforms.
- Wrote the SQL queries & PL/SQL code tables and Data Mart Staging Tables to validate the data results by counting the number of rows in both the tables.
- Developed UNIX shell script to run jobs in multiple instances by using a parameter file.
- Performed Import and Export ofDataStagejobs usingDataStageManager to take backups and maintain them in CVS.
- Interacted with Solutions analysts, system staff, ETL, BOdevelopersand the data load staff.
- Involved in Unit, Integration, System and User Acceptance Testing (UAT).
- Using ODBC stage Extracted the data from SQL Server databases, Oracle databases and loaded in to DB2 Tables
- Created Complex SQL Queries and Used in the Jobs.
- Used the inter process stage to connect passive stages as well as active stages to enhance performance.
- Used the surrogate key stage to generate surrogate keys on parallel jobs.
Environment: IBM Information Server (DataStage) 8.1, EPIC, Parallel Extender, Oracle 10g, IBM DB2 UDB 8.2/8.0, SQL SERVER 2000, Teradata, Windows XP, AIX 5.3/5.1, Putty.
Confidential
ETL Developer
Responsibilities:
- Gathered all the information from existing ETL team and source providers.
- Participated in business meetings and understood the current job flow and their dependencies.
- Exported jobs from production to development, worked on the issues raised and moved back to the production environment.
- Used Auto-sys - Scheduling tool to schedule jobs in the production environment based on the pre-conditions and job dependencies.
- ModifiedDataStagejobs to improve the performance of the job.
- Used JIL scripts to create boxes in the auto-sys environment.
- UsedDataStagedirector to run the jobs manually.
- Worked closely with the mainframedevelopersin getting the source files, and discussed the data related issues.
- Analyzed the total architecture and documented them for the future reference.
- Used sequential files, Flat files, oracle database, mainframe files as source and oracle 9i as the target.
- Extensively worked with Parallel Extender for parallel processing to improve job performance while working with bulk data sources.
- Developed jobs in Parallel Extender using different stages like Transformer, Aggregation, dataset, Filter, Lookup, Surrogate key, Sort, Remove Duplicates stages etc.
- Data is loaded from different source files to staging and applied transformations then loaded into ODS.
- Worked closely with Data Analysts to make sure the data is accurate and consistent for table loads.
- Extensively worked on Error handling, cleansing of data, Creating Hash files and performing lookups for faster access of data.
- Involved in performance tuning of the ETL process and performed the data warehouse testing.
- Query Optimization for improving the performance of the data warehouse.
- Resolved issues occurring during the UAT (user accepting testing) and SIT (System Integration Testing)
Environment: IBM Information Server (DataStage) 8.1.1, Quality Stage 7.5.1, PL/SQL, Oracle 10g, Windows NT.