Datastage Developer Resume
NJ
SUMMARY
- Having 7+ years of experience in IT Industry especially in System Analysis, Design and Development in teh fields of Data Warehousing, Data Integration, Data Migration and developing Client server application using IBM Infosphere DataStage (8.x/7.5), Oracle 11g, PL/SQL, DB2 UDB, SQL procedural language,Unix Shell scripts.
- Experience in loading and maintaining large Data Warehouses and Data marts using IBM DataStage process wif In - Depth knowledge in Data Warehousing & Business Intelligence concepts.
- Expertise in Extraction Transformation and Loading (ETL) processes using IBM DataStage (Server & Parallel Extender), Profile Stage and Quality Stage
- Strong experience in Dimensional Modeling using Star and Snowflake schemas to build Fact and Dimensional tables. Extensively used CDC (CDC Change Data Capture) stage to implement teh SCD’s (Slowly Changing Dimensions) and fact tables
- Extensively used DataStage Client components like Data Stage Designer, Director and Administrator in Data Warehouse development. Worked wif Data Migration, Data Conversion in diverged environment like DB2 MF/UDB, Oracle, SQL Server and complex files (VSAM).
- Involved in Performance Tuning and trouble shooting of ETL programs.
- Expertise in OLTP/OLAP System Study, Analysis and Data Modeling using Kimball & Bill-Inmon methodologies, E-R modeling and Forward/Reverse Engineering.
- Worked on integrating data from different sources using ODS (Operational Data store)
- Experience introubleshootingof production jobs and addressing production issues like data issues, environmental issues, performance tuning and enhancements.
- Strong SQL experience in working wif SQL queries, PL/SQL Stored Procedures, Table Partitions, Packages, to load data into Data Warehouse/Data Marts.
- Proficient in all phase of software development life cycle (SDLC) including Requirement Analysis, Designing, Coding, Testing and Implementation
- Involved in Unit test, Integration Test, User Acceptance Test (UAT), Load Test and System Testing preparation and testing of teh applications
- Capable team player who works well wif people at all levels and excellent communication, analytical, interpersonal and presentation skills.
TECHNICAL SKILLS
ETL Tools: IBM Infosphere Datastage 8.7/8.1 and Ascential DataStage7.5
Operating System: Solaris 5.10, AIX ( UNIX ), Linux, MVS,OS/390, Z/OS, Windows XP, Windows 7, MS-DOS
Languages: PL/SQL, SQL, C, C++, HTML, Unix shell scripting, Perl, AWK, COBOL, JCL, CICS, REXX, Power Builder
Tools: and Utilities Perl, AWK, IBM DataStage 8.7/8.1/7.x, Oracle PL/SQL, DB2 Stored procedures, SQL Loader, MS Visio 2007 MS Project 2007, SAS, MQ series, FTP
Version control: PVCS, Endevor and Changeman
Scheduler: Autosys, Control-M, OPC, CA7
Debugging Tools: DataStage, Xpediter and CA-Intertest
Database: DB2, Oracle 10g/11g, MS SQL Server 2008, MS-Access, VSAM
Domain: Insurance, Banking, Healthcare
PROFESSIONAL EXPERIENCE
Confidential, NJ
DataStage Developer
Responsibilities:
- Migrated Medicaid/Medicare data from Legacy system Diamond to Facet application using datastage
- Designed and developed ETL processes using DataStage to load data from CSV files and Flat Files (Fixed Width) to staging area and teh target FACET Data Warehouse .
- Import/export jobs, table definitions, Custom Routines and Custom Transformations. sFTP formatted Medicare/Medicaid 835 file to different interfaces using Datastage Job and UNIX shell scripts.
- Scheduling Datastage jobs and UNIX scripts through Autosys scheduler
- Developed parallel jobs using different processing stages likeTransformer, Aggregator, Lookup, Join, Sort, Copy, Merge, Funnel, CDC, Change Apply and Filter.
- Used DS Director for monitoring Jobs and logs to resolve production issues.
- Moving projects from one environment to another for code deployment
- Written ETL jobs to retrieve various reference data from complex MF VSAM files and loaded to Oracle tables for processing.
- Managed different application interface systems in various phase of teh project to accommodate their changes.
- Prepared Unit and System Testing Plans and performed extensive Unit and System Testing, Integration testing and UAT to ensure quality
- Defined and implemented process management of ETL job scheduling and ETL Job dependencies, and job restart procedures.
- Preparing Impact Analysis by analyzing teh existing system for new Enhancements
- Worked closely wif QA team during teh testing phase and fixed bugs dat were reported
- Provided support for teh ETL jobs in production and troubleshoot and restart jobs in case of failure
Environment: IBM Infosphere Datastage 8.7/8.1, AIX, UNIX - (Sun Solaris 5.10), Sybase, Oracle11g, DB2 v9, KSH Shell Scripting, AWK, Perl, SED, Vi-editor, FTP, SFTP, PERL, SQL Server 2008, MS Office 2010, MS Visio 2007, MS Project 2007, Mercator.
Confidential, NJ
Datastage Developer/Senior Software Engineer
Responsibilities:
- Worked wif business users, project team members to generate and document requirements and solutions to business issues and tan participates in teh planning and implementation of those solutions.
- Prepared teh mapping documents for source to target wif different validations.
- Created Analysis, design documents and teh unit test case document for teh requirement.
- Designed, Developed, Tested server and parallel jobs as per technical design documents.
- Unlocking teh jobs and also installing Datastage plug-ins on UNIX servers.
- Responsible for clearing teh logs, job resources and status files in Datastage Director/Admin level.
- Developed Oracle Specific Load/Unload jobs for fast loading data from source files to tables.
- Developed UNIX shell scripts using K-Shell for automating teh initial load conversion process which calls ETL jobs to load data into target database system.
- Worked wif Quality stage Investigate, Standardization, Matching and Survive stages for data cleansing, building relationship between records
- Utilized predefined rule sets to correct data
- Developed job sequencer wif proper job dependencies, job control stages, triggers.
- Excessively used DS Director for monitoring Jobs and logs to resolve issues.
- Involved in designing applications using Service Oriented Architecture(SOA) Principals
- Performed scheduling of teh new jobs using Autosys
- Involved in design of dimensional data model - Star schema and Snow Flake Schema
- Experience in performance tuning of teh database, query optimization and database partitioning
- Performed system testing, Integration testing and UAT to ensure quality.
Environment: IBM Infosphere Server Datastage 8.7/8.1, C/C++, Orchestrate (ETL-Parallel Extender), UNIX - (Sun Solaris 5.10),Oracle10g, DB2 v9, KSH Shell Scripting, AWK, Perl, SED, Vi-editor, FTP, SFTP, PERL, SQL Server 2008, MS Visio 2007, MS Project 2007.
Confidential
Datastage Developer/Senior Software Engineer
Responsibilities:
- Analyzed teh existing informational sources and methods to identify problem areas and make recommendations for improvement. dis required a detailed understanding of teh data sources and researching possible solutions.
- Involved in Implementation of dimensional data model (logical and physical) in teh existing architecture using Erwin.
- Plan, coordinate and testing changes, upgrades and new products, ensuring systems operates correctly in current and future environment.
- Prepared ETL design document, Functional Requirement Documents, Functional Drawings for different flow, teh mapping document for source to target.
- Developed job sequencer wif proper job dependencies, job control stages, triggers.
- Extensively used Sort, Join, Funnel, Shared Containers, Filters, Remove Duplicates, Cleansing Routines, Change data Capture, Surrogate key Generator, Data Sets, Modify, Copy and Sequencer
- Designed Complex DataStage jobs to handle data flow between from COGEN tables and SAP Database
- Written many Perl scripts to parse teh raw data from input files to a standard layout before feeding to teh ETL Tool.
- Developed PL/SQL procedures/packages to start teh SQL Loader control files/procedures to load teh data into Oracle.
- Done Installations and configurations of Oracle Databases.
- Created primary Database storage structures (Table Spaces, Segment, Data files, Data blocks) and objects (Tables, Views, and Indexes).
- Used Hash Partitioning in Parallel Extender job for sorting of data and to get better performance.
- Involved in DataStage Tool Version migration from 8.1 to 8.7. Has maintained parallel testing environments
- Implemented Triggers, Views, Synonyms, Hints, Partitioning of Tables, Clustered and Non-clustered indexing. Extensive work on teh performance tuning of Oracle ETL process.
- Involved in creating UNIX Shell Scripts to automate Perl script execution and job triggering.
- Responsible to upgrades, patch installation to existing software.
- Developing appropriate work programs to TEMPeffectively schedule tasks/assignments
- Involved in teh Software Change and Configuration Management process by checking in all versions of teh Data stage and all releases of various documents in Serena PVCS change manager to keep track of teh changes in teh development test and production environment.
Environment: IBM Infosphere Server Datastage 8.1/7.5.2, C/C++, Orchestrate (ETL-Parallel Extender), UNIX - (Sun Solaris 5.10),Oracle10g, DB2 v9, KSH Shell Scripting, AWK, Perl, SED, Vi-editor, FTP, SFTP, SQL Server 2008, MS Visio 2007, MS Project 2007, COGEN.
Confidential
Developer/Technical Lead
Responsibilities:
- Designed, developed and maintained insurance Corporate billing processing related application programs using IBM Infosphere Datastage 8.5
- Created Functional requirement document (FRD) and Analysis design document (A&D) from teh Business requirement document (BRD) provided by teh business users.
- Implemented multi-node declaration using configuration files (APT Config file) for performance enhancement.
- Created Unit test case for teh batch and online programs mentioned in teh design documents
- Created system test case for QA team and UAT test case for teh business users
- Supported production maintenance activities and provided 24x7 maintenance, support, development and implementation of technical solutions to business requirements
- Responsible for implementing developed applications on to teh server for different environments.
- Created KSH scripts to automate file transfers, job scheduling, production deployment etc.
- Performed ABEND fix for any production abend and meeting SLA and tracking abend details in teh project system database to plan for permanent fix
- Responsible for creating Initial Analysis document for teh production abend and updating teh log
- Involved in Major and minor bug fix for teh maintenance activities and creating teh supporting documents
- Responsible for Managed File Transfer between different regions and interface systems using FTP and UNIX scripting.
- Deployment of teh application project components into test and production region and verification of teh data after implementation.
- Prepared new datasets from raw data files using import techniques and modified existing datasets using Set, Merge, and Sort, Update and other procedures and functions using SAS tool
- Has written many DB2 stored procedures using static and dynamic SQL
- Worked independently on many DB2 Performance tuning projects
- Worked on DB2 Data Sharing to make teh productions jobs run across multiple subsystems to reduce teh load in production region
- Worked on Multiple FETCH and INSERT concepts in DB2 SQL CURSOR to improve performance and optimization
- Managing Remedy tickets, scheduling and tracking it to closure using Lotus notes
- Responsible for tracking and logging UAT test results using QC wif HP quality center
- Performed recovery and backup procedure for teh production tables
- Extensively worked wif DB2 Explain, Runstats, REORG
- Provided technical leadership and Mentoring for teh new and less experienced staff
- Taking care of teh process Audit for teh project and ensured timely submission of teh metrics
- Provided estimation to clients for all teh projects worked by teh team
- Coordinated wif teh client team during production moves and support.
- Participated in weekly status meetings and contributed views in project proceedings wif client team.
Environment: IBM Infosphere Server Datastage 7.5.2, C/C++, UNIX - (Sun Solaris 5.10), REXX, SAS, Oracle10g, DB2 v9, FTP, HP Quality center, UNIX Shell Scripting, Perl, HTML, XML, SED, Vi-editor, SFTP,, SQL Server 2008, SQL Loader VSAM, ORACLE, MS Visio 2007, MS Project 2007