Sr Datastage Admin/developer Resu
ME
SUMMARY
- Above 10 years’ experience in Data Warehouse (OLAP) using Teradata and Ascential Datastage, IBM Information server (Latest version of datastage i.e.V8.0.1 & V8.1) Decision Support Systems, Client/Server business systems design, development, testing and production.
- Excellent noledge and experience in data warehouse development life cycle, dimensional modeling, repository management and administration implementation of STAR, Snowflake schemas and slowly changing dimensions.
- Strong experience in Data Warehousing, Data Architecture, Data Modeling, Data Mining, Data Analysis, Decision Support System (DSS) and GUI applications.
- Extensive noledge in writing, testing and implementation of teh triggers, stored procedures, functions, packages using PL/SQL.
- Designed BO universe on Siebel CRM applications.
- A good exposure in developing Server jobs, Parallel jobs, and Shared containers.
- Designed and developed jobs using Parallel Extender for splitting bulk data in to subsets and to dynamically distribute to all available nodes to achieve best job performance.
- Experience in using various Server stages like Aggregator, Filter, Merge, Hash, Sort, Universe, Stored Procedure, DB2Load, Sybase Load, Folder, FTP, Pivot, and XML Input/Output.
- Familiarity wif OLAP reporting and business intelligence tools like Business Objects
- Performed Debugging, Trouble Shooting, Monitoring and performance tuning using Datastage.
- Experience wif Parallel Extender for Parallel Processing to improve job performance while working wif bulk data sources.
- Extensively used SQL, PL/SQL to program Stored Procedures, Functions and database Triggers, Cursors to enforce complex integrity constraints and for auditing purposes.
- Strong noledge of UNIX shell scripting (K, C shell), C and C++.
- Exceptional verbal and written communication skills, excellent team player.
TECHNICAL SKILLS
ETL Tools: IBM Information Server Datastage9.1,IBM Information Server Datastage8.7, IBM Information Server Datastage8.1, IBM Information server 8.0.1 (Administrator, Designer, Director), Ascential Data Stage 7.x/6.x/5.x (Administrator, Manager, Designer, Director), Meta Stage, Parallel Extender. Informatica Power Center V8.5.1
Data Warehousing: Data marts, OLTP, OLAP, Normalization, Dimensional Modeling, Facts, Dimensions, Star schema, Snow Flake schema.
Databases: Oracle 10g/9i/8i, DB2/UDB, MS SQL server 2005/2000, DB2, Teradata v2r6/v2r5/v2r4Data Modeling: Erwin 4.1/3.5, ER/Studio 3.5, Microsoft Visio 2000Reporting Tools: Business Objects XI/6.x/5.x, Crystal Reports XI/10/9/8
Programming Languages: SQL, PL/SQL, Unix Shell scripting, UML, C, C++, Java, Visual Basic 5.0
Operating System: Windows 2003/2000/NT, UNIX, Linux, HP, AIX
Web Development: J2EE, Applets, Servlets, EJB, XML, HTML 4.0.
Other Tools: MQ Series,Autosys, Maestro, SQL Loader, SQL Navigator, Toad, WSFTP MS Visual StudioVersion Control Clear Case, Clear Quest.
Hardware: NCR’S world mark 5200 MPP systems, SUN E 10K, HP - UX, VAX, MVS, AIX
PROFESSIONAL EXPERIENCE
Sr Datastage Admin/Developer
Confidential, ME
Responsibilities:
- Maintain all teh ETL servers for all teh environments. Provide a Common Framework for teh projects leveraging their efforts of maintaining teh environment.
- Building projects for teh teams such dat they will be able to use teh already structured directories and sub-directories. Also, re-built corrupted projects by running few steps and Importing from teh Daily backups.
- Migrated projects from 8.1 to IS8.7 GRID.
- Written Unix scripts and Routines such dat project teams can count lines in a file in teh Trigger condition, call C programs in Execute command stage and get parameters in teh User-defined stages.
- Involved in creating users, maintaining user groups and assigning roles
- Scheduled job runs using DataStage director, and used DataStage director for debugging and testing.
- Involved in WAS upgrade.
- Configure teh High Availability for DR.
- Configure teh Datastage application to LDAP Autantication
- Creating Datastage packages by using information server manager
- Worked on teh change management process wif in Guitar Center for changes to Production. Involved in teh Disaster Recovery tests wif in Guitar Center.
- Debug problems between DataStage server and client connectivity and Regulated teh DataStage for optimum performance Confidential all times.
- Built and created Wrapped stages such dat project teams Custom stages.
- Monitored teh logs for teh Daily Exports and Backups.
- Involved in schedule teh various process streams using TWS.
- Involved in writing shell scripts for ftp/sftp files.
- Involved in executing jobs on demand basis based on business people’s request.
- Involved in creating master sequences.
- Participated in teh design review meetings to come up wif teh proper methodology dat is to be followed uniformly across teh development.
- Collaborated wif project team members in providing design and development guidance, mentoring, best practices.
- Implemented data extraction and load processes in a parallel framework.
- Created teh Schema file to dynamically pass teh metadata in Sequential file stage.
- Created Shared Container to encapsulate teh logic dat is commonly used across teh project.
- Created ETL/DI designs for various source and target Databases
- Created Unix flow to unload data from Teradata and load to SQL Server Database
- Experienced on working TERADATA PARALLAEL TRANSPORTER
- Created teh multi-instance Generic Load Parallel Job dat is called in teh Job Sequence to load teh data into teh Teradata Database.
- Extracted data from idoc’s and loaded idocs into SAP system by using idoc connector in SAP R/3 pack.
- Extracted data from SAP Tables by using ABAP stage.
- Worked wif widely used stages like Flat File, Lookup, Join, Pivot, Transformer, Sort, Aggregator, Merge, Row Generator, and Column Generator and also Troubleshooted teh designed jobs and tested teh jobs for all logical errors.
- Created XML files by using new XML stage.
Environment: IBM Information Server Datastage8.1/8.7/9.1,DB2 V8, SAPR/3/ABAP, Solaris, UNIX AIX 6, Shell Scripts, PUTTY, TOAD. TWS, MQ
Sr. DataStage Developer/Lead/Admin
Confidential, NJ
Responsibilities:
- Upgraded IBM information server from 7.1 to and 8.5 on Solaris environment.
- Involved in SAP R/3 pack installation in both version 6.0 and 7.5
- Involved in fix pack installation for datastage
- Involved in WAS upgrade.
- Configure teh High Availability for DR.
- Configure teh datastage application to LDAP Autantication.
- Created new Datastage projects and file systems and make changes in datastage configuration.
- Assign teh proper permissions for developers, testers.
- Migrated projects from 7.1 to IS8.5 GRID.
- Written Unix scripts and Routines such dat project teams can count lines in a file in teh Trigger condition, call C programs in Execute command stage and get parameters in teh User-defined stages.
- Involved in creating users, maintaining user groups and assigning roles.
- Scheduled job runs using DataStage director and unix crontab and used Datastage director for debugging and testing.
- Worked on teh change management process wif in Guitar Center for changes to Production. Involved in teh Disaster Recovery tests wif in Guitar Center.
- Debug problems between DataStage server and client connectivity and Regulated teh DataStage for optimum performance Confidential all times.
- Built and created Wrapped stages such dat project teams Custom stages.
- Monitored teh logs for teh Daily Exports and Backups.
- Involved in schedule teh various process streams using TWS.
- Involved in Parallel Extender node configuration for various projects
- Excessive usage of Datastage Director for monitoring Job logs to resolve issues.
- Used Performance analyzer and resource estimator to estimate and monitor performance of stages/jobs.
- Created PMR’s and worked wif IBM SWG for teh product support.
- Given on-call support on 24/7 basis
- Used impact analysis to identify which jobs/stages using a particular metadata.
Environment: IBM Information Server Datastage7.1,8.5 Sun Solaris,SAP R/3 Pack, DB2, Oracle
Sr. DataStage Developer/Lead/Admin
Confidential, CT
Responsibilities:
- Upgraded IBM information server from 8.1 to and 8.7 on AIX environment.
- Involved in SAP R/3 pack installation in both version 6.0 and 7.5
- Involved in fix pack installation for datastage
- Involved in WAS upgrade.
- Configure teh High Availability for DR.
- Configure teh datastage application to LDAP Autantication.
- Created new Datastage projects and file systems and make changes in datastage configuration.
- Assign teh proper permissions for developers, testers.
- Migrated projects from 8.1 to IS8.7 GRID.
- Written Unix scripts and Routines such dat project teams can count lines in a file in teh Trigger condition, call C programs in Execute command stage and get parameters in teh User-defined stages.
- Involved in creating users, maintaining user groups and assigning roles.
- Scheduled job runs using DataStage director and unix crontab and used Datastage director for debugging and testing.
- Worked on teh change management process wif in Guitar Center for changes to Production. Involved in teh Disaster Recovery tests wif in Guitar Center.
- Debug problems between DataStage server and client connectivity and Regulated teh DataStage for optimum performance Confidential all times.
- Built and created Wrapped stages such dat project teams Custom stages.
- Monitored teh logs for teh Daily Exports and Backups.
- Involved in schedule teh various process streams using TWS.
- Involved in Parallel Extender node configuration for various projects
- Excessive usage of Datastage Director for monitoring Job logs to resolve issues.
- Used Performance analyzer and resource estimator to estimate and monitor performance of stages/jobs.
- Created PMR’s and worked wif IBM SWG for teh product support.
- Given on-call support on 24/7 basis
- Used impact analysis to identify which jobs/stages using a particular metadata.
- Involved in code promotion process.
- Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, Sort, Surrogate key Generator, Change Data Capture, Modify, Row Generator and Aggregator.
- Worked wif teh Business analysts and Subject Matter Experts to thoroughly understand teh different business processes and data Confidential various sources.
- Documented ETL high level design and detail level design documents.
- Involved in creating functional and scope documentation for data cleansing, conversion, and integration processes.
- Participated in teh review of Technical, Business Transformation Requirements Document Developed jobs using Quality Stage to strip teh unwanted data.
- Investigated and fixed duplicate data records making into teh landing tables.
- Involved in creating Message Queues to extract teh data from Mainframes using MQ Connector stage.
- Involved in creating ds jobs to extract/load teh IDOC’s from/to SAP using IDOC stage.
- Involved in designing ds jobs to no whether teh SAP process is completed successfully or not using BAPI stage.
- Involved in schedule teh various process streams using TWS.
- Involved in writing shell scripts for ftp/sftp files.
- Involved in executing jobs on demand basis based on business people’s request.
- Involved in creating master sequences.
Environment: IBM Information Server Datastage8.1, 8.7 AIX,SAP R/3 Pack, DB2, Clear Quest, Clear Case and Build Forge
Confidential, Deerfield, IL
Sr.ETL Developer/Admin
Responsibilities:
- Used Parallel Extender for partition parallelism, teh same job would TEMPeffectively will run simultaneously by several processing nodes, each handling separate subset of total data.
- Designed several parallel jobs using Sequential File, Dataset, Join, Merge, Lookup, Remove duplicates, Funnel, Filter, Copy, Column Generator, Peek, Modify, Oracle Enterprise, Aggregator, Transformer Stages.
- Responsible for FTPing teh files produced to teh respective consumer servers.
- Analyzed teh performance of teh jobs and project and enhance teh performance using teh standard techniques.
- Created job sequences and schedules for automation.
- Used DataStage to transform teh data to multiple stages, and prepared documentation.
- Documented teh purpose of mapping to understand teh process and in corporate teh changes as and when necessary. Finally send it for testing and production environment.
- Involved in teh development and implementation of ad-hoc reporting system using Business Objects.
- Used Join/Merge/Lookup Stages to replicate integration logic based on teh volumes of teh data.
- Responsible for unit, system and integration testing. Development test scripts, test plan and test data.
- Designed teh logical and physical data warehouse schema. Analyzed source systems and creating a mapping to teh target database schema.
- Involved in writing shell scripts for ftp teh files to different servers.
- Involved in gathering teh requirements.
- Involved in writing functional and technical specifications.
- Involved in SIT and UAT to check data consistency.
- Involved in designing POC’s.
- Involved in convert server jobs into parallel jobs.
- Involved in installing fix packs on server side on IIS 8.
- Upgraded IBM information server from7.5.1A to and 8.1 on Solaris environment.
- Created new Datastage projects and file systems and make changes in datastage configuration.
- Assign teh proper permissions for developers, testers.
- Monitoring and administrating DataStage server performance and usage
- Implemented teh various patches on teh system to ensure its TEMPeffective working.
- Involved in Parallel Extender node configuration for various projects
- Excessive usage of Datastage Director for monitoring Job logs to resolve issues.
- Involved in creating users, maintaining user groups and assigning roles.
- Extensively used DataStage Tools like Infosphere DataStage Designer, Infosphere DataStage Director for developing jobs and to view log files for execution errors.
- Used Performance analyzer and resource estimator to estimate and monitor performance of stages/jobs.
- Automated and Maintained backups of DataStage projects and restored them in emergency.
- Used impact analysis to identify which jobs/stages using a particular metadata.
Environment: IBM Information Server Datastage8.1, Siebel, Oracle10g, Linux, Shell Scripts, PUTTY, TOAD
Confidential, Austin, TX
Sr.Datastage Developer/Admin
Responsibilities:
- Involved in designing teh POC’s.
- Help team to convert informatica mappings into Datastage jobs.
- Involved in Datastage V8.1 Installation.
- Involved in Trouble shooting teh Aborted datastage jobs
- Involved in Data modeling.
- Involved in writing teh shell scripts.
- Involved in writing teh documents .i.e. Functional specifications and technical specifications.
- Involved in Datastage jobs performance tuning.
- Involved in creating datastage template jobs for identifying teh delta’s.
- Involved in install/upgrade Information Server product suite on different tiers.
- Involved in Create/Delete projects, create/modify environmental parameters. Multiple APT CONFIG FILE’s.
- Unlock, list, remove teh datastage jobs and remove teh VOC files, configure and verify teh environment variable settings in Datastage administrator.
- Import and export teh datastage code and changing teh compile trace mode option using datastage manager.
- Used Both Pipeline Parallelism and Partition Parallelism for improving performance.
- Designed XML stages for reading XML log files for capturing data stage jobs audit data.
- Involved in installing Datastage, changing license details.
- Upgraded Datastage from version from 7.5 to 8.1
- Used IBM clear quest and PVCS release management for Datastage code release purposes.
- Managed teh entire “ETL process” involving teh access, manipulation, analysis, interpretation and presentation of information from both internal and secondary data sources to customers in sales area.
- Raised PMR wif IBM for several config/server issues.
- Involved in teh creation of oracle Tables, Table Partitions, and Indexes. Involved in teh development and testing of individual data marts, and update processes. .
- Add, change, delete DS user variables and Unlock, list, remove DataStage job using DataStage Administrator.
- Deploying and compilation of teh datastage jobs
- Shutdown and Bringing up teh datastage and RTI servers
- Purging teh logfiles
Environment: IBM Information Server Datastage8.1, Informatica Power Center V8.5.1, Oracle10g,db2 v8, PL/SQL, AIX 5.2, Shell Scripts, Erwin5.5, PUTTY, TOAD,Clear Quest 7.0.1.0 and Clear Case 7.0.1.0
Confidential, Long Beach, CA
Solution Architect
Responsibilities:
- Created a template job for identifying Delta’s in an efficient way.
- Involved in datastage V8.1 installation and create/delete projects.
- Help team to convert server jobs into parallel jobs.
- Load data into dimension tables, generating surrogate keys for dimension tables and load dimensional data into fact table wif some business transformations.
- Developed Data stage parallel jobs using various stages.
- Export and import datastage jobs in different environments.
- Migrate teh Project from Version 7.5.1A to Version 8.1.
- Involved in writing functional and technical specifications.
- Involved in creating job sequences.
- Involved in writing shell scripts.
- Involved in project planning.
Environment: IBM Information Server Datastage8.1, Ascential Data Stage 7.5.1A, Oracle10g,db2 v8, PL/SQL, PeopleSoft, LINUX, Shell Scripts, Erwin5.5,Gloden Guddy, PUTTY, TOAD.
Confidential, San Roman, CA
Sr.DataStage Admin/Developer
Responsibilities:
- Implemented migration process from different systems.
- Extensively used Data stage to load data from DB2 and Mainframe COBOL files to Oracle.
- Created number of staging jobs to load teh data into target table.
- Created number of complex ETL jobs in this life cycle.
- Involved in migration, error handling and reporting, data quality issues,
- Extensively used stages like DB2, Flat File, Lookup, Joiner, Pivot, Transformer, Sort, Aggregator, Merge, Copy, Row Generator, Column Generator, CDC.
- Troubleshoot teh designed jobs and tested teh jobs for all logical errors
- Involved in Code Reviews
- Supported every available report using universes created in Business Objects XIR2
- Analyzed teh Data extraction from source to check for data irregularities and identify dirty data to apply suitable transformation in teh mappings in teh jobs
- Designed, build, and maintained Business Objects universes.
- Involved in preparation on Test Cases and Test Scripts followed by teh execution of teh same
- Worked on Export and import of Data Stage jobs
- Used different partitioning methods like Auto, Hash, Same, Entire etc
- Involved in Unit testing, System testing to check data consistency
- Written Oracle PL/SQL queries for data validations and other transformations.
- Prepared all documents necessary for noledge transfer such as ETL strategy, ETL development standards, ETL processes, etc
- Developed SQL scripts to augment teh ETL process and to check on final target data involved in Program Specification document preparation,
- Developed Data stage parallel jobs using various stages
- Involved in creation of Sequencers using Data stage Designer.
- Involved in teh development of Data stage parallel jobs using various stages and Sequencers and prepared scripts to run them.
- Involved in writing teh shell scripts for extracting or load files in different servers.
- Worked in importing and cleansing of data from various sources like DB2, Oracle, flat files onto SQL Server 2005 wif high volume data.
- Design teh ETL and ELT jobs based on teh business requirement using Datastage Designer.
- Program Specification Document preparation and review, ETL Development, review and testing, Performance Tuning of teh system.
- Extensively involved in Data Extraction, Transformation and Loading (ETL process) from Source to target systems using Data stage parallel Extender.
- Created data jobs to extract data from different source files, transform teh data using stages like Transformer stage, Aggregator stage to classify rows from a single input link to groups, Remove Duplicate stage to remove duplicate rows, Sort stage to sort teh data in a particular order, Copy stage to copy data into more number of links, Modify stage to alter record schema of its input data set, Filter stage to filter teh data, Join stage and tan load to data warehouse
- Created projects using DSAdmin.
- Involved in configure teh DataStage server for I/O usage.
- Created file system for teh projects and assigning proper permission to teh developers and testers.
- Involved in converting Perl scripts into shell scripts and writing new shell scripts.
- Datastage code migration/export using datastage manger.
- Run, stop, schedule dsjobs and view their log and save it in local machine using ds director, list, unlock, delete jobs using DSAdmin.
- Created apt file for teh project.
- Worked wif teh team in setting up new projects.
- Used teh Data stage Administrator to assign Privileges to users or user groups (to control which Data Stage client applications or jobs they see or run), move, rename, or delete projects, and manage publish jobs from development to production status.
Environment: Ascential Data Stage 7.5.1A, Business Objects XIR2, Oracle10g, PL/SQL, Mainframes, Cobol,JCL, DB2,SQL Server 2005,LINUX,Cognos, Shell Scripts, Perl, Cobol,Crontab, WS FTP, PUTTY, TOAD, OLAP, Visual Studio, Manual Testing, Microsoft SQL server Management Studio,MsAccess and VSS
Confidential, Rosemead, CA
Sr. Datastage Developer/Administrator
Responsibilities:
- Worked closely wif business analysts in requirements gathering, reviewing business rules and identifying data sources.
- Generated HLD, LLD, Source to Target mapping, test cases and miscellaneous documents.
- Performed analysis and designed teh business flow and mapping jobs.
- Created job to interact (END-to-END) for teh given data sources.
- Created ETL jobs and deployed as Web Service in order to communicate wif teh internal systems.
- Defined FTP scripts for file moving process from mainframes
- Moved files wif FTP utilities and archived on UNIX server
- Responsible for Extracting, transforming and loading data from Oracle, File Systems(Excel and XML) and loading target databases
- Worked on XML stages - XML Input, XML Output stages and XML Meta Data importer for handling XML files.
- Designed ETL interface wif Datastage for loading data to Siebel CRM
- Designed BO universe on Siebel CRM applications.
- Defined BO and Webi reports for Siebel customer data.
- Tuning SQL using Explain Plan and SQL Tuner
- Worked on real time components in IBM Information Server - WISD Input, WISD Output and
- SQL and PL/SQL wrote backend store procedures, functions and triggers.
- Web services Client stage for receiving and passing information to web services.
- Extensively Used teh IBM Information Server Designer to develop jobs to extract, transform and load data from various source systems into teh Data Warehouse.
- Designing teh Datastage jobs MQSeries as a source and DB2 as a target database.
- Extensively used IBM Information Server Director for scheduling teh job to run in batch, emailing and online production support for troubleshooting from LOG files.
- Used Job Sequencers to run teh jobs sequentially and reporting teh Status of teh Job through Email.
- Exported and imported teh Data stage jobs between teh production and teh development servers
- Involved in S.I.T (System Integration and Testing) and U.A.T (User Acceptance Testing).
- Involved in Exposing teh Data Stage jobs as Web Services using IBM Information Server Console.
- Involved in creating HXML files.
- Created Environment Variables using Datastage Administrator.
- Upgrade/Install patches on teh DataStage server. configure teh DataStage server for I/O usage.
- Start & Stop teh DataStage engine.
- Monitoring teh UNIX file system space.
- Adding/Modifying database connection parameters (ODBC or native).
- Restarting teh RTI agent.
- Monitor teh RTI console and listener ports.
- Trouble shooting ds jobs using DataStage director.
- Datastage code import/export using datastage designer.
- Compare teh code between two environments using third party tool (i.e. beyond compare).
- Supported all production servers by 24/7 days by on call-schedule wise.
- Configured nodes in configuration file using DataStage Designer.
- Updated/deleted/inserted DataStage environment variables using DataStage admin.
- Opened teh case wif IBM when issue is critical and unable to resolve wif in our team
Environment: IBM Information Server 8.0.1,Mainframes, DB2,UDB Cobol,Oracle10g, PL/SQL, UNIX, Shell Scripts, FTP, Visio 2003, SQL, SQL*Loader,TOAD, Erwin5.5, OLAP, Cognos, Manual Testing, VSS,MQ Series, Orchestrator(SCE own scheduling tool).