Sr. Datastage Developer Resume
Jersey City, NJ
SUMMARY
- IT professional, 7+ years experience in System Analysis, Design and Development and around 5 years of experience in IBM Infosphere, IBM DataStage v 8.1/ 7.x/6.x/5.2 (Server and Enterprise Edition), using Components like Administrator, Manager, Designer, and Director.
- Expertise in Dimensional data modeling, Star schema modeling, Snow - Flake modeling, identification of fact and dimension tables, Normalization, Physical and Logical data Modeling using ERwin and Oracle Warehouse Builder to implement Business Intelligent systems.
- Experience in Parallel extender jobs, Sequencer jobs and Server Jobs in DataStage.
- Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, Remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML.
- Proficiency in data warehousing techniques for Slowly Changing Dimensions, Surrogate key assignment and Change Data Capture.
- Extensively used DataStage- Manager to Export/Import DataStage Job components and Import Plug in Table Definitions from DB2UDB, Oracle .
- Proficient in working with Oracle, Access, SQL Server, and DB2 Databases.
- SQL Server, DB2 UDB and good understanding of COGNOS tool.
- Extensive experience in development of UNIX Shell scripts for file management, Scheduling ETL Jobs, Reject Reprocessing and SFTP processes.
- Extensively used SQL coding for overriding the generated SQL in Datastage and also tested the data loaded into the data base.
- Proven track record in troubleshooting of DataStage Jobs and addressing production issues such as performance tuning and enhancement.
- Excellent in Documentation, End-User Training, Knowledge Transfer and Production Support.
TECHNICAL SKILLS
RDBMS: Oracle 10g,9i, 8i/8.0/7.x, MS SQL Server, Sybase, DB2 UDB 6.x, 7.x,8.x, DB2 Z/OS, DB2 AS/400, MS Access 7.0, SQL server 2008, Teradata 12.0.0.09.
ETL & BI Tools: Ascential DataStage 5.1/5.2/6.0/7.0/7.5. x/8.x, QualityStage 7.x/8.x, Informatica 6.x/5.x, Cognos 6.x, Business Objects 4.x/5.1 Tools Crystal Reports, Developer 2000, SQL* Loader, TOAD, Erwin, N-Vision Reports, SAP NetWeaver MDM.
Programming: C,C++,COBOL,Java,SQL,PL/SQL
Environment: Sun Solaris 5.x, 2.x, AIX 5.x, HP-UX B.11.31, UNIX, Korn Shell, Bourne Shell, Novell NetWare, Win 95/98, XP, Win NT 4.0/2000, Linux 2.6.9-55,Fedora Linux 10, Redhat Linux.
PROFESSIONAL EXPERIENCE
Confidential, Jersey City, NJ
Sr. Datastage Developer
Responsibilities:
- Used the Datastage Designer to develop processes for Extracting, Cleansing, Transforming and Loading data into SAP using Idoc’s.
- Used different stages of Datastage Designer like Lookup, Join, Merge, Funnel, Filter, Copy, Aggregator, Sequential files, Datasets, Sort, Remove duplicate and Transformer with different functions..
- Developed Datastage Jobs, sequencers with NO warnings and also redesigned all ready existing code for Zero warnings.
- Created Project Level Parameter Sets and its Value files for different environments.
- Code reviewed Datastage Jobs and UNIX scripts.
- Used Hash, Entire Partitioning methods among different Partitioning Techniques.
- Used Datastage Director for validating, execution, monitoring Jobs, Processes and check the log files for errors.
- Written UNIX Script to pick the most recent file based on timestamp in filename from remote server.
- Responsible for running of DI processes using Autosys in PROD and Pre-Prod.
- Responsible for fixing the issues which raised due to failure of DI processes.
- Responsible for fixing defects that are part of Hyper-care defect resolution.
- Modified and added processes to the Autosys JIL’s to schedule them, which were not scheduled before or which didn’t exist.
- Identify the cause of failure of Autosys/Datastage processes and notify the concerned with its root cause.
- Used Datastage Designer for importing metadata into repository, for importing and exporting jobs into different projects.
- Performed unit testing of all monitoring jobs manually and monitored the data to see whether the data is matched.
- Used Log in Datastage Director and Peek stage for debugging.
- Written JIL’s in autosys for scheduling of Datastage Jobs and DI processes.
- Used several stages While developing Parent, Child Sequencers like Start Loop, End Loop, UserVariable Activity, Nested Condition, Routine Activity, Exception handler, Abort notification, Wait for file and Mail Notification stages to build an overall master Sequencer and to accomplish Re-start ability.
Environment: IBM Information Server DataStage 8.1, Windows Vista Enterprise, Visio, AIX, SAP, Putty, WinSCP.
Confidential, Chicago, IL
Sr. Datastage Developer
Responsibilities:
- Migrated Datastage Jobs from Datastage 7.5 to Datastage 8.0.
- Using Functional Document(FD) prepared Detail Design Document(DDD) for the development of DataStage Jobs.
- Used the Datastage Designer with complex oracle queries to develop processes for extracting large amount of data from Oracle EDW .
- Used different stages of Datastage Designer like Lookup, Join, Merge, Funnel, Filter, Copy, Aggregator, Sequential files, Datasets, Sort, Remove duplicate and Transformer with different functions..
- Developed New Datastage Jobs, sequencers with NO warnings and also redesigned all ready existing code for Zero warnings .
- Designed and coded the automation of SFTP process which completes in less than 10 mins, previously consumed 4 hrs of IT time every day.
- Created Project Level Parameter Sets and its Value files for different environments.
- Written UNIX scripts for SFTP of files which updates it’s SFTP status in database and notify’s the business after success or failure.
- Used Hash, Entire Partitioning methods among different Partitioning Techniques.
- Used Datastage Director for validating, execution, monitoring Jobs, Processes and check the log files for errors.
- Integrated all the subject area’s of application into a master sequencer which is scheduled monthly.
- Written most complex queries which setup’s Plan Configuration for PBM business.
- Used Orchadmin for managing datasets in file system when space is full or ds are corrupted..
- Used Datastage Designer for importing metadata into repository, for importing and exporting jobs into different projects.
- Performed unit testing of all monitoring jobs manually and monitored the data to see whether the data is matched.
- Used Log in Datastage Director and Peek stage for debugging.
- Worked with QA team, supported them in running the Jobs, analyzing data with complex logics.
- Used several stages While developing Parent, Child Sequencers like Start Loop, End Loop, UserVariable Activity, Nested Condition, Routine Activity, Exception handler, Abort notification, Wait for file and Mail Notification stages to build an overall master Sequencer and to accomplish Re-start ability.
Environment: IBM Information Server DataStage 8.1, Windows Vista Enterprise, Visio, AIX, Oracle 10.2.1, TOAD, SQL developer, Tidal 3.2.1.4466, Atlassian tools, Putty, WinSCP.
Confidential, Peoria,IL
Sr. Datastage Developer
Responsibilities:
- Used Information Analyzer to gather and analyse the Technical metadata characteristics of the data.
- Using Interface Design Document(IDD) prepared Technical Design Document(TDD) for the development of DataStage Jobs.
- Used the Datastage Designer to develop processes for Extracting, Cleansing, Transforming and Loading data into TeraData EDW.
- Used different stages of Datastage Designer like Lookup, Join, Merge, Funnel, Filter, Copy, Aggregator, Sequential files, Datasets,Modify, and Sort.
- Used CDC (Change Data Capture) Stage to Capture the New records and updated records and Impemented SCD type 2.
- Created Project Level Parameter Sets and its Value files for different environments.
- Used Teradata Enterprise Stage for Teradata Multiload and Used TeraData Connector,,ODBC ConnectorStages for looking up against DB2 and Teradata Views.
- Used Hash,Entire Partiotioning methods among different partiontioning Techniques.
- Used Datastage Director for validating, execution, monitoring Jobs,Processes and check the log files for errors.
- Scheduled Jobs using TIDAL scheduling Tool.
- Used Datastage Designer for importing metadata into repository, for importing and exporting jobs into different projects.
- Performed unit testing of all monitoring jobs manually and monitored the data to see whether the data is matched.
- Used Log in Datastage Director and Peek stage for debugging
- Supported Testing Team in SIT by assisting them with Functionality as well as Datastage tool.
- Worked in UAT supporting client in Preparing Grief analysis Report and Data Validation using Business Objects Reports.
- Developed UNIX scripts to automate the Data Load processes like moving files to Execution folder after identifying the correct file’s to read and Creating a header and footer to file after success full completion of Job.
- Used several stages While developing Parent, Child Sequencers like Start Loop,End Loop,UserVariable Activity,Nested Condition,Routine Activity and Mail Notification stages to build an overall master Sequencer and to accomplish Re-start ability.
- Assisted both the DEV and Testing OFFSHORE teams.
Environment: IBM Information Server DataStage 8.1, Windows Vista Enterprise,Visio, Linux 2.6.9-55, Oracle 10.2.1, Teradata 12.0.0.09, DB2, Teradata SQL Assistant 12.0, Tidal 3.2.1.4466, HP Quality Centre 10.0,SAP Business Objects,SAP.
Confidential, Seattle, WA
Datastage Developer
Responsibilities:
- Used the Datastage Designer to develop processes for Extracting, Cleansing, Transforming and Loading data into Oracle Database.
- Used different stages of Datastage Designer like Lookup, Join, Merge, Funnel, Filter, Copy, Aggregator, Sequential files and Sort.
- Developed several jobs to improve performance by reducing runtime using different partitioning techniques.
- Used Information Analyzer to gather and analyse the technical metadata characteristics of the data.
- Used Datastage Director for validating, execution, monitoring jobs and check the log files for errors.
- Used stage variables for source validations, to capture rejects and used Job Parameters for Automation of jobs.
- Created Project Level Parameter Sets.
- Migrated Jobs among different environments.
- Performed unit testing of all monitoring jobs manually and monitored the data to see whether the data is matched.
- Developed UNIX scripts to automate the Data Load processes to the target Database file.
- Used DataStage Director and the runtime engine to schedule running the solution, testing and debugging its components and monitoring the resulting executable versions.
- Used ODBC stage to do Extraction/loading/Lookup/manipulating of data.
- Used several stages in Sequencer like Abort Job, Wait for Job and Mail Notification stages to build an overall main Sequencer and to accomplish Re-start ability.
Environment: IBM Information Server DataStage 8.1 EnterpriseEdition(Parallel extender), Oracle, SQL,Microsoft Visio, Erwin 4.0, Windows NT 4.0 sp 6a, IBM AIX, Cognos, Autosys scheduler.
Confidential, Auburn Hills, MI
ETL/Datastage Consultant
Responsibilities:
- Involved in Business Analysis, Data Analysis and requirement gathering.
- Involved in analysis, design, implementation and maintenance of the data warehouse conceptual, logical and physical models
- Created data flow diagrams to demonstrate data origination and data flow between various business applications
- Performed DataStage Installation, Configuration, Applying patches, User Setup and Administration of IBM WebSphere DataStage Enterprise Edition.
- Developed ETL Process to Load the Data from various database systems into Warehouse Database using DataStage (Parallel jobs, Server jobs & Sequence jobs)
- Involved in setting up job migration processes between Dev, QA and Prod environments.
- Defined and Implemented ETL design, development standards based on industry best practices
- Involved in design, development and implementation of strategies, procedures and recommendations for assessing and enforcing consistency in data
- Performed 24/7 ETL Production Support, troubleshooting, problem fixing and ongoing enhancements to the Data Warehouse.
- Developed Job Migration process and standards from development to production.
- Involved in setting up environment, data migration and job import and exports between Development, QA and Production environments.
- Developed and implemented Scheduling of the jobs using Control-M scheduler
- Developed production support run book and documentation of ETL processes
Environment: IBM WebSphere Enterprise DataStage 8.0/7.5.2, MS SQL Server 2005, MySQL 5.0, microstrategy, Control-M, Qlikview 7.5, Subversion, Windows XP and Linux.
Confidential, Cincinnati, OH
DataStage Developer
Responsibilities:
- Worked with various sources such as Oracle DB, Access mdb, Flat files to extract data and used IBM WebSphere DataStage to load the data into Data Warehouse built on Oracle.
- Used the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Designed various procedures for getting the data from operational systems in to Data Warehousing system.
- Designed the Data Mart model with Erwin using Star Schema methodology.
- Extensively used various stages and transforms of the DataStage Server jobs for various types of date conversions.
- Documented the metadata to capture from the sources.
- Created sessions and batches to extract the data.
- Closely worked with Autosys mid support team for setting up production job cycles for daily, monthly, weekly loads with proper dependencies.
- Created jobs using DataStage Designer and used Datastage Director to validate schedule run and monitor the DataStage jobs.
- Metadata was stored in the repository and is imported using the DataStage Manager.
Environment: IBM WebSphere DataStage Version 7.5 (Director, Designer, Manager), MetaStage, Oracle 10g, Autosys, PL/SQL, SQL Developer, SQL*Plus, Red Hat Enterprise Linux AS, Windows Server 2003
Confidential
DataStage Developer
Responsibilities:
- Designed various procedures to get the data from all operational systems in to Data Warehouse.
- Extensively used ETL to load Access data in to Oracle database.
- Designed and developed various PL/SQL scripts to meet the business requirements.
- Developed stored procedures using Oracle to automate the data loading process.
- Involved in design, source to target mappings between sources to operational staging targets, using DataStage Designer.
- Used DataStage Director to run and monitor the jobs for performance statistics.
- Used Erwin for data modeling (i.e. modifying the staging and SQL scripts on Oracle and MS Access Environments).
Environment: Ascential DataStage 6.0.1(Designer, Manager, Director), Parallel Extender (PX), Oracle 9i, MS Access, SQL, PL/SQL, Toad, UNIX