Sr Datastage Developer Resume
NyC
SUMMARY
- 7 plus years of experience in Information Technology with extensive experience in Data Warehousing and Business Intelligence.
- Over 5 years of experience on DataStage 6x/7x/8x (IBM Web sphere information server) Environments
- Experience in developing applications using Oracle, SQL Server and Teradata.
- Involved in gathering Business requirement and Designing Functional specifications.
- Solid experience in Migration of DataStage version 7.5 to 8.0.1 version.
- Solid experience in using UNIX/IBM AIX commands and writing UNIX shell scripts.
- Design Technical specifications and Mapping documents with Transformation rules.
- Strong experience in developing jobs using different stages in DataStage parallel Extender like join, merge, lookup, remove duplicates, filter, dataset, modify, aggregator and change data capture.
- Good Experience in handling SAP data and understanding SAP modules like Supply Chain Management(SCM), Sales and Distribution(SD) and Finance(FICO)
- Extensive knowledge in developing and analyzing the data modeling models such as E/R model and Dimensional model and Implemented data warehousing methodology using Star schema models as per the business process.
- Experience in Data profiling, Data Modeling using tools like Erwin, Oracle, TOAD, Designer for OLTP and Data Warehousing environment.
- Used DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database
- Strong hands on using MicroStrategy reporting tool.
- Developed schema objects and public objects (facts, attributes, hierarchies, reports, filters, metrics, templates, etc.,) using MicroStrategy Desktop.
- Good experience in generating reports and dashboards using MicroStrategy Desktop and web as requested by the end users.
- Expertise in datawarehousing techniques for Slowly Changing Dimension phenomenon.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements.
TECHNICAL SKILLS
BI TOOLS: IBM Information Server(8x)/DataStage 7x/6x, MicroStrategy 8
DATA MODELING: Star/Snow Flake Schema, Dimensions & Fact Tables, Erwin
DATABASE: Oracle 8i/9i/10g, SQL Server, MS Access, DB2, Teradata, Progressive DB, PeopleSoft, HP 3000, Seibel, SAP
LANGUAGES: C, SQL, T - SQL, PL/SQL, Shell Scripts
OPERATING SYSTEM: Windows 98/2000/2003 server/NT, UNIX/Linux
PROFESSIONAL EXPERIENCE
Confidential
SR DATASTAGE DEVELOPER
ENVIRONMENT: IBM INFORMATION SERVER, ORACLE, HP 3000, PEOPLESOFT, UNIX, SAP
Responsibilities:
- Gathered all the required Functional spec’s related to different SAP modules like Supply Chain Management, Sales and Distributions, Finance,etc.,
- Participated in Business and Technical meetings and discussed the transformation rules for the required fields.
- Worked on transforming the data in different modules of SAP(SD, SCM, FICO, WBS etc.,)
- Efficiently used Parallel Extender stages like Remove-Duplicates, Sort, Funnel, Filter, Switch, Transformer, Aggregator, pivot, etc.,
- Developed very complex datastage jobs using Stage Variables, Derivations, functions, Constraints, etc.,
- Used stages like standardize, match frequency, Investigate in Quality Stage for cleansing of customer data based on address, state, zip
- Used DataStage Designer to Import and Export the project from Development to QA to Production.
- Worked on building complex Cross reference tables which are efficiently used to populate data from Master Table to Transactional table and vice versa.
- Working with various SAP Functional Analysts.
- Assigned roles and responsibilities to the Datastage developers, Created parameters for file paths in UNIX server and database names etc.,
- Worked closely with SAP functional and technical Teams to gather the required documents and help them in building the Load program (LSMW, Custom program) for loading into new SAP.
- Worked closely with IBM support and engineering team in resolving DataStage related issues/analysis like WAS diagnostics, Patch installations, PMR tickets etc...
- Resolved various defects that are raised by User Acceptance testing team.
- Involved in comparing and optimizing the jobs for faster response times and data accuracy.
Confidential, NYC
DATASTAGE DEVELOPER
ENVIRONMENT: IBM INFORMATION SERVER(8.1), ORACLE(9i), AUTOSYS, IBM AUX(5.3), VSS
Responsibilities:
- Gathered all the information from existing ETL team and source providers.
- Participated in business meetings and understood the current job flow and their dependencies.
- Exported jobs from production to development, worked on the issues raised and moved back to the production environment using VSS(Microsoft Visual Source Safe)
- Used “Autosys - Scheduling tool” to schedule jobs in the production environment based on the pre-conditions and job dependencies.
- Modified datastage jobs to improve the performance of the job
- Used JIL scripts to create boxes in the autosys environment.
- Used datastage director to run the jobs manually.
- Worked closely with the mainframe developers in getting the source files, and discussed the data related issues.
- Analyzed the total architecture and documented them for the future reference.
- Used sequential files, Flat files, oracle database, mainframe files as source and oracle 9i as the target.
- Extensively worked with Parallel Extender for parallel processing to improve job performance while working with bulk data sources.
- Developed jobs in Parallel Extender using different stages like Transformer, Aggregation, dataset, Filter, Lookup, Surrogate key, Sort, Remove Duplicates stages etc.,
- Data is loaded from different source files to staging and applied transformations then loaded into ODS.
- Worked closely with Data Analysts to make sure the data is accurate and consistent for table loads.
- Extensively worked on Error handling, cleansing of data, Creating Hash files and performing lookups for faster access of data.
- Involved in performance tuning of the ETL process and performed the data warehouse testing
- Query Optimization for improving the performance of the data warehouse
- Resolved issues occurring during the UAT (user accepting testing) and SIT (System Integration Testing)
Confidential, NJ
DATASTAGE DEVELOPER
ENVIRONMENT: DATASTAGE 7.5.2, MICROSTRATEGY 8, ERWIN, PROGRESS DB, ORACLE, PEOPLESOFT, UNIX, SHELL SCRIPTS, CRT-M
Responsibilities:
- Participated in discussions with Project Manager, Business Analysts and Team members on different Business Requirement issues.
- Used Erwin Data Modeler to build the logical and physical data models.
- Worked on the existing documents and developed the required technical specification as per the business needs.
- Worked on extracting data from Flat files, Sequential files, Progress Database, SQL Server and Oracle database.
- Designed ETL jobs by identifying various source files and applying transformations and ETL logic to them.
- Used Toad (a graphical user interface for Oracle 10g) extensively for creating and editing database objects such as tables, views, indexes, constraints etc.,
- Developed various jobs using stages like Transformer, Lookup, Datasets, Funnel, Change Capture stage, Change Apply stage, ODBC stage etc.,
- Mapped Data Items from Source Systems to the Target System.
- All the jobs were migrated from development to production using DataStage Manager.
- Developed UNIX shell scripts to automate data loading in batch mode.
- Validation of all the metrics is done well in advance, before migrating it into production environment.
- Monitored all the metrics in the production and worked on the issues raised.
- Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions.
- Extensively used UNIX Shell Scripts to trigger the DS jobs through a Master Sequencer.
- Used control-M to schedule the jobs based on prerequisites in and dependencies out of the jobs.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements.
- Participated in the meetings with the teammates, project manager and the users
- Involved in generating reports using MicroStrategy Reporting tool version 8.0
- Created schema and public objects (facts, attributes, filters, metrics, prompts, reports, hierarchies) using MicroStrategy Desktop and Web.
- Developed the reports for the Management team using MicroStrategy and made available on web for the users.
Confidential, CA
SR DATASTAGE DEVELOPER
ENVIRONMENT: DATASTAGE 7.5/8.0.1, SYBASE, ORACLE, ERWIN, UNIX
Responsibilities:
- Gathered all the required documents and analyzed the current flow and performance of the current jobs.
- Actively participated in the Team meetings to gather functional requirements and tech specs.
- Developed logical and physical data models as per BI requirements.
- Migrated jobs from DataStage version 7.5 to DataStage 8.0.1
- Used DataStage8.0.1 for impact analysis on jobs for determining the parameter sets
- Used advance search criteria and also used the parameters shared options in datsastage8.0.
- Designed and developed Star Schema dimensional model.
- Worked with sequential files, Sybase as sources and Oracle as Target.
- Data is extracted from Siebel databases, flat files, CFF files
- Performed some of the administrative tasks like creating users, projects and giving access to a group or individual users.
- Mapped Data Items from Source Systems to the Target System.
- Used the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse.
- Used different stages of DataStage Designer like Lookup, Join, Merge, Funnel, Filter, Copy, Aggregator, Sort etc.
- Used DataStage Director to schedule, monitor, cleanup resources, and run job.
- Developed various UNIX shell scripts to meet all the project requirements.
- Involved in performance tuning at source, transformations, and target levels.
- Involved in tuning long running queries and database changes.
- Created and updated the program specifications as per the recommended changes.
- Involved in data profiling of the source data.
- Used Autosys for scheduling jobs.
- Provided Standard Documentation, Best practice, Common ETL Project Templates and tuning the jobs/Process to higher performances.
- Involved in creating summary tables by developing Store procedures and functions using PL/SQL
- Involved in comparing and optimizing the jobs for faster response times and data accuracy.
- Implemented Slowly Changing dimension concepts.
- Involved in writing functional test cases and performed Functional testing and Performance testing for jobs developed to ensure that it meets the requirements.
- Involved in the execution of jobs for UAT and SIT.
Confidential, IL
DATASTAGE DEVELOPER
ENVIRONMENT: DATASTAGE 7, ORACLE 8i, UNIX, AUTOSYS
Responsibilities:
- Actively involved in building Data Warehouse. Used Ascential DataStage 7.0 for extracting, transforming, sorting and integrating the data from various source databases, flat files and loading them into base tables of the warehouse.
- Involved in retrieving the data from source database using shell scripts, SQL scripts and Stored Procedures and the data is mapped into the target database.
- Used DataStage and SQL Loader utilities for Import/Export, Migration and Bulk Data Load.
- Analyzed data issues for mapping to existing database structures.
- Involved in developing and applying business rules to enhance data consistency.
- Involved in designing Star schema data model for organizing the data in data warehouse using Erwin data modeler.
- Used DataStage Designer for developing several server and parallel job using different stages like aggregator, join, merge, lookup, filter, funnel, etc.,
- Created Shared containers to use in multiple jobs.
- Edited the Repository contents through DataStage Manager.
- Extensively used DataStage Manager, Designer and Director for creating, migrating and implementing jobs.
- Developed processes for extracting, cleansing, transforming, integrating and loading data into Data marts using DataStage Designer.
- Used DataStage Director for running the Jobs and scheduling them to run at specified time.
- Developed various jobs using Hashed files, ODBC, Aggregator, Sequential file stages.
- Scheduled various ETL batch processes using AUTOSYS.
- Involved in the Performance tuning of DataStage Jobs at different levels (source and target levels)
- Designed and implemented slowly changing dimensions methodologies.
- Performed Unit testing for jobs developed to ensure that it meets the requirements.
Confidential
DATWAREHOUSE DEVELOPER
ENVIRONMENT: DATASTAGE 6, ORACL, SQL SERVER, TERADATA, MAINFRAME, PL/SQL, UNIX
Responsibilities:
- Interacted with technical, financial users and business analysts to understand the business and reporting requirements. Interacted with source systems technical team.
- Created logical and physical database design, data structures, and implemented large databases using Erwin.
- Developed functional requirement documents based on user requirement specification.
- Enhance and developed the existing data-mart with Oracle to scheduled loads from ERP operational data, Mainframe and Teradata.
- Developed various new processes and fixed the existing process with new business requirements, various meetings with users Input.
- Business analysis and requirements gathering, analyzed the hierarchy for Dimensions.
- Designed ETL process as per the requirements and documented ETL process.
- Used the DataStage Designer to develop processes for extracting and loading data into data warehouse database and DataStage Manager for importing and exporting jobs.
- Used the PL/SQL, Shell Scripts to develop processes for extracting, cleansing, transforming, integrating and loading data into data warehouse database.
- Worked on Unit Testing and tuned for better performance with updates on data warehouse tables by non-clustered & clustered indexes using Oracle.
- Extensively used Ascential DataStage Director for jobs monitoring and troubles shooting.
- Extensively used Sequential File Stage, Aggregator Stage, Hashed File Stage etc
- Used Shared Containers for Server Jobs & shell scripts for job sequences, for handling rejected data, handling NULL values and complete email reporting of data changes for production support