Data Stage Developer Resume Profile
Professional Summary
- Extensively used sql and pl/sql code in Datastage jobs for data processing.
- Extensively used SQL coding for overriding the generated SQL in DataStage
- Experience in integration of various data sources like Oracle, Teradata, DB2, SQL Server, MS Access and Flat files into the Staging Area.
- Developed jobs using various types of stages like Sequential file, ODBC, Hashed File, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
- Extensively used Export/Import DataStage Job components and Import Plug in Table Definitions from DB2UDB, Oracle and Teradata databases
- Extensive knowledge and experience in stages like Datasets, sequential file, aggregator, Funnel, Filter, lookup, surrogate key, remove duplicate, transformer, column/row generator and peek along with complex flat files and XML formats.
- Designed Job Sequencers, Batch Jobs, Parallel jobs. Handled multiple pieces of a Project.
- Developed ETL jobs as per business rules using ETL design document
- Extensively used DataStage Client tools like DataStage Designer, Director and Administrator in Data Warehouse development.
- Expertise in Extraction, Transformation and Loading ETL processes using Datastage ETL tool.
- Worked with various relational data bases RDBMS as Oracle, DB2UDB, Teradata, Mainframe databases DB2 , SQL server and ODBC stages as both source and target systems.
- Working knowledge on the Enterprise IBM IIS Datastage v8.5.
- In Depth knowledge in Data Warehousing Business Intelligence concepts with emphasis on ETL and full Life Cycle Development including requirement analysis, design, development, testing and implementation.
- Experience in gathering, documenting and analyzing the business and functional requirements and use cases.
- Around 6 years of experience in ETL methodologies in all the phases of the Data warehousing life cycle
- Over 7 years of experience in System Analysis, Design and development in the fields of data Warehousing, Data Integration Migration and developing business applications and production support using IBM Infosphere DataStage 8.5/v8.1/7.5.2 .
- Strong experience in Multi Dimensional Modeling using Star and Snowflake schemas to build Fact and Dimensional tables, star-schema modeling and snowflake-schema modeling.
- Experienced performing Unit, Integration, Functional testing of ETL jobs and data.
- Involved in Performance Tuning and troubleshooting of ETL jobs via configuration files and shared containers.
- Documented ETL test cases, test scripts, and validations based on design specifications for testing purposes and analyzing errors.
- Worked with Datastage Administrator for creating projects, users and their access.
- Worked with unix shell scripts and JIL scripts for scheduling jobs.
- Worked on different scheduling tools like Autosys and Control-m.
- Good communication and organizational skills, hardworking, ability to work independently or cooperatively in a team.
Professional Experience:
Confidential
ETL Developer
Responsibilities:
- Gather Business requirements and prepare Technical Specifications.
- Analyzed the source system to understand the source data, business rules, to check data integration and develop the data model.
- Worked with DBA to create the physical model and tables and apply the data model changes.
- Documented ETL Coding standards, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing and prepared test data for testing, error handling and analysis.
- Performed Design, build unit test on parallel jobs to extract files from odbc stage , Teradata connector stage Flat files.
- Used the DataStage stages like Join, Change Capture, Lookup, Transformer, Aggregator, Sequential file, Sort stage, Filter stage, Data Set, Remove Duplicate, surrogate key.
- Designed and developed ETL Jobs using designer to load data from Oracle, Teradata, Flat Files Fixed Width and XML files to staging database and from staging to the target Data Warehouse database.
- Worked on creating fixed width flat files and csv files.
- Developed job sequencer's with proper job dependencies, job control stages and triggers and schedule jobs to run jobs in sequence.
- Utilized the stages of Job Sequence such as User Variable Activity, Notification Activity, Routine Activity, Terminator Activity
- Used Data stage Administrator for defining environment variables and project level settings.
- Used UNIX scripts to execute jobs and also used the DataStage Director for scheduling, executing and monitoring jobs.
- Scheduled jobs through Autosys
- Used Local containers, shared containers, job parameter sets and Stage Variables in developing jobs a
- Performance Tuning of Datastage jobs and SQL queries.
- Created Shell Scripts to read parameter files and to automatically notify Business Exceptions and Rejects during the Loads and file processing stages.
- Responsible for doing the code reviews, Planning and estimating the project requirements and to report the status to business managers..
- Walkthrough of SIT Documents with Client for UAT sign off.
Environment: IBM Web sphere Datastage8.0.1, IBM Infosphere Datastage 8.7, Teradata, DB2, Windows XP, UNIX, SQL Server studio, Autosys.
Confidential
Data Stage developer
Responsibilities:
- Reviewed the project scope, requirements, architecture diagram, Conversion design documents CDD and development guidelines.
- Worked closely with Mach 1 process team members during the application development process requirement gathering, design, build and test, and implementation .
- Designed and developed ETL jobs using IBM Infosphere Datastage 8.5 to extract , transform and load the data into SAP.
- Analyzed the data and responsibilities for data cleansing and data conversion for Mach 1 deployment sites.
- Developed parallel jobs using different processing stages like Transformer, Aggregator, Lookup, Join, Merge, Sort, Remove Duplicate, Copy, Funnel and Filter and other stages.
- Worked on Quality stage to develop jobs for data cleansing and data quality improvement.
- Performed various conversions/transformations for the data fields/values as per the business logic specified in mapping document.
- Used Datastage Director to run, monitor and validate the jobs.
- Performed various tasks with SQL programming language for Data retrieval and query on the data as part of application development.
- Dealt with various databases Oracle, DB2 stages connectors as a source and target systems.
- Loaded the Data into SAP R/3 using various programs like LSMW, Z-tran and Datastage.
- Created and managed defects/tickets and scripts with HP Quality center for quality assurance, requirement management, test management and business process testing for IT and application environments.
- Used Data stage Director to clear the job logs, job resources and status files.
- Performed excellent customer engagement skills and understood the importance of creating and deploying quality software deliverables.
- Worked closely with various teams in various geographical locations.
- Environment: IBM Information server DataStage 8.5, Information Analyzer , Oracle, DB2 UDB, TUFops, SQL, SAP R3 PACKS, HP Quality Center.
Confidential
Data stage developer/Analyst
Responsibilities:
- Involved in requirement gathering, analysis and study of existing systems.
- Involved in preparing technical design/specifications for data Extraction, Transformation and loading.
- Extensively used DataStage Designer to develop various jobs to extract, transform, integrate and create extract files as needed.
- Involved in writing Jil Script's to create Autosys Jobs to trigger ETL jobs and Shell Script.
- Created Technical Specs document for the DataStage Jobs, Developed several Test Plans and Error Logs / Audit Trails were maintained.
- Developed new and effective controls data, report, ETL for data validation.
- Worked on EDW Conversion project mainly designed for migrating EDW 2.0 code to IIS Grid environment.
- Worked on migration project, which includes ETL jobs, scripts Autosys JIL jobs, would be fork lifted to EDW 3.0 installed on IIS Grid environment.
- Implementing performance-tuning techniques along various stages of the ETL process.
- Coordinated with the Admin team in migrating the DataStage code on different environments Development, test and production .
- Developed a generic shell script to initiate file transfer between two servers.
- Co-coordinating with client managers, business architects and data architects for various sign offs on data models, ETL design docs, testing docs, migrations and end user review specs.
- Worked extensively in executing the daily IT Cycle, ST Cycle and debugging the problems in daily runs and provided technical and functional help to team members.
Environment: IBM InfoSphere DataStage 8.1, OBIEE, Teradata 13.0, Autosys 4.5.1,WinXP, UNIX and Teradata Sql Assistance
Confidential
ETL Developer
Responsibilities:
- Involved in creation of Code review check list and Process flow documents.
- Developed jobs using the stages like Sequential file, Dataset, Oracle connector, ODBC stage, Lookup, Join, Aggregator, Pivot, External Source, Link Partitioner/Collector, Copy, Transformer, Sort, Remove Duplicates, Funnel, FTP.
- Used the Client components Designer, Director and Administrator.
- Developed the jobs and documented by following the SJM ETL standards.
- Developed parallel jobs which involved of SAP BW Open Hub Extract, ESSBASE plug in stage and oracle enterprise stage.
- Worked with complex flat files in the process of extraction of data.
- Worked with Project Lead, Technical Lead and Functional analysts to understand the functional requirements and from there designed the Technical specifications.
- Designed the technical design documents from Functional specifications.
- Implemented complex logics in Transformer stage like date validation, use of stage variables.
- Used Job Sequencers to run the jobs sequentially and reporting the Status of the Job through Email.
- Exported and imported the Datastage jobs between the production and the development servers
- Involved in S.I.T System Integration and Testing and U.A.T User Acceptance Testing .
- Unit testing and Integration testing the individual and extract-transform-load jobs in sequence respectively.
- Extensively used SQL coding for overriding the generated SQL in Datastage and also tested the data loaded into the database.
- Worked on Data Migration from legacy ESSBASE to the ESSBASE V10.
- Extensively used IBM Information Server Director for scheduling the job to run in batch, emailing and online production support for troubleshooting from LOG files.
- Also used UNIX scripts in file moving, scheduling jobs, removing null from the Flat files.
- Used AutoSys to schedule the load process and worked closely with operations team.
Environment: Datastage 8.1, Oracle 10g, MS SQL Server 2005, Autosys, EssBase Visual Explorer 11, SQL / PLSQL, FTP Client, Windows XP
Confidential
Data Stage Developer
Responsibilities:
- Analyzed and gathered the business requirements. Interacted with Business users and Technical Architects to analyze the data gathering the requirements from various sources.
- Used Web Sphere DataStage to design, execute, manage and deploy and administer DataStage jobs.
- Used Designer client for basic, advanced search and impact analysis and to import and export
- components for moving jobs between different environments.
- Worked on DataStage for subjecting the data to multiple stages, thereby transforming it and prepared documentation. Used DataStage Manager to define Table definitions, Custom Routines and Custom Transformations.
- Worked extensively with different stages in Datastage like Join, Sort, Merge, and Aggregator and Remove Duplicates, Funnel, Transformer, Surrogate Key Generator, SCD, Range and Case Lookup.
- Extensively worked on DataStage Job Sequencer to Schedule Jobs to run jobs in Sequence
- Created data connections and parameter sets or environment variables to use them for the project across dev, test and production servers.
- Used Director Client to validate, run, schedule and monitor the jobs that are run by WebSphere DataStage server.
- Used Administrator Client for general and project-related and mappings.
- Involved in migration of jobs from Datastage 7.5x2 to Datastage 8 version.
- Used IBM IS Web Console for administration areas: security, licensing, logging, and scheduling.
- Installed and Configured Director, Manager, Administrator and Designer components of DataStage.
- Understand the business needs and implementing the same into a functional database design.
- Maintaining warehouse metadata, naming standards and warehouse standards for future application and development.
- Used Autosys to schedule jobs and e-mailed the status of jobs to operations team daily.
Environment: IBMWebsphere Information Server V8.0.1 Suite Designer,Director, Administrator , Unix, Oracle10g Metadata Repository, DB2, SQL, PL/SQL, Autosys, Windows XP/2003
Confidential
DataWarehouse Developer
Responsibilities:
- Involved in creating entity relational and dimensional relational data models using Data modeling tool Erwin.
- Designing the Target Schema definition and Extraction, Transformation and Loading ETL using Datastage.
- Mapping Data Items from Source Systems to the Target System.
- Used the Datastage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Worked on programs for scheduling Data loading and transformations using Datastage from legacy system to Oracle 9i using SQL Loader and PL/SQL.
- Designing and Developing PL/SQL Procedures, functions, and packages to create Summary tables.
- Used the Datastage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on an ad hoc or scheduled basis .
- Worked with Datastage Manager for importing metadata from jobs, new job Categories and creating new data elements.
- Developing Shell Scripts to automate file manipulation and data loading procedures.
Environment: Datastage 7.5 Manager, Designer, Director , ERWIN, Oracle 9i, PL/SQL, SQL Loader, SQL Server 2000, Windows NT 4.0, UNIX.