Etl Data Stage Developer Resume
Lancaster, PA
SUMMARY
- Over 8 years of experience in client/server and Business systems with Data Warehousing, data marts and Ex - traction, Transformation and Loading (ETL) processes using IBM Information Server (Data Stage) 11.3,8.7,8.5,8.1/8.0, Ascential Data Stage 7.5 using components like Data Stage Designer, Data Stage Manager, Data Stage Director, Data Stage Administrator, Information Analyzer, Meta data asset
- Used ETL data stage tool in major industry sectors like Banking, Retail and Finance.
- Knowledge and experienced of installation, configuration of IBM Information Server.
- Experienced of providing support, testing using IBM Information Server.
- Knowledge of IBM Info sphere discovery.
- Knowledge of data gathering and analysis.
- Knowledge of writing system requirements.
- Knowledge of IBM Info sphere Business Glossary.
- Experienced in IBM Info sphere Data Architect.
- Experienced in data stage director client for troubleshooting.
- Knowledge of fact tables, dimensions table, star schema modeling.
- Knowledge of Software development life cycle methods.
- Experienced in data modeling using tools like MS Visio, oracle designer and SQL server management studio.
- Knowledge of developing strategies for extraction, transformation and loading mechanism.
- Ability to participate in Low Level Design documents and Control Plans/Run books
- Having knowledge of business reporting services
- Knowledge of developing business intelligence application in business cognos, business object and Hyperion.
- Used Data Stage Director to validate, schedule and run Data Stage jobs
- Designed and developed jobs using Parallel Extender for splitting bulk data into subsets and to dynamically distribute to all available nodes to achieve best Job performance.
- Proficient in various Stages like Hierarchical, Unstructured Data, CFF, XML, Aggregator, Merge, Hash File, Transformer, Bulk load, ODBC etc.
- Expertise in data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon.
- Experience in integration of various data sources like IBM DB2, Oracle, SQL Server and Flat Files using Active/Passive Stages available in Data Stage Tool.
- Created derivations and business rules to be used by ETL for mapping source data for the population of the Warehouse and Data Marts.
- Designed and Implemented Server and Parallel Jobs including Batches and Sequencers.
- Expertise in creating Star/Snowflake Schema Designing and Dimensional Modeling (Logical and Physical Data warehouse Modeling).
- Developed PL/SQL programs on Database Triggers, Stored Procedures, Functions and Packages
- Expertise in RDBMS design and development.
- Proficient in Oracle Tools and Utilities such as TOAD and PL/SQL Developer.
- Knowledge in UNIX shells Scripting.
- Having knowledge of creating, modify, deleting share point accounts.
- Experience in answering incoming calls, accepting related tickets and working the issue
- Excellent analytical, problem solving & reverse engineering skills.
- Self-motivated, able to set effective priorities to achieve immediate and long-term goals and meet operational deadlines.
- Knowledge of JCL when job is executed in mainframe followed steps Procs and Parms.
- Able to work independently and as team member, adept at motivating staff to ensure smooth workflow and increased productivity.
- Knowledge of Ab initio.
- Experienced in unit testing, system integration testing, implementation and maintenance of databases jobs.
TECHNICAL SKILLS
Data Warehousing: IBM Data Stage 11.3,8.1/ 8.5/8.7(Designer, Director, Administrator), SQL*Loader, Server Edition, parallel extender
OLAP: Cognos 7.x (Impromptu, Power Play, Transformer, Visualizer), Business Objects 5.1,Microstrategy
Databases: Oracle 11g,10g/9i/8i/8.0/7x, DB2 UDB, SQL Server, Cassandra, Hadoop TERADATA, MS Access 7.0/97/2000/2013, Excel
Tools: SQL Developer 3.0,Developer 2000, Forms 6i, Reports 6i, Visual Basic 6.0, Excel, Power Point, MS OFFICE Suite, TOAD,HUE, Tortoise SVN 1.7, Control M 7.0,Putty
Dimensional Data Modeling: Data Modeling, Star Schema, Snowflake Schema, Physical and Logical Data Modeling, Erwin
Programming: COBOL, VB, XML, JAVA, VB Script, SQL, PL/SQL and Unix shell scripts
PROFESSIONAL EXPERIENCE
IBM info sphere Data Management Technical Architect
Confidential - Malvern, PA
Responsibilities:
- Involved in Business meetings to understand the business requirement specifications and implemented the ETL jobs using Data stage.
- Interacted with user to understand business requirements.
- Involved in providing support and testing using IBM Information server.
- In data architect, responsibilities are data designing, data models and visualize the structure.
- Involved in developing the source to target process and mapping documentation.
- Data Stage programming in an IBM IIS v11.3.1.2 environment
- Use of the IIS Information Governance Catalog (IGC) Rest Explorer to query, create and modify Assets via JSON and XML PUT and GET calls
- Creation of custom assets in IGC via the “Bundle.zip” functionality within the Rest Explorer
- Coding of Data Stage parallel jobs which utilized the Hierarchical Data (HD) Stage to queryCreate and modify IGC assets via the REST API, Creation of JSON and XML statements in Data Stage transformers and also via the JSON Parser Step within the HD stage - in order that Confidential custom technical assets could be created and Maintained within IGC
- Use of the Oracle Connector & Stored Procedure stages within custom Data Stage job flows for Interacting with Confidential ’s “EMM” application and IGC
- Creation of custom unit test plans and test results documents in order to document detailed Testing on Data Stage job flows at Confidential
- After data mapping to EMM, created jobs to schedule data synching from EMM to IGC
- Invoked REST API and XML through jobs in Hierarchical stage in data Stage to create Term and Asset mapping in IGC
- Participated in the review and approval of the technical transformation requirements document used to design and build the ETL modules in Data stage Designer.
- Used various types of sources like Oracle, MS SQL, Sybase, DB2, VSAM Files, Externally generated files in data stage
- Participated in daily status meeting.
- Prepared a best practice document to use when designing data stage parallel jobs to gain optimum performance by using appropriate partitioning techniques.
- Created and used job parameter set during developing jobs.
- Developed parallel jobs using various stages transformer, Hierarchical stage, Oracle connector
- Created job sequencer to automate the job.
- Worked on director client for troubleshooting.
- Involved in performance tuning of Data stage jobs and creating templates for future use.
- Worked on programs for scheduling data loading and transformations using Data stage.
- On Data stage 11.3Extender extensively used Transformer, Hierarchical, Oracle connector, Sequential File stages.
Environment: IBM information Server 11.3, Data Stage 11.3(Designer, Administrator, Director), Oracle EMM 7.1(Enterprise metadata management), IBM Information Governance Catalog, Windows 7, UNIX AIX, Oracle 11g,Control-M 7.0, Tortoise SVN 1.7, Putty
ETL Data Stage Developer
Confidential - Lancaster, PA
Responsibilities:
- Involved in Business meetings to understand the business requirement specifications and implemented the ETL jobs using Data stage.
- Interacted with user to understand business requirements.
- Involved in providing support and testing using IBM Information server.
- Involved in set up, Installation of IBM Info sphere server.
- Involved in working with IBM Info sphere Data Architect.
- In data architect, responsibilities are data designing, model, data models and visualize the structure.
- Involved in developing the source to target process and mapping documentation.
- Involved in data modeling and data profiling.
- Participated in the review and approval of the technical transformation requirements document used to design and build the ETL modules in Data stage Designer.
- Loading the historical data in data ware house.
- Participated in daily status meeting.
- Prepared a best practice document to use when designing data stage parallel jobs to gain optimum performance by using appropriate partitioning techniques.
- Implemented slowly changing dimensions on customers table using SCD stage in Data stage 8.7 on IBM Information server 8.7.
- Created shared container to in corporate business logic and used in multi job.
- Created and used job parameter set during developing jobs.
- Developed parallel jobs using various stages transformer, join, look up and merge
- Created job sequencer to automate the job.
- Knowledge of director client for troubleshooting.
- Knowledge and worked with administrator client for creating new user and assigning role.
- Utilized the parameter set feature in Data stage 8.7 to create common project level parameters.
- Involved in performance tuning of Data stage jobs and creating templates for future use.
- Worked on programs for scheduling data loading and transformations using Data stage.
- On Data stage 8.1 Extender extensively used the Filter, Copy, Funnel, Data Set, Join, Merge, Aggregator, Column Generator, Sort, SCD and Remove Duplicate stages, Complex Flat File Stge.
- Involved in the development of dimensional data models using ERwin as per the specified business requirements
- Used the Data Stage designer to develop processes for extracting, cleansing, transforming, integrating and loading data into data warehouse.
- Developed and implemented strategies for slowly changing dimensions, surrogate key generation and for incremental data loading.
- Performed performance tuning of Data Stage jobs to improve the extraction, transformation and loading time of data Worked on Fast track component of IBM Information Server 8.7 for mapping source to target subject area.
- Deployed the Data stage jobs as Web Service Application using IBM Information Services Director.
- Created the enterprise vocabulary used in this project using IBM WebSphere Business Glossary.
- Used Pl/SQL programming to develop store procedures and functions.
- Build and testing of batch flows and stored procedures.
Environment: IBM information Server 8.7, Data Stage 8.7(Designer, Administrator, Director), Parallel Extender, Visio, Windows 7, UNIX AIX, Oracle 10g
Sr. ETL Data Stage Developer
Confidential, NJ
Responsibilities:
- Prepared documentation including requirement specification.
- Creating Dimensions and Facts in the physical data model.
- Involved in working with IBM Info sphere Information Analyzer.
- Documented the metadata to capture from the sources
- Created Sessions and batches to extract the data.
- Involved in the creation of jobs using work flow manager to validate schedule run and monitor the jobs.
- Involved in designing the procedures for getting the data from all systems to Data Warehousing system.
- Performed production support activities.
- Handled CRs (Change Requests).
- Performed impact analysis during the system enhancements.
- Requirements Gathering from End Users.
- Prepared Design Document for DQD Implementation.
- Developed ETL mappings, Transformations and Loading using IBM Data stage 8.7.
- Involved in Scheduling using the scheduling tool like AUTOSYS.
- Developed JIL (Job Information Language) Scripts in UNIX Environment.
- Extensively used ETL to load data from Relational Databases.
- Involved in Developing and testing all the data stage mappings using Lookups and other transformations.
- Developed mappings using different types of transformations like stored procedure, expression, filter, update strategy, lookup, and sequence generator.
- Involved in Unit Testing of Data stage jobs.
- Used the Data stage Designer client to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Assisted warehouse designer while designing the models.
- Created Unix Shell Scripts to automate the process.
Environment: Data stage designer 8.7, Windows NT, Oracle, UNIX and PERL scripting, Autosys, Flat Files, DB Artisan, JIL scripts.
ETL Data Stage Developer
Confidential
Responsibilities:
- Worked as a part of IBM Implementation team thereby coordinated heavily with the IBM’s offshore team and the client.
- Involved in analysis, planning, design, development, implementation stages of projects using IBM WebSphere software.
- Involved with the performance tuning of the existing parallel jobs without affecting the current functionality.
- Reviewed and updated mapping documents to create better performing ETL codes on adhoc basis.
- Create data stage jobs using different stages using transformer, sort, remove duplicates, dataset, merge, lookup, funnel, and filter, modify and surrogate key.
- Knowledge and expertise in using lookup, merge and join stages.
- Extensively used sequential file, data set, file set stages.
- Used SQL explain plan in Queryman, SQL Developer to fine tune the SQL codes which were used to extract the data in database stages
- Designed and developed jobs using Parallel Extender for all the four regions (US WMT, US SAMS, MX WMT, MX SAMS, CA WMT, BR WMT, BR SAMS, K2 WMT, AR WMT and GB WMT) for extracting data from Teradata, DB2 legacy tables, and flat files for implementing transformation logic using Teradata Connector Stage and DB2 Connector Stages and loading into the target JDA tables on Oracle 10g.
- Extensively used Hash File Stage, Transformer Stage along with looping functions, Aggregator Stage, Link Partitioner and Link Collector Stages in transforming the source data into the target database.
- Developed jobs in DEV environment and moved them across TEST and PROD environments through Power and Team Forge.
- Developed Job control Routines to process large files like ITEM, DFU, SKU and SCHEDRCPT extracts.
- Worked on standing up the Performance Environment by creating Value Files, Parameter Sets, Unix Shell Scripts, and running one time PL-SQL scripts for inserting/updating values in the various tables.
- Migrated codes between different regions and performed version controlling using Power 1.1.2.
- Developed UNIX Shell Scripts to run Data Stage Jobs using CA7 scheduling tool.
- Scheduled different jobs using CA7 on mainframe.
- Created System Variables, Process variables, Task variables and Event triggers in CA7 to run same Data Stage jobs for four different regions.
- Developed UNIX script to FTP files to/from Mainframe server and Data Stage Unix box.
- Provided SIT/UAT/Production support for jobs running on daily and weekly schedule.
- Solved SIT/UAT/Production issues and was involved in loading JDA tables on time.
- Participated in weekly status meeting
Environment: IBM Ascential Data Stage 8.0, Queryman for Teradata, SQL Developer for Oracle 10g, QMF for DB2 8.2 w/ Z OS, Power 1.1.2, Team Forge, CA7 Job Scheduler, AIX 4.0, UNIX, MS Access 2007, MS Outlook 2003/2007, MS Vision 2007, Erwin 7.0.
ETL Data Stage Developer
Confidential, New York
Responsibilities:
- Involved in business users meetings to review Integrated Data approaches and to interpret results.
- Gathered and analyzed business requirements from users to prepare BRD.
- Worked in capacity as a functional person, manage client requirements, issues & communications throughout project life-cycle and rollout.
- Prepared Best Practices document for developers to use when developing parallel jobs using Data Stage Enterprise edition.
- Prepared Development Design Standards document to establish consistent naming standards to improve development productivity and quality.
- On Parallel Extender extensively used the Filter, Copy, Funnel, Data Set, Join, Merge, Aggregator, Column Generator, Peek, and Sort, generic, SCD and Remove Duplicate stages.
- Built prototype jobs for different environments for in-house developers to reference when developing new jobs as well as mentor and guide in-house developers.
- Used Profile stage to reduce the time needed to analyze the source system, ensure that source data supports the target requirements and identify problems early in project.
- Used Quality Stage tool for cleansing and integrating the data before it is loaded into the staging area.
- Used various stages of Quality stage like standardize stage, survive stage, format convert, transfer and unjoin stages.
- Worked in conjunction with analysts and other developers to develop solutions that are consistent with client and enterprise-wide data standards.
- Prepared mapping documents, conceptual design, and Technical design documents for loading extracts to ODS (Operational Data Store).
- Interacted with Unix Admin to setup Project Structure, estimate space required for the project.
- Developed UNIX shell scripts to automate the Data Load processes to the target Data warehouse.
- Involved in designing common error management jobs to handle errors.
- Involved in designing and development of common jobs to update common Batch Status, Control, File Info, App Parameter tables.
- Implemented SQL coding for overriding the generated SQL in Data Stage in special cases and also created Stored Procedures and Functions using PL/SQL.
- Performed. job tuning and SQL tuning for better performance
- Developed Unix Shell Scripts to validate files, schedule Data Stage jobs and data loading procedures.
- Developed and assisted other developers to create complex Data stage jobs.
- Developed several Parallel and Server jobs in Data stage Designer.
- Used Manager to extract metadata for several tables and file structures. Used manager to compile multiple jobs, import and export jobs when moving into Test and Production.
- Involved in moving Data stage code from development to Test and Production environment.
Environment: Windows 2000 Professional, UNIX AIX Server, IBM Data stage 7.5.2/7.5.1 r1/7.0 (Manager, Designer, Director, Administrator),Parallel Extender, Quality Stage 7.5, Erwin 4 & MS Visio for Data Modeling, Oracle10g, SQL, Server 2000, SQL, PL/SQL, Toad, UNIX, Profile stage, Metastage.
Oracle PL/SQL Developer
Confidential
Responsibilities:
- Manage and support the 30+ Oracle databases.
- Create or clone the Oracle Instance and Databases on ASM. Perform database cloning and re-location activities.
- Involved in data modeling.
- Managing tables, data files, table spaces and its segments.
- Maintained data integrity and managing profiles, resources and password protection.
- Involved in managing Users, Privileges and Roles.
- Involved in installation of Oracle software and patches.
- Upgraded the database from lower version to higher version.
- Write script to monitor the database with PL, SQL such as procedure, function and package.
- Involved in all phases of database development from needs assessment to QA/QC,design and support
- Trained the new recruiter and user.
Environment: SQL Developer for Oracle 8i,Oracle 9i, UNIX, MS Access 2006, MS Outlook 2003/2007, MS Vision 2006,Windows XP