Sr. Data Stage Consultant Resume
Chicago, IL
SUMMARY
- A Dynamic IT professional with 8+ years of work experience in Data Integration and migration for Data Warehouses including IBM Info Sphere/Web Sphere/Ascential Data stage (Ver. 8.7/8.5/8.0.1/7.5.1/7.5.2 ) Server Edition, Enterprise Edition (Manager, Designer, Director, Administrator, Parallel Extender), Profile Stage/ Information Analyzer, Quality Stage, Audit Stage
- Experience with Information Analyzer which was used to automate the task of source data analysis by expediting comprehensive data profiling and minimizing overall costs and resources for critical data integration projects by scanning the samples of data and determining their quality and structure
- Extensively used Quality Stage components including the Match Designer for designing and testing match passes, and a set of data - cleansing stages like Investigate stage, Standardize stage, Match stage, Survive stage
- Profile Stage was used to investigate data sources to see inherent structures, frequencies of phrases, identify, data types, etc. Based on the real data, rather than metadata, it was helpful to suggest a data model for the union of data sources
- Used Quality Stage Address Verification Interface like Geocoding and Postal Certification for Matching address data against standard postal reference data that helps to verify address information for 240 countries and regions
- Worked in various business domains including Retail, Healthcare, Financing, Banking, Investing, Logistics, Telecom industries
- Experience in Analysis, Design, Development and Implementation of Relational Database (OLTP) and Data Warehousing Systems (OLAP)
- Extensive experience on the Data Modeling phases conceptual, logical, physical
- Strong experience in Data warehouse development life cycle and Design of Data marts with Star Schemas, Snowflake Schemas and Integrated Schemas
- Used the Data Stage Designer to develop processes for extracting, transforming, and loading data into data warehouse databases
- 8 Years of experience in client/server business systems in design/analysis/testing, GUI prototyping, Data Warehousing, and application development
- Experience in Pipeline and Partitioning Concept
- Extensively worked with Parallel Extender for parallel processing to improve job performance while working with bulk data sources
- Worked extensively with different database stages of Data Stage like Oracle Enterprise, Dynamic RDBMS, Stored Procedure, OCI, ODBC
- Worked extensively with different file stages of Data Stage like Sequential, Dataset, File set, Lookup File set
- Worked extensively with different processing stages of Data Stage like Filter, Sort, Aggregator, Copy, Transformer, Funnel, Join, Look Up, Merge, Pivot, Modify, Switch, Change Capture, Surrogate Key Generator, Remove Duplicates
- Worked extensively with different development/debug stages of Data Stage like Head, Tail, Row Generator, Column Generator, Peek
- Worked with Local Containers, Shared Containers and Job Sequences
- Knowledge in SQL & PL/SQL and expertise in writing Stored Procedures, functions and Packages
- Expert in Data Warehousing techniques for Data Cleansing, Slowly Changing Dimension Phenomenon (SCD), Change Data Capture(CDC)
- Extensive experience in dealing with High Volume Data, Performance Tuning, Maintaining, Multiple Job Compile, Surrogate Key Generator Stage, Job Reports, Message Handler Options
- Developed efficient mappings for data extraction/transformation/loading (ETL) from different sources to a target data warehouse
- Extensively Worked on Job Sequences to control the flow of job execution using various activities like Job Activity, Email Notification, Sequencer, Routine activity and Exec Command
- Excellent problem-solving and trouble-shooting capabilities. Quick learner, highly motivated, result oriented and an enthusiastic team player. Good interpersonal skills, experience in handling communication and interactions between different teams
TECHNICAL SKILLS
ETL Packages: IBM Info Sphere/Web Sphere Data Stage and Quality Stage 8.7, 8.5, 8.0.1, Ascential Data Stage 7.5.1/2 (Designer, Director, Manager, Administrator), Information Analyzer/ Profile Stage, Quality Stage, Audit Stage
Databases: Teradata 13.11 client, MS Access, Oracle 10g/11g, MS SQL Server 2005/2008, DB2 UDB 8.1/7.2, OBIEE 10g/11g, MDM (Oracle CDH)/ Oracle Apps 11i/R12 (OM & AR modules)
Database Tools: SQL* Plus, SQL Loader, Toad, Autosys, Zena, Serena
Database Modeling: Anchor Modeling, Star-Schema Modeling, Snowflakes Modeling, Integrated Schema, E-R Modeling, FACT and Dimension Tables, Microsoft VISIO, ERWIN 4/7.1/8
Operating Systems: Windows NT / 2000 / XP Pro / Vista, 7, Windows Server / 2008, UNIX - Solaris/AIX/UX, Linux - Mint, Ubuntu
Languages: SQL, PL/SQL, UNIX Shell scripting, Java
PROFESSIONAL EXPERIENCE
Confidential, Chicago IL
Sr. Data stage Consultant
Responsibilities:
- Responsible forbusiness analysis, requirement collection, design and development of guest data mart.
- Interpreted the information from various operational sources and external systems to document the data stage jobs as per the business requirement.
- Analyzed the data for inconsistencies, duplicates and bad data.
- Used theData stage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- UsedData stageManager for importing metadata from repository, new job categories and creating new data elements.
- UsedData stageDirector and the runtime engine to schedule running the server jobs, monitoring scheduling and validating its components.
- Used Parallel Extender Development/Debugging stages likeRow generator, Column Generator, Head, Tail and Peek.
- Dealt extensively with data from Teradata sources.
- UsedData stageDirector to validate schedule run and monitor the data stage jobs.
- Used Before/After Job-Subroutines in Job Properties.
- UsedData stagefor developing, programs for scheduling data loading and transformations
- Written several TeradataBTEQ scripts, Fast Export scripts and Python scripts for extracting data from Teradata source and to implement the business logic.
- Verified job process logic by preparing test data and conducting unit tests and participated in the systems testing and user acceptance testing.
Environment: IBM Info Sphere Data Stage 8.7/8.5 (Designer, Administrator, Director, Manager), Teradata 13.11, Zena, Serena, Windows Server 2003, AIX 6.1, SQL Plus, UNIX Shell Scripting, SQL Loader, SQL
Confidential, Roanoke, VA
Sr. Data Stage Consultant
Responsibilities:
- Participated in discussions with Team leader, Group Members and Technical Manager regarding any Technical and Business Requirement issues
- Used Partition Parallelism, the same job would effectively run simultaneously by several processing Nodes each handling separate subset of Total data
- Used Data Stage to extract client data from Oracle and mapped the data into a target business warehouse
- Used Data Stage Director to view logs for any errors and warnings
- Used Surrogate Keys to keep track of Slowly Changing Dimensions (SCD)
- Used Quality Stage to automate the conversion of data into standard formats and match variables that are common to records (for example, given name, date of birth, or gender) when unique identifiers are not available
- Used Quality Stage components like Match Designer for designing and testing match passes
- Used Analyzer tools like:
- End-to-end data profiling and content analysis: this provided standard data profiling features and quality controls
- Business-oriented approach: this has task-based user interface, it aided business users in reviewing data for anomalies and changes over time, and provided key functional and design information to developers
- Adaptable, flexible, and scalable architecture: handled high data volumes with common parallel processing technology, and utilized common services such as connectivity to access a wide range of data sources and targets
- Extensively used Pivot stage to pivot the source data to achieve required table structures like converting data from rows into a column
- Used development/debug stages to test the environment by creating samples of data from given high volume data or by creating mock data
- Imported and exported repositories across projects
- Extensively followed the concepts of Naming Conventions, Parameterizing the variables from Global Environment to stage level
- Performed parallel processing of data extraction and transformation
- Extensively worked with various stages like sequential file, dataset, lookup, peek, transformer, merge, aggregator, row generator, surrogate key generator and many more to design jobs and load the data in to fact and dimension tables
- Implemented Local containers for same job and Shared Containers for multiple jobs, which have the same business logic
- Used stage variables which is a temporary location used to hold the values temporarily at the time of execution for better performance and to reduce the complexity of defining expressions
- Extensively used Data Stage Director and Autosys for Job Scheduling, emailing production support for troubleshooting from LOG files
- Extensively worked on Error Handling
Environment: IBM Info Sphere Data Stage 8.5/8.7 (Designer, Administrator, Director, Manager), Quality Stage, Audit Stage, Information Analyzer, Oracle OBIEE 10g/11g 11g/10g, Teradata, DB2 UDB 8.1, Autosys, Windows Server 2003, AIX 6.1, SQL Plus, UNIX Shell Scripting, SQL Loader, SQL
Confidential, Hartford, CT
Sr. Data stage Consultant
Responsibilities:
- Designed Parallel jobs using various stages like (XML, MQ, Join, Remove Duplicates, FTP stage, Filter, Dataset, Lookup file set, Modify, Transformer, ODBC and Funnel stages) for one-shot (AD-HOC jobs as per the requirement)
- Extensively used TOAD for analyzing data, writing SQL, PL/SQL scripts performing DDL operations
- Used Quality Stage for various data cleansing stages to get complete visibility of the actual condition of data, to reformat data from multiple systems to ensure that the data has the correct specified content and format, and to ensure that the best available data survives and is correctly prepared for the target
- Used Quality Stage components like Match Designer for designing and testing match passes
- Information Analyzer was used to automate the task of source data analysis by expediting comprehensive data profiling and minimizing overall costs and resources for critical data integration projects by scanning the samples of data and determining their quality and structure
- Used development/debug stages to test the environment by creating samples of data from given high volume data or by creating mock data
- Worked on the code fixes and on the tickets raised due to the job failures
- Provided 24*7 support on rotation basis
- Supporting unit, integration, and end user testing by resolving identified defects
- Ensuring timely deliveries of work items to the Client
- Involved in Implementing ETL standards and Best practices within our portfolio
- Used the Data Stage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database
- Reusing the logic from Data Stage jobs in real time
- Developed jobs using different types of stages -- Sequential File, Transformer, Aggregator, Merge, Link Petitioner and Link Collector and Hashed File
- Extensively used almost all database stages, file stages, processing stages, and development/debug stages
- Performed lookups for faster access of data
- Used Data Stage Designer for importing metadata from repository, new job categories and creating new data elements
- Extensively used Autosys and Data Stage Director for Job Scheduling, Emailing production support for Troubleshooting from LOG files
Environment: IBM Web sphere Data stage 8.0.1/8.5 (Designer, Director, Administrator, Manager), Quality Stage, Audit Stage, Information Analyzer/Profile Stage, Microsoft Visio, Oracle OBIEE10g, Teradata, UNIX AIX 6.1, Windows Server 2003, SQL Loader, Toad, Autosys, SQL, PL/SQL, Oracle SQL Plus, UNIX Shell Scripting, ERWIN 8
Confidential, Richmond, VA
Sr. Data Stage Developer
Responsibilities:
- Used various sourced and designed and developed jobs in order to facilitate the integration process of the expenditures.
- Analyzed reports made by business user to extract data to effectively integrate expenditures from various sources.
- Developed number of staging jobs to load the data into target table, created number of complex jobs in the life cycle and also was involved in migration, error management, reporting, and data quality issues.
- Worked with widely used stages like Flat File, Lookup, Join, Pivot, Transformer, Sort, Aggregator, Merge, Row Generator, and Column Generator and also troubleshooter the designed jobs and tested the jobs for all logical errors.
- Evaluated the Data extraction from source to confirm for data irregularities and classify corrupt data to apply suitable transformation in the mappings in the jobs.
- Used diverse partitioning methods like Auto, Hash, Same, Entire etc. and were also involved in preparation of Test Cases concerned with Unit testing, System testing to check data reliability.
- Involved in Data Extraction, Transformation and Loading (ETL process) from Source to target systems using Data stage.
Environment: IBM Info Sphere Data Stage 8.1 (Designer, Director, Administrator), Oracle 10g/9i, UNIX, MDM (Oracle CDH)/ Oracle Apps 11i/R12 (OM & AR modules),Shell Scripting, Erwin 7.0, Quality stage, Meta stage, TOAD, PL/SQL, Autosys, MS Access.
Confidential, Columbus, OH
Data Stage Consultant
Responsibilities:
- Involved in the design and development of Data Warehouse
- Worked closely with data modeler and database administrator to understand the business process of the data warehouse model
- Used Meta Stage for managing and collecting metadata from various other tools through the use of Meta Broker
- Extensively used Flat File Stage, Hashed File Stage, DB2 UDB Stage, FTP Plug-in Stage and Aggregator Stage during ETL development
- Used Parallel Extender for distributing load among different processors by implementing pipeline partitioning
- Involved in Designing Parallel Extender Jobs
- Worked with Business customers to identify the different sources of data in operational systems and developed strategies to build data warehouse
- Preparation of technical specification for the development of Extraction, Transformation and Loading (ETL) jobs to load data into various tables in Data marts
- Developed several complex Data Stage jobs for loading Participants to the data warehouse
- Provide technical support to team members for design and developing Data Stage Jobs
- Developed various jobs using Oracle, Aggregator, Sequential file stages
- Extensively used Parallel Stages like Join, Merge, Lookup, Filter, Remove Duplicates, Funnel, Row Generator, Modify, Peek etc. for development and de-bugging purposes
- Used Data Stage Director and the runtime engine to schedule running the server jobs, monitoring scheduling and validating its components
- Used Basic Routines to pass values from Sequencer to jobs in runtime
Environment: Ascential Data Stage 7.5.2 (Designer, Director, Manager, Administrator), Quality Stage, Profile Stage, Parallel Extender, Oracle 9i, DB2, Teradata, UNIX Solaris, MS Access, Autosys, Erwin 4.0, Windows NT
Confidential, Tampa, FL
Data Stage Developer/ETL Analyst
Responsibilities:
- Used the Data Stage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse
- Extensively used Data Stage Director for debugging, Validate, Run and monitor the jobs
- Used Data Stage Manager to export/import jobs from environment to environment
- Used Meta broker to import the table definitions from Erwin
- Extensively used Hashed files to improve the performance of Referential Lookups in Server Jobs
- Used stages Link Practitioner, Link Collector, Hash Files, Sequential File stage, Oracle OCI, ODBC stages in server jobs
- Designed Parallel jobs using Dataset Stage, aggregator, sort, merge, join, remove duplicates, filter and funnel, copy and peek and transformation and Look-up stages and modify stages
- Reviewed, modified the existing Data Stage Jobs and developed the logical flows for Data Stage Jobs
- Used the partitioning techniques in most accurate way for increasing the speed of Parallel job execution
- Used Stored Procedures created by the DBA, through Stored Procedure Stage in Server Jobs and in Parallel jobs
- Created Job Sequencer to execute the jobs in batches
- Analyzed the performance bottlenecks and fine-tuned the jobs
- Scheduled jobs through UNIX shell scripts in UNIX CRON utility
- Coordinated with team members at times of change in Business requirements and change in Data Mart Schema
- Interacted with User Groups/ Corporate Testing Groups/Business people
Environment: IBM Web sphere Data Stage (Designer, Director, Manager, Administrator) 7.5.1/2 Enterprise Edition (formally known as Parallel Extender), Windows XP, UNIX AIX, MDM, Oracle OBIEE 10g, Teradata, Erwin 3.5, SQL, PL/SQL, Crontab
Confidential
ORACLE 10g Database Design Consultant
Responsibilities:
- Member of the development team in building up the Employee database in Oracle.
- Created optimized, single and cascaded database triggers and stored procedures in PL/SQL to check integrity constraints.
- Used knowledge of advanced PL/SQL concepts like arrays, tables, cursors, built-in and user defined object types, exception handling and database packages.
- Utilized SQL*Plus for SQL coding of DDL statements for creation of the required database objects and DML queries for data retrieval.
- Involved in loading large amounts of data using utilities such as SQL Loader
- Gathering requirements and providing development suggestions to the design team.
- Actively participated in formulating technical designs based on business needs.
- Studied business requirements and created relational database designs in a team environment.
- Participated in the final testing phases which required writing SQL code as well.
Environment: Oracle 8i, SQL, PL/SQL, Forms, Reports, Developer 2000, SQL*Plus, SQL Loader, Windows 2000