Etl Data Stage Developer Resume
Freeport, ME
SUMMARY
- Sr. Data Stage Developer with more than 7 years of experience in the field of ETL design and development. Involved in Gathering of Requirements, System Design, Data Modeling, ETL Design, Development and Production Support and Maintenance.
- Over 7 years of IT experience in implementation of ETL solutions and processes.
- Over 6years of experience in using IBM Data Stage 8.5/8.0.1/7.5.1/7.0 (Data Stage Designer, Data Stage Director, Data Stage Administrator) and developing data stage Server jobs, Parallel jobs using different stages such as Aggregator, Sort, Transformer, Hash File, Sequential File,Link Collector, Link Partition, Funnel, Sort, Remove Duplicates, Look - Up, Join, Merge, Aggregator, DB2 Enterprise, Data Set, File Set.
- Over 3 years of experience in Data Warehousing and Oracle Warehouse BuilderOver 3 years of experience in Data Warehousing and Oracle Warehouse Builder.
- Experience in designing the architecture of Data Warehousing and Business Intelligence solutions in a multi environment.
- Good knowledge in Data warehouse concepts and principle like Star Schema, Snowflake Schema, Slowly Changing Dimension, Surrogate Key, and Normalization etc.
- Experience in ETL design and development of Data Marts and Operational Data Stores.
- Knowledge in logical, physical data modeling and conceptual data modeling and performance tuning of IBM DB2 database, ETL process.
- Working experience with DBA for better performance.
- Experienced in scheduling Sequence, Parallel and Server Jobs using Zena Scheduler and Data Stage Director.
- Designed and developed Server Jobs, Parallel Jobs and Sequence Jobs using Data Stage Designer.
- Excellent communication skills and good team leading knowledge skills.
TECHNICAL SKILLS
DW / ETL Tools: IBM Info Sphere / Web Sphere Data Stage 8.5/8.7/8.0.1/7.5.1/7.0 (Designer, Director, Administrator) Server Jobs, parallel jobs, Sequence Jobs, Quality Stage.
Programming languages: C, C++, OOPS through JAVA, PL/SQL, VB
Operating Systems: Windows 2000/XP/Vista/7/8, UNIX, IBM AIX
Data Bases: DB2, SYBASE, Oracle 10g/11g, SQL server 7.0/2000.
Web Technologies: HTML, XML, Java scripts, Cascading Style Sheets
Data Modeling Tools: MS Visio, MS Access, ERWIN, Star Schema, Snow Flake Schema, Physical and Logical Data Modeling
Other Tools: Sybase Central, IBM DB2 command editor, Squirrel command editor, Daptive, JIRA, Trizetto, Zena Scheduler.
PROFESSIONAL EXPERIENCE
Confidential, Freeport ME
ETL Data Stage Developer
Responsibilities:
- Designed the ETL jobs using IBM Info sphere Data Stage 8.5 to Extract, Transform and load the data into EDW.
- Design the jobs using different Databases, Processing and File Stages like DB2 connector, Oracle connector, Transformer, Aggregator, Sort and Sequential Files or Data Sets.
- Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
- Design the jobs using different stages to load the data into warehouse.
- Design the jobs using different stages like JOIN, LOOK-UP, SORT, AGGREGATE, REMOVE-DUPLICATES and FUNNEL to load the data into EDW.
- Designing the shared container jobs for reusing of business logic.
- Creating the data flows in the design studio by considering various stages and connectors.
- Responsible to create the standard parameter sets with unique standard naming formats.
- Responsible to design the jobs according to the requirements and standards.
- Responsible to create the .DSX files of the designed codes.
- Responsible to create the Unit Test plan and conduct the meeting sessions with the testers and compare the Unit Test results with the different test cases of testers.
- Responsible to create the Deployment plans by including all the pre-production and post-production steps and getting the approval from change management team to deploy the .DSX files into QA and Production environment
Environment: IBM Info Sphere Data Stage 8.7(Designer, Director), Control M scheduler, Tivoli Scheduler,Squirrel Command Editor, Oracle 10g, DB2 Database.
Confidential, MO
ETL Data stage Developer/Unit-Tester
Responsibilities:
- Attend the meetings with the Vendors, Data Architects and Project Managers and analyze the requirements.
- Attend the Mapping review meetings conducted by BDA and BSA's and analyze and make sure the requirements are covered in the CDMA mappings.
- Designed the ETL jobs with the help of CDMA mappings using IBM Info sphere Data Stage 8.5 to Extract, Transform and load the data into EDW (Ware House) or create the File Extracts to vendors.
- Responsible for configuration of data-stage tool and creation of project and Environment variables.
- Design and develop the ETL jobs using Server Edition or Parallel Edition according to the CDMA mappings.
- Design the jobs using different Databases, Processing and File Stages like DB2 connector, Sybase connector, Transformer, Aggregator, Sort, Link Collector, Link Partitioner, Hash File and Sequential Files.
- Responsible to design the Sequence jobs in order to create a sequence to the Server jobs or Parallel jobs.
- Responsible to create Sequential files in order to meet the end user requirements.
- Once the initial design of the jobs is done, unit testing of the Sequential files is performed.
- After the unit testing the files are sent to testing team to perform different kinds of testing like End-to-End testing, Smoke testing, Regression Testing.
- Responsible to work with testing team in explaining the Data Pattern to the testing individuals.
- Once the testing of the files is done, the sequential files are sent to vendors for third-party vendor testing in order to full-fill the requirements.
- The files to the third-party vendors are sent through SFTP process (Sterling File Gate Way), the server connections are set prior to the development and some specific file naming conventions are followed to send the files.
- Once we get the approval from the vendors on the Sequential Files develop the .DSX files of the designs and prepare the unit-test plan and test cases.
- Responsible for the Deployment of code into Test and Production environments which includes preparation of Deployment Plan, Code Review Documents, Code Approvals, Unit Test Plans. The deployment plan covers all the pre-production and post-production steps and responsibilities.
- After that responsible to prepare the RFC document to deploy the .DSX designs into production.
- Responsible for the creation of Zena jobs in order to schedule the data stage jobs, also responsible for the creation of PAR files and its deployment into necessary environments.
- After the successful deployment of the designs responsible for monitoring the Data stage job log and create a log report, the log report contains the details of time elapsed, row counts and errors occurred etc.
Environment: IBM Info Sphere Data Stage 8.5(Designer, Director), ZENA scheduler, IBM DB2 command editor, SYBASE editor, FACETS Trizeto Application interface, Microsoft SQL 2005/2008.
Confidential, Detroit, MI
ETL Data stage Developer/ Tester
Responsibilities:
- Design the ETL jobs using IBM Info sphere Data Stage 8.5 to Extract, Transform and load the data into staging, ODS and EDW.
- Responsible for configuration of data-stage tool and creation of project and project variables.
- Design and developed Data Models for the Business Requirements.
- Design and developed the ETL jobs using Parallel Edition according to the data models which distributed the incoming data concurrently across all the processors, to achieve the best performance.
- Responsible to work on Complex flat files which are used to develop the end user requirements of MVS data sets and transform them and load them into the system.
- Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
- Responsible for generation of DDL statements, which are executed for database creation.
- Responsible for preparing Physical/logical data models.
- Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
- Handled Performance Tuning of Jobs to ensure faster Data Loads.
- Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
- Performed the Integration and System testing on the ETL jobs.
- Translated business rules and functionality requirements into ETL derivations.
- Scheduled jobs using Auto-sys scheduler utility based on the requirements and monitored the production processes closely for any possible errors.
- Migrated projects from development to QA to Production environments.
- Assisted operation support team for transactional data loads in developing SQL&UNIX scripts.
- Imported the required Metadata from heterogeneous sources at the process level.
- Created Job Parameters and Environment variables to run the same job for different sources and targets.
- Used the Data Stage Director to schedule running the job, testing and debugging its components, and monitoring.
- Created Shared Containers for Re-using the Business functionality.
- Collaborated with BO team to design crystalreports for Enterprise reporting applications.
- Worked with Developers to troubleshoot and resolve issues in job logic as well as performance.
Environment: IBM Info Sphere Data Stage 8.5(Administrator, Designer, Director), IBM Information Analyzer 8.1.1a, Microsoft SQL 2005/2008, IBM DB2 9.1, Oracle 11g, Java, MS-Access, shell scripts, PUTTY, WINSCP, ERWIN 8.1, Mercury Quality Center.
Confidential, Warren, NJ
ETL Data Stage Developer
Responsibilities:
- Responsible for understanding of business rules and standards and act accordingly.
- Involved in identifying the business rules for developing Data Warehouse.
- Involved in data modeling activities using ERWIN.
- Involved in architectural design and sharing of thoughts.
- Creation of physical data model by Reverse Engineering.
- Generated DDL scripts to deploy the model to a database.
- Comparing the objects in the database and to generate DDL script.
- Working with DBA to monitor the data stage server performance.
- Develop ETL source data to the standard values and format the data warehouse.
- Designing of different jobs using the data stage designer for extracting, transforming and loading the data into data marts.
- Working on how to import some data stage jobs and run in the tool.
- Designing the shared container jobs for reusing it.
- Creating the data flows in the design studio by considering various stages and connectors.
- Working on different stages like Look up, Join, Funnel Filter, Row Generator, Column Generator, Slowly Changing Dimension and Remove Duplicates, Auto-Scheduler.
- Developing some sequence jobs to extract and load jobs on schedule basis.
- Involved in unit testing and system integration testing.
- Working with reporting team for generating reports and developing of user interface dashboards.
Environment: IBM Web sphere Data Stage 8.1(administrator, designer and director), IBM Info sphere warehouse 9.7, windows XP, ERWIN, Web sphere Administration Console, MS Visio, Auto-Sys.
Confidential, Minneapolis, MN
ETL Data Stage Designer
Responsibilities:
- Responsible for assisting in architectural design and development related to data warehouse and IBM Info Sphere Information Server platforms.
- Involved in understanding the scope of application, present schema, data model and defining relationship within and between groups of data.
- Gather the Data from different sources and perform the Operational Data Integration (ODI) to the data.
- Administered the Data Stage for Security Hazards, denied access for non- authorized ones.
- Maintained backup for emergency purpose.
- Allocated memory space on Data Stage by configuring the nodes to it for various purposes.
- Used Data stage Parallel Extender to load data, utilizing the available processors to achieve job performance, configuration management of system resources in Orchestrate environment.
- Developed necessary metadata repositories for all initiatives and ensure these meet current needs and provide flexibility for future growth.
- Used to work on Complex Flat Files, which are used to develop the MVS datasets.
- Managed migration of all job batches and related designs from Version 7.5 to 8.1, incorporating new functionality and notification capabilities.
- Used DB2 EE stage for doing loads into DB2 UDB Database and to load large volumes of data into Teradata.
- Implemented Oracle Warehouse Builder to perform data conversion.
- Extensively used Lookup, Join, Merge stages for joining various information and also used Parallel Transformer, Column Generator, Funnel, Filter, Switch, Modify, Pivot, Row Generator from various database DB2 Enterprise, Oracle Enterprise.
- Used Metadata Repository for storing data stage log messages.
- Designed Conceptual, Logical and Physical Data Mart using Star Schema Methodology using ERWIN data model.
- Involved in Deal decisions and Deal Processing data in Data warehouse. This required various complex data transformations, with the involvement of number of tables.
- Participated in source to target mapping design document, prepared system requirement documents based on data model and source target mapping documents.
- Optimized Query Performance, Session Performance and Reliability.
- Scheduled various ETL Batch processes using Auto Sys.
- Worked with Connect Direct processes, FTP, SCP scripts for Transferring files between Servers and Legacy systems.
- Created interfaces for SQL data access to corporate level operations codes used as dimensions in the Data Warehouse.
- UNIX scripts written to create and move files for ad hoc client projects, executing custom programs based on project specifications.
- Scheduled ETL processes to avoid Conflicts both at Resource utilization level, Database lock issues and to avoid Data stage contention issues.
- Trouble-shouted, reloaded and rejected records using DTS, SQL scripts.
- Performance tuning of ETL jobs.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements.
- Responsible for Planning UAT Testing.
- Used Clear Case to store entire-project .DSX backups.
- Interacted with Report Users and Business Analysts to understand and document the Requirements and translated these to Technical Specifications for Designing Universes and Business Object Reports.
Environment: IBM Web Sphere Data Stage 8.1(Administrator, Designer, Director), SQL, PL/SQL,DB2,Teradata, Meta stage, Profile Stage, Quality Stage, IBM AIX, Erwin Data Modeler, Clear Case, Oracle 10g, Auto-Sys, Business Objects.
Confidential, Southfield, MI
ETL Developer/Trainer
Responsibilities:
- Worked on Data Stage Designer, Manager, Administrator and Director.
- Worked with the Business analysts and the DBAs for requirements gathering, analysis, testing, and metrics and project coordination.
- Involved in extracting the data from different data sources like Oracle and flat files.
- Creating ETL Job flow design.
- Involved in creating and maintaining Sequencer and Batch jobs.
- Created various standard/reusable jobs in Data Stage using various active and passive stages like Sort, Lookup, Filter, Join, Transformer, aggregator, Sequential file, Datasets.
- Involved in development of Job Sequencing using the Sequencer.
- Used Remove Duplicates stage to remove the duplicates in the data.
- Taking the regular backups of the jobs using Data Stage Export/Import utility.
- Used designer and director to schedules and monitor jobs and to collect the performance statistics.
- Extensively worked with database objects including tables, views, indexes, schemas, PL/SQL packages, stored procedures, functions, and triggers.
- Creating local and shared containers to facilitate ease and reuse of jobs.
- Implemented the underlying logic for Slowly Changing Dimensions.
- Executed Pre and Post session commands on Source and Target database using Shell scripting.
- Worked with Developers to troubleshoot and resolve issues in job logic as well as performance.
- Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
Environment: Data Stage Enterprise Edition 7.5.2/7.1 Parallel Extender, Profile Stage, Data Quality, Meta Stage, DB2 UDB 8.0, Oracle 10g, Sybase, AIX, PL/SQL, Business Objects 6.5, OLAP, ERwin5.5, SQL plus, SQL Loader, Sun Solaris 8.0.
Confidential
ETL developer
Responsibilities:
- Developed several transformations in the process of building Data warehouse database.
- Used server jobs to Extraction, Transformation and Load.
- Analyzed and designed source code documentation for investment Data Warehouse.
- Used Data Stage Designer for developing various jobs to extract, cleansing, transforming, integrating and loading data into Data Warehouse.
- Used COBOL programs to extract data from the mainframes and create a load ready file.
- Used Data Stage Manager for managing Data Stage repository (view and edit), define custom routines & transforms, Import and export items between different Data Stage systems or exchange metadata with other data warehousing tools.
- Extensively used Parallel Stages like Join, Merge, Lookup, Filter, Remove Duplicates, Funnel, Row Generator, Modify, Peek etc. for development and de-bugging purposes.
- Extensively worked with Data Stage Job Sequences to Control and Execute Data Stage Jobs and Job Sequences using various Activities and Triggers.
- Used Data Stage Director and the runtime engine to schedule running the server jobs, monitoring scheduling and validating its components.
Environment: Data Stage 7.5, Oracle 8i, SQL Server 2000.