Datastage Etl Developer Resume
Columbus, OH
SUMMARY
- ETL developer with 8+ years of IT experience, with special expertise in Development, Analysis and Design of ETL methodologies in all the phases of the Data Warehousing life cycle.
- Experience on Analysis, Design, Development, Testing, Implementation and Support life cycle for Data Warehouse and Data Integration projects using Extraction Transformation
- And Load (ETL) methodologies using IBM InfoSphere Information Server 8.5, IBM Info Sphere DataStage 8.1.0.
- Experience in Data warehousing involving data warehouse analysis and design using Acential DataStage 8.5/7.5/6.0 (Manager, Designer, Director and Administrator), Data mart, OLAP and OLTP
- Extensive experience in Ascential Datastage 8.5/8.1/7.5 using components like Datastage Designer, Datastage Manager, Datastage Director
- Datastage Administrator and Parallel Extender and IBM WebSphere 8.5 (Datastage, Information Server, Quality Stage, Information Analyzer, Metadata Server).
- Expert in all the stages of Software Development Life Cycle.
- Expert in developing Datastage jobs using star schema and snowflake schema modeling and conversant with Data Warehouse concepts like fact tables and dimension tables.
- Efficient in in corporation of various data sources such as Oracle, MS SQL Server, DB2, and Flat files into the staging area.
- Experienced in UNIX shell scripting.
- Strong understanding of the principles of Data Warehouse using Fact Tables, Dimension Tables, Star Schema modeling and Snowflake Schema modeling.
- Experienced in incorporating various data sources like Oracle, MS SQL Server, DB2and flat files into the staging area.
- Experienced in troubleshooting of Datastage jobs and addressing production issues like performance tuning and enhancement.
- Expertise in data migration projects with (target - source) same database as well as with heterogeneous databases.
- Excellent communication and presentation skills.
TECHNICAL SKILLS
Data Warehousing: IBM Information Server 8.5, IBM Infosphere DataStage 8.1.0,IBM WebSphere DataStage 7.5.1/7.5/6.0 (Administrator, Manager, Designer, Director, Parallel Extender, Quality Stage/Integrity, MetaStage), DataStage Plug-In, Data Mining, OLAP and OLTP
Dimensional Data Modeling: Dimensional Data Modeling, Data Modeling, Star Schema Modeling, Snow-Flake Modeling, FACT and Dimensions Tables, Physical and Logical Data Modeling, ERwin 4.0/3.5, Oracle Designer
Programming: Unix Shell Scripting, SQL, ANSI SQL, SQL * Loader, SQL*Plus 3.3/8.0
Databases: Oracle 10g/9i/8i, MS SQL Server 2000/7.0/6.5, DB2, MS Access 7.0
Environment: Sun Solaris 2.6/2.7, HP-UX, IBM AIX 4.2/4.3, OS/390, MS-DOS 6.22, Win 95/98, Win NT 4.0
PROFESSIONAL EXPERIENCE
Confidential, Chicago
Datastage ETL Developer
Responsibilities:
- Worked on Functional design, Detailed level designs and Mapping documents
- Created Unit and Integration Test Plan documents
- Worked on Creating UNIX directories, access according to best practice guide lines
- Worked with Oracle DBAs to add the tns entries for the interaction of DataStage with Oracle database.
- Added DataStage Environmental Variables at the Project Level
- Created ODBC entries for the Datastage interaction with SQL server.
- Used different Parallel job stages like Join, Merge, Lookup, Filter, Col and Row generator, Transformer, Modify, Aggregator, Remove Dup and Target Stages, Oracle and ODBC Stages, Stored Proc Stages, Custom Wrapper Stage e.t.c.
- Worked on new Transformer Looping using DataStage v8.5
- Created Master sequencers using User variable Activity, Job Activity, Execute Command Stage, Start Loop Activity, End Loop Activity, Nested Condition, Exception Handler Stages
- Created UNIX shell scripts to invoke DataStage sequencer and error handling.
- Used Control-M as a scheduling tool to handle event based scheduling and time based scheduling.
- Worked on Datastage admin activities like creating ODBC connections to various Data sources, Server Start up and shut down, Creating Environmental Variables, Creating Data Stage projects and Message Handler files, Dsparams File.
- Created shared container and after job sub-routine to record each job start time and end time to log in the Audit tables
- Defined Best ETL Data Stage practices and naming conventions as well Followed and implemented New Oxygen-4 (M27) Global DataStage Standards
- Was involved and implemented in Performance tuning of Datastage jobs with proper datastage partitioning techniques and Node configuration
- Involved in the Production On call Support during Migration event
- Used Quality Centre to track defects and updated the status as and when the changes are done
- Used ClearCase and ClearQuest to check in the Datastage code and Proper change management.
Environment: IBM Infosphere Datastage 8.5, IBM InfoSphere Datastage 8.1.0, Oracle 11i/10g, DB2, AIX 6.1, SQL,PL/SQL, TOAD, SQL Developer, Microsoft-Visio,Control-M,UML, Hyperion-Essbase, TSM, Lotus Notes, TMW Maestro, ClearCase 6.0, Erwin 4.1, MainFrame, Windows XP.
Confidential, NY
Datastage Developer
Responsibilities:
- Identified business needs, evaluated business and technical alternatives, recommended solutions and participated in their implementation.
- Involved in status meetings and interacted with the business analyst to get the business rules.
- Imported data from various transactional data sources residing on SQL Server 2005, DB2 9.5 and Flat files and loaded into Oracle database.
- Used Information Analyzer for Column Analysis, Primary Key Analysis and Foreign Key Analysis.
- Identified and documented the slowly changing dimensions.
- Extensively worked on Parallel jobs Enterprise Edition Environment for splitting bulk data into subsets and to dynamically distribute to all available processors to achieve best job performance.
- Designed Parallel jobs using various stages like join, merge, remove duplicates, filter, dataset, lookup file set, aggregator, change capture, slowly changing dimension and funnel stages.
- Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
- Enhanced the reusability of the jobs by making and deploying shared containers and multiple instances of the jobs.
- Imported and exported Repositories across Datastage projects.
- Extensively used Autosys for automation of scheduling for UNIX shell script jobs on daily, weekly monthly basis with proper dependencies.
- Used Oracle PL/SQL for writing stored procedures, packages for extracting the data.
- Involved in creating technical documentation for source to target mapping procedures to facilitate better understanding of the process and in corporate changes as and when necessary.
- Involved in the migration of Datastage jobs from development to production environment.
- Responsible for the delivery of solution-oriented complex reports using Cognos Report Studio.
- Used Framework Manager to build models, packages and publish packages to Cognos ReportNet Server.
- Worked on troubleshooting, performance tuning and performance monitoring for enhancement of Datastage jobs.
- Handled successfully various severity issues, Meet the dead line with in SLA.
- Created environment to load data files, codes in testing environment to test with customers and also evaluated it.
Environment: IBM InfoSphere Datastage 8.1, Asential Datastage 7.5 Enterprise Edition/Parallel Extender (Datastage, Quality Stage), SQL *Loader, Autosys 3.0, IBM DB2 7.2, SQL Server 2008, Oracle 10g, Sequential files, Flat files, SQL, PL/SQL, Shell scripts, UNIX, Windows XP. IBM Tivoli 8.2
Confidential, NY
Datastage Developer
Responsibilities:
- Involved in understanding business processes and coordinated with business analysts to get specific user requirements to build Data Marts.
- Modeled the Star Schema data marts by indentifying the facts and dimensions using ERwin Data modeling tool.
- Designed and developed the DataStage server as well as parallel jobs for extracting, cleansing, transforming, integrating and loading data using DataStage designer.
- Developed DataStage jobs to load the data into tables using fast load utility.
- Worked with DataStage director to schedule, monitor and analyze performance of individual stages and run DataStage jobs.
- Imported and exported repositories across project using DataStage manager.
- Set various environment variables and parameters in DataStage administrator and also used them in managing the projects.
- Used several stages like sequential file, hash file, aggregator, funnel, change capture, change apply, transformer, merge, join and lookup during the development process of the DataStage jobs.
- Involved in the preparation of ETL documentation by following the business rule, procedures and naming conventions.
- Used shard containers for reusability and reducing job complexity.
- Responsible for unit, system and integration testing. Development test scripts, test plan and test data. Participated in UAT (User Acceptance Testing).
- Analyzed data with discrepancies through error files and log files for further data processing and cleansing.
- Responded to user request on queries on the enterprise data warehouse and creation of reports using Cognos 8.
- Created Autosys jils for scheduling and running DataStage jobs.
- Used UNIX commands like awk, sed, tr, cat.
Environment: IBM Infosphere Datastage 8.1, autosys scheduler, QualityStage, Win 2000, Goldengate 10.0, DataMirror, SQL, PL/SQL C++, AIX,UNIX scripting, JAVA, ERwin 6.1.0, DB2 DB,IBM mainframe, Cobol flat files, Oracle 10g,Clear Case and Rational Quest.
Confidential, Columbus, OH
Datastage Developer
Responsibilities:
- Involved in developing Parallel as well as Server jobs.
- Involved in creating entity relational and dimensional relational data models using data modeling tool ERwin.
- Used Datastage Manager for importing metadata from repository, new job categories and creating new data elements.
- Developed Datastage jobs using star schema and followed development standard into different projects.
- Generated surrogate ID’s for the dimensions in the fact table for indexed and faster access of data.
- Created surrogate key tables to map the required dimensions.
- Involved in the migration of data from oracle 8i to oracle 10g.
- Wrote UNIX shell scripts for initialization process, to solve deferred bugs and for process control mechanism.
- Designed the target schema definition and extraction, transformation and loading using Datastage.
- Maintained all the data needed for supporting the sales results and compensation processing rules.
- Involved in low level design and developed various jobs and performed data loads and transformations using different stages of Datastage and pre-built routines and functions.
- Mapped data items from source systems to the target system.
- Used the Datastage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Worked on programs for scheduling data loading and transformations using Datastage.
- Used Datastage Director to schedule and monitor the jobs to load into target database.
- Designed documentation and generated reports of the Datastage jobs
- Designed and developed PL/SQL procedures, functions, and packages to create summary table.
- Coded, tested and implemented components for querying and updating the database.
- Performed tuning of ETL jobs.
Environment: IBM Web sphere, Ascential Data Stage 7.5(Parallel Extender & Server), Erwin 7.0, SQL* Loader, Oracle 9i,MS Access 2003, Oracle 8i/9i/10g, SQL Server 2000, AIX UNIX, SQL, PL/SQL, XML, Windows XP.