Sr. Datastage Developer Resume
Mclean, VA
SUMMARY
- Over 7.5Years of IT Experience in development of Data warehousing using DATASTAGE PARALLEL JOBS & IBM Web Sphere Information Server.
- Experience in Development and Implementation of Client Server Applications.
- Experience in System Analysis, Design and Development and implementation of Relational Database (OLTP), Data Warehousing Systems (OLAP) using Data Stage 7.X/8.7/8.5 and 9.1 (Parallel Extender) and Dimensional modeling (Star schema and Snowflake schema).
- Directly Responsible for the Extraction, Transformation and Loading of data from multiple sources into Data warehouse. Expert in dimensional modeling, Star Schema modeling, Snowflake modeling, fact and dimension table design, physical and logical Data modeling using Erwin.
- Good experience with databases like SQL Server 2000/7.0, Oracle 10g/9i/8i/7.x, SQL*Plus, DB2 UDB 8.x, Teradata, DB2/400 and MS Access 2000/97/7.0, database programming using PL/SQL
- Proficiency in data warehousing techniques for data cleansing, slowly changing dimension phenomenon, surrogate key assignment and change data capture.
- Experience in Designing DS jobs using Processing stages like Filter, Join, Merge Lookup and Transformer Stage etc.., File Stages like Sequential file and Data set.
- Experience in Import/Export Jobs from Development to Production Environment.
- Experience in Performance tuning of jobs in Data Stage.
- Knowledge in Implementation of the SCD Type - 2.
- Knowledge in Creating the Job Sequencer and Containers.
- Good at Data Warehousing Concepts, ETL Concepts, UNIX Commands, Data Replications using SQL commands and IBM MQ.
- Good knowledge in usingSOAPfor exchanging information in computer networks usingXML and stages related to XML.
- Involved in Unit Testing and Preparing test cases.
- Ability to work in-groups as well as independently with minimum supervision and initiative to learn new technologies and tools quickly.
- Experience in Fine Tuning, Performance Enhancement, and Performance Analysis and Trouble Shooting of Data Stage jobs.
- An excellent team player with highly favorable interpersonal, multitasking, communication skills with hardworking, fast learning and prioritizing capabilities.
- Reputation for strong organizational skills, excellent communication skills, dedicated Teamwork, Attention to details, ability to work under pressure to balance competing priorities and meet Deadlines.
TECHNICAL SKILLS
Databases: Oracle10g/9i/8i/7.x, SQLServer 2014/2012/2008/2005/2000 , SQL*Plus, DB2 UDB8.x, SQL/400, Teradata, Netezza, MS Access.
ETL TOOLS: SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS), OLAP tools, IBM Information Server 9.1/8.X/ 7.5/7.1/5.2/4.0 Parallel Extender
Languages: SQL, T-SQL, PL/SQL, Dynamic SQL, .NET, HTML, C, C++, C#, UNIX.
Web Technologies: XML, HTML, XSL, JavaScript, IIS
Database Design Tools: Erwin 4.0 (Forward engineering, Reverse engineering).
Operating Systems: Windows 2000/NT 4.0, Windows 2003 Advanced Server/Windows 95/98/200/XP-pro, UNIX, MSWindows95/98/2000/XP
PROFESSIONAL EXPERIENCE
Confidential, McLean, VA
Sr. Datastage Developer
Responsibilities:
- Involved in all phases including Requirement Analysis, Design, Coding, Testing, Support and Documentation.
- Worked with Data Modelers, Technical Architects, Customer/end user, Business analysts, and Data analysts to design Technical Specification documents / Mapping documents.
- Extensively used Datastage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into the Data Warehouse database.
- Created DataStage jobs to extract data from mainframe files to staging area and from staging to base database.
- Created the various complex Datastage jobs to accommodate various complex logics.
- Extensively used DataStage stages like sequential file, Copy, Aggregator, Surrogate key, Transformer, dataset, look up, Aggregator, join, Remove Duplicates, sorter, Column generators, CDC, and Funnel.
- Extensively used Qualitystage stages like Investigation stage, Standardize, Match frequency, duplicate & unduplicated match and Survive stages.
- Developed several complex ETL jobs for Historical data loads and ongoing data loads using DataStage.
- Worked on setting up different environments for development, system testing, UAT testing and Production
- Tested all the developed jobs based on the requirements of the project and deployed the code into production environment.
- Involved in performance tuning of the jobs while developing the Datastage jobs and also for existing jobs.
- Used Quality Stage plug-in stage to call Quality Stage jobs into the DataStage Designer.
- Implemented slowly changing dimensions SCD TYPE1 and TYPE2.
- Created and used Shared Containers to reuse the logic in another Job.
- Developed staging and Data Mart DS jobs using Data Stage Designer on parallel environment and Involved in writing the possible Unit test cases and tested number of job and also resolved the defects in developed jobs.
- Extensively used Datastage scheduler for scheduling the Datastage jobs and UNIX scripts.
- Extensively used SQL in Datastage jobs for processing data.
- Developed batches and sequencers in designer to run and control set of jobs.
- Involved in importing and exporting jobs category wise and maintaining the backup regularly.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements.
- Developed job sequences for the designed jobs using Job Activity, exec command, E-mail Notification Activities and Triggers.
- Proficient in writing complex SQL’s to validate the data between different stages (Source to Data Warehouse, Data Warehouse to Data mart) in the data warehousing environment.
- Involved in Unit, Integration/System and User Acceptance Testing (UAT) and supported testing team.
- Recommended industry best practices in design and development.
Environment: IBM DataStage/Qualitystage 9.1/8.7/8.5/11. x, DB2 UDB 9.7/9.1, DB2 Z/OS, MS SQL Server 2008Rapid SQL 8.1.1, Main Frames, Autosys 4.0, HP Quality Center 11/10.
Confidential, Arlington, TX
Sr. Datastage Developer
Responsibilities:
- Worked with Data Architect (DA) team to gather requirements and mapping specifications that were put together in IBM Infosphere FastTrack.
- Designed and developed several datastage jobs to extract data from Epic Clarity source system (Oracle) & ALLSCRIPTS (SQL server) and load to highly normalized EDW (DB2) tables with intermediate steps landing data as-is from source, staging the data in a format that is similar to AWM model.
- Worked on performance tuning of datastage jobs and SQL to handle large volumes of data.
- Extensively used CDC (Change Data Capture) stage, implemented SCD (Slowly Changing Dimension) and used Join, Lookup stages & SQL join appropriately to lookup reference data based on expected volumes.
- Used different types of surrogate key generation methods, change detection methods etc. all with the intent of accurate and faster processing of data.
- Used connecter stages (Oracle, ODBC, DB2, Netezza) to connect to database for efficient read/write operations.
- Extracted data from data warehouse and created multiple weekly and monthly flat files.
- Created ETL design documents, Unit test results documents, Quality Assurance test cases and participated in QA testing
- As a part of version control to migrate jobs from one environment to other used Clear case version control software was used
- Participated in code reviews, worked closely with IBM Datastage and DB2 consultants on some of the performance related issues.
- Used HP Quality center to log and as well keep track of defects.
- Worked on replatform project to move the code from 8.5 to 9.1 and convert the jobs from DB2 to Netezza.
- Tweaked the source SQL’s as well as UPDATE SQL’s to support Netezza.
Environment: IBM Information Server (Datastage, FastTrack) 8.7/8.5/11.x, Netezza, DB2 9.7, Oracle 11.2,MS SQL Server 2008 R2, AIX 7.1, Epic Clarity, All scripts EHR, Clear Case, Aqua Data Studio, HP Quality center.
Confidential, Frisco, TX
Sr.Datastage Developer
Responsibilities:
- This project is done in two phases 1Phase: Using IBM Information Analyzer, done column Analysis
- 2 Phase: Provided hands-on participation, technical guidance and leadership to support existing Data warehouse applications, involving DataStage, Quality Stage.
- Used Multi load stage using Teradata Utilities (TPUMP, MultiLoad) to load into Teradata database.
- Developed reusable jobs using Dynamic Metadata using run column propagation.
- Developed in writing transforms using stage variables for jobs and code for batch jobs to run jobs in parallel.
- Performing export and import of DataStage components, table definitions and routines using DataStage Designer.
- Developed Job Sequences and implemented logic for job sequence loops, recovery and restart.
- Used DataStage Director to clear the job logs, job resources and status files.
- Experience in complete life cycle of Design, Development, Maintenance and Documentation of Conversion Process
- Worked with Datasets, Lookup, Merge, Join, Funnel, Transformer etc.
- Uses IBM MQ to communicate with different end users and it simplifies the application and maintains the stability in business.
- Profiled vendor supplied raw data using Information Analyzer.
- Prepared technical design, tests (Unit/System), and supported user acceptance testing.
- Involved in setting up the ETL standards and helped the client to use ETL best practices.
- Worked on Perl Scripting for Transforming Raw data to the standard format.
- Identified performance bottle-necks and suggested improvements.
- Used Maestro tool as third party tool for scheduling ETL jobs and notifications.
Environment: DataStage 8.1 using IBM Data Stage and Quality stage9.1/8.7/8.5, Erwin 4.2, Oracle 9i/10g, Teradata, DB2, Flat files, TOAD, UNIX- AIX, IBM MQ, Windows XP, MS Word, Excel.
Confidential
Datastage. Admin
Responsibilities:
- Developed jobs to load the external feeds from LOB’s (delimiter files, fixed length, XML files and Mainframe files) into database.
- Developed ETL jobs to extract data from SQL Server using ODBC Connector stage and load the data into internal DataMart using oracle connector stage.
- Used XML output and XML Transformer stages to generate XML output file.
- Extracted data from mainframeby using Change Data Capture (CDC) management console.
- Developed SQL scripts to Create/Modify tables and T-parameter at source and staging levels.
- Developed and assisted other developers to create complex Datastage jobs using Database, Development /Debug, Processing, file and Real time stages.
- Used Shared container for simplifying design and maintenance. Extensively dealt with Performance tuning of the jobs.
- Tuned data stage jobs to improve the performance and to reduce the load on database. Compiled technical documents as per the client standards.
- Prepared the deployment packages for the code and checking in code to repository.
- Involved in Writing Shell scripts to automate the ETL Process
Environment: IBM Information Server 8.X, Oracle 10G, Linux 2.6, SourceSafe, Microsoft SQL Server 2005, XML, VSS, 24X7 Scheduler
Confidential
Datastage developer
Responsibilities:
- Built prototype jobs for different environments for in-house developers to reference when developing new jobs as well as mentor and guide in-house developers.
- Developed several Parallel and Server jobs in Datastage Designer.
- The data is extracted from Flat files and loaded in to Oracle Database.
- From Target staging the data is loaded and stored in Final Data Warehouse by Using the Data Stage.
- Involved in the development of creating Parallel jobs using the DataStage Client Tool i.e. DS Administrator, DS Designer, DS Manager, and DS Director.
- Involved in data analysis and assisted business users.
- Responsible for identifying the failure process and reporting to concern developer.
- Involved in unit testing and Involved to compiling, validating, running, Monitoring the jobs.
- Developed Spreadsheet to update all data every week when they send new files and load new updated data into database
- Used DataStage Administrator to assign privileges to users or user groups to control purging of Repository and DataStage client applications or jobs they run, move, and rename projects.
- Worked as a datastage admin to assign a username/passwords and maintain ODBC connections, all datastage admin issues.
Environment: (DataStage7.5.2, Quality-Stage, Oracle10g/9i, SQLServer7.0)