We provide IT Staff Augmentation Services!

Sr. Datastage Developer Resume

0/5 (Submit Your Rating)

Minneapolis, MN

SUMMARY

  • 7.1 years of professional experience in retail industry in various capacities.
  • Over 6.8 years’ experience in using IBM Datastage 8.x/7.x
  • Data Stage Designer, Director, Administrator & Manager
  • Teradata & UDB DB2
  • Certified in Teradata & Datastage
  • Design Parallel jobs & Sequencers
  • Multi Dimensional Modeling
  • Industries: Retail, Telecommunication
  • Strong working experience on data warehousing applications, directly responsible for Extraction,
  • Transformation and Loading of data from multiple sources into data warehouse.
  • Executing Data stage jobs - Job execution status - Monitoring a job - Job log view - Job scheduling - Creating Batches - Scheduling batches.
  • Involved in all the phases of a project life cycle; including Requirements gathering, Analysis and design, Development and coding, Unit testing, Integration testing, Implementation and Maintenance.
  • Strong knowledge of data warehouse architecture and designing star schema, snowflake schema, FACT and Dimensional Tables, Physical and Logical Data modeling using Erwin
  • Expertise in data warehousing concepts, ETL programming using Datastage Server jobs, Parallel jobs, Job Sequencers, Batch Jobs and other data warehouse lifecycle tasks such as data analysis, cleansing, transforming, debugging/testing, and data loading across source systems
  • Strong knowledge with Extraction Transformation and Loading (ETL) processes using Datastage ETL Tool, UNIX shell scripting
  • Worked extensively using key DataStage stages like the Aggregator, Transformer, Lookup, Sequential file, Data Set, Join, Sort, Remove Duplicate, Funnel, Copy and Peek
  • Experience in job Sequencer to specify a sequence of parallel jobs to run. Worked and extracted data from various database sources like Teradata, Oracle 10g/9i/8i/7.x, DB2, Sequential files, Flat files.
  • Hands on experience in fine tuning, tuning performance, identifying and fixing bottlenecks at various levels such as source, Confidential and mapping
  • Strong understanding of basic concepts of data warehousing such as dimensional modeling, star, snowflake and starflake schemas, datamarts, fact and dimension tables identification.
  • Excellent track record as a team player with effective communication skills.

TECHNICAL SKILLS

ETL Tools: DataStage 8.5, /7.5.3(Enterprise Edition) /7.5.1

Database: Teradata, DB2 UDB 9X, 8X, Oracle 10g/9i/8i

Database Tools: Teradata SQL assistant, SQL Developer & AQT

Reporting Tools: Microstrategy, WebfocusOffice Tools MS Office, MS Access, MS Visio and MS Project

Other Tools: MSTFS, TAD Control-M, Service now, Remedy, HPSD and Erwin

Operating Systems: Windows 98/2000/XP/Vista/7, UNIX.AIX

PROFESSIONAL EXPERIENCE

Confidential, Minneapolis, MN

Sr. DataStage Developer

Responsibilities:

  • Participated in meetings with Business users and Subject Matter Experts (SMEs) to understand the business requirements.
  • I have involved in the Development of Enterprise Data warehouse (EDW) in Teradata which is one of the biggest data warehouse for Confidential in Teradata platform.
  • I was involved in the development activities of Performance Mart layer - Performance layer includes Base tables in Dimensional form, at the lowest grain required for reporting. It also includes Aggregate tables and merged Mart tables that pre-join tables and/or pre-compute certain metrics.
  • As part of Development, created Micro Strategy, SAS and Web Focus objects on top of Performance Layer and/or Foundation Layer.
  • I have been involved in fine tuning table objects by selecting correct Primary Indexes, Secondary Indexes, Partitioned Primary Indexes, and Join Indexes in warehouse.
  • As part of Project set up in Teradata, have performed the below activities.
  • Control - M user ID set up.
  • Control-M flow and the dependency set up.
  • Teradata user ID set up.
  • Creation of DB objects per the Physical design before the Test Data loads.
  • Documentation for Migration / Incremental is updated before the Test Execution.
  • Requirements traceability for Test Cases.
  • Micro Strategy user ID and permission.
  • Involved in the bulk Data migration from DB2 to Teradata through various Teradata utilities like Fastload, FastExport, MultiLoad & TPump.
  • Involved in the Development of ELT Scripts/ DataStage Jobs sourcing the incremental data for EDW.
  • Have worked on Multiple Teradata utility tools like Teradata FastExport Utility, Teradata FastLoad Utility, Teradata Administrator and Teradata SQL Assistant etc…
  • As part of EDW project, we have built a new semantic which will function as a translation layer for any data or data model changes to the underlying data architecture and eliminates any MSTR re-architecture to support the new Teradata EDW.
  • Have worked in the semantic layer deliverable for PARS Phase 2 Finance Stock Ledger (STL) is a reporting layer that leverages improvements made to foundation data structures
  • Worked in establishing connections between Teradata environment and DataStage and have enabled the multiple optimizations in the ETL routines through performance tuning.
  • Providing support in the Finance Vision for Reporting, Analytics, and recommending business decisions and also in Financial Reporting like SCCR and Microstrategy Adhoc Reports.
  • Coordinating with business users and help them validating the end results.
  • Have been leading efforts in preparing project implementation plan, roll-out activities by coordinating with team about the prerequisites which are to be completed before the implementation, RFCs and WO creations, post implementation tasks, KM sessions etc.,
  • Briefly worked in Sales data model changes in ERWIN & involved in several key changes to support the history load.
  • Performed Enterprise Administration Management team needs by providing knowledge transfer of project details including support documentation & identification of potential Small Business Enhancements.
  • Have been a leading member for technical discussions with architects on Teradata, DB2 & ETL and by providing KT to project team including partitioning, tuning SQLs etc.
  • Derive project level tasks to be completed before the end of every milestone during the project implementation.
  • Developed & implemented complex migration strategy and scripts.
  • Used DataStage Designer for developing various jobs for Extracting, Cleansing, Transforming, Integrating and Loading data into Data Warehouse.
  • Designed Parallel jobs using various stages like (Join, Remove Duplicates, FTP stage, Filter, Dataset, Lookup, file set, Modify, Transformer and Funnel stages)
  • Used SCD (Slowing Changing Dimension) Type1 & Type 2 to handling the historical data.
  • Extracted data from text files, using FTP Stage and loaded into DB2 UDB databases.
  • Used the Data Stage Director and its run-time engine to schedule the jobs, testing and debugging its components and monitoring the resulting executable versions.
  • Analyzed data with discrepancies through Error files and Log files for further data processing and cleansing.
  • Created Test plans, Test cases and performed Unit Testing, Integration Testing & System Testing.
  • Involved in Analysis, Design & Development of all the different modules.
  • Involved in analyzing the daily defects of the production support and finding the root cause.
  • Involved in testing, debugging, bugs fixing and documentation of the system.
  • Involved in Knowledge Management related activities during KT transition of the project.
  • Design of ETL processes that extract information from data sources and populate Enterprise Data Warehouse for Finance Business Intelligence (FBI).
  • Technical design covers ETL data load processes for the project.
  • Used to monitor the data warehousing applications through Control-M tool.
  • Request for change (RFC) for bringing in the changes in the production environment with using ServiceNow which is a workflow tool used to manage IT Service Management (ITSM) processes such as Change, Configuration, Incident, and Problem Management. ServiceNow replaced HP Service Desk (HPSD), the previous IT Service Management solution for Incident, Event, Problem, Change and Configuration Management.

Environment: Data stage 8x, Data stage 7x, Teradata, DB2 9X, Shell script, SQL Developer, Oracle, DB2, Performance Tuning, Control M, Visio, Project planning & implementation, Maintenance

Confidential

DataStage Developer

Responsibilities:

  • Preparation of technical specification for the development of DataStage Extraction, Transformation and Loading (ETL) mappings to load data into various tables in Data Marts and defining ETL standards.
  • Used the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into Data Warehouse database.
  • Analysis, development and implementation of CAARUS for systems pertaining to the Data Warehousing system. HPSD is used as a Change management tool and is used for promoting the changes to production box.
  • Participated in meetings with business people for requirements gatherings and addressing the issues and changes in existing system.
  • Prepare the estimation and plan for development, testing, delivering and deploying the changes for the permanent fixes.
  • Preparing the environment in the development environment to simulate the problem and troubleshoot the same.
  • Raising a CR (Change Request) for bringing in the changes in the production environment. This also involves coordinating with other groups like DBA to make the changes successfully.
  • Receiving Client problems using Remedy and analyzing code and solving the issues to provide a persistent resolution to the recurring problems.
  • Created Job flow document for each process and Unit Testing.
  • Performed Troubleshooting and Tuning of DataStage Jobs for better query performance.
  • Exported and imported DataStage components using DataStage Manager.
  • Have to create the report for tracking the status of the change requests worked. Will be using HPSD tool for getting the same and would involve for about 1 hour per week.
  • Monitoring the Critical jobs & coordinating for Server Outages. Also monitoring the performance of the system under varying conditions using the PERFORMANCE MONITOR Tool.
  • Maintaining and Enhancing the Client Business Intelligence applications like CIS, CAARUS and FACTS.
  • Transitioning the applications to the new team members. This includes both Technical and application knowledge of the system.
  • Created Shared Containers to simplify the DataStage design, to use as a common job component throughout the project.
  • Designed jobs for data extraction from the mainframe DB2 tables using DB2 API stage and load landing tables.
  • Source Tables/Files Mapping
  • UNIX scripts which involves purging of tables after a stipulated time period, calling of merge scripts & other job specific requirements.
  • Scheduled batch jobs in control-M for entire project
  • Created re-usable components used in entire project
  • Generating & storing the error information and reprocessing
  • Design of pre & post processing which includes generating files for the system health tables, unzipping, archiving files, creation of ACR file etc.
  • Used stages like Data set, Join, Lookup, Aggregator, Change capture, Copy, Filter, Funnel, Remove duplicates, Pivot, Sort, Transformer, Oracle Enterprise, Peek stage, Row Generator, Surrogate Key Generator.
  • Used DataStage director to run, validate and check job status and log files.
  • Designed the job templates and created new jobs from existing templates
  • Guided the team members in their development, testing and implementation cycles
  • Production Maintenance for 3 months

Environment: Data stage 7.5.3, Oracle 10g, Shell script, Performance Tuning, Control M, Visio, Project planning & implementation, Maintenance

Confidential

DataStage Developer

Responsibilities:

  • Responsible for designing, developing, implementing all aspects of ETL
  • Phase Prepare the estimation and plan for development, testing, delivering and deploying the changes for the permanent fixes.
  • Performing code changes or procedure changes in the development environment as per the analysis done.
  • Preparing the environment in the development environment to simulate the problem and troubleshoot the same.
  • Testing the code changes with the help of the tool to check the standards of Programs and to check whether the code changes adhere to the Program standards or not.
  • Raising a CR (Change Request) for bringing in the changes in the production environment. This also involves coordinating with other groups like DBA to make the changes successfully.
  • Involved in all SDLC cycles, maintaining and enhancing the Reliance Business Intelligence applications like GSM.
  • Created Job flow document for each process and Unit Testing.
  • Performed Troubleshooting and Tuning of DataStage Jobs for better query performance.
  • Exported and imported DataStage components using DataStage Manager.
  • Transitioning the applications to the new team members. This includes both Technical and application knowledge of the system.
  • Mentored new joiners on the various technical aspects of the project and towards quality.
  • Coordinating with other utility teams.
  • Developed high performance ETL jobs to load large volumes of data
  • Designed and developed ETL jobs to load data to DB2 UDB relational tables
  • Developed various Complex Data stage Mappings implementing SCD type 2 for Transaction & Billing cycle modules.
  • Detected bottlenecks, trouble shooting and tuning of mappings, queries, sessions for better performance and efficiency. Handled error handling routine using automated error checking mechanisms to reduce failures & monitor error logs
  • Created ETL batch jobs and sequencers for data warehouse data loading automation process. Designed a strategy to integrate workflows with Control-M scheduler
  • Created UNIX Shell scripts to automate routine tasks
  • Deliver project documentations such as Source to Confidential mapping document, ETL design specs, ETL Test strategy, Production Operational documents
  • Maintenance of the project
  • Implementations planning
  • Support Transition & secondary support until system is stabilized

Environment: Data stage 7.5.1, Oracle 9x, Shell script, Performance Tuning, Control M, Visio, Project planning & implementation, Maintenance.

We'd love your feedback!