Sr. Datastage Developer Resume
Cincinnati-ohiO
SUMMARY
- 10 years of experience in Data Warehousing (ETL), Data Migration and Business Intelligence (reporting) at both offshore and onshore locations with prominent experience in Banking, Financial and Insurance domains. Has been involved in whole SDLC life cycle for various development and maintenance /enhancement projects and has worked on ETL job development, code migration/deployment, scheduling and production support.
- Certified in Information Technology Infrastructure Library for foundation level and Agile Scrum Master.
- Proven Experience in Data Mapping. Built Source to Confidential Mapping (STM) documents for various projects which involve multiple data sources from different databases including DB2, Oracle, SQL Server, Mainframe DB2, XML and web services.
- Worked extensively on IBM Data stage, Tableau, Microstrategy and scheduling tools
- Strong Experience in designing complex and re - usable jobs to implement slowly changing dimensions using Shared Container and Change data capture.
- Experience in Web Service Implementation through ETL Process
- Experience in integration with Hadoop File System, Hive Connectors
- Extensive experience in loading high volume data, and performance tuning.
- Involved in creating dashboards, data quality and reconciliation reports using Tableau reporting tool.
- Extensive experience in DataStage jobs/code reviews, troubleshooting and optimizing DataStage jobs.
- Implemented scrum/agile development methodologies/practices according to the application requirements. Understanding of business process and data models.
- Proficient in various EDW Environments like Telecommunication, Healthcare Domain, Finance and Retail Sector.
- Hands on experience with project migration from DataStage lower versions to higher versions.
- Participated actively in Server jobs upgrade by using Connector migration tool.
- Experienced in HP Quality Center to manage and track the test defects.
TECHNICAL SKILLS
BI/ETL Tools: IBM InfoSphere DataStage and Quality Stage 8.x 9.x 11.x (Designer, Director, AdminClient), IBM Info Sphere Information Analyzer, Microstrategy, Tableau.
Databases: Microsoft SQL Server 2005/2008, Oracle 8i, Db2.
Scheduling Tools: Active batch, Crontab, Control-M & Tivoli Workload Scheduler.
Tools: BMC Remedy, CA Rally, Agile Accelerator UNIX.
Version Control Tool: Clear Case, Serena.
ERP: JD Edwards
PROFESSIONAL EXPERIENCE
Confidential, Cincinnati-Ohio
Sr. Datastage Developer
Responsibilities:
- Acting as a Release manager and working closely with the offshore team as an onsite coordinator.
- Collaborated with Business users and Subject Matter Experts (SMEs) to understand the business requirements.
- Migrated sub projects successfully in the Investment Advisor from 8.1 to 9.1 Ver & 9.1 to 11.5 Ver.
- Executed proof of concepts to understand the impacts to older server jobs in 9.1 Ver.
- Involved in analyzing the quality of the jobs developed by the team members and providing the suggestions to improve the performance and did the performance tuning.
- Used Web services stage in one of the E-Money sub Project, Developed Web service jobs for hitting the WSDL operations to get the services through Request and response process.
- Imported WSDL file definitions using import Web Service File Definitions utility in DataStage Designer.
- Cleansing the extracts using the quality stages in DataStage.
- Parsing Json and Xml files using Hierarchical stage.
- Used to receive Structured and Un-Structured Source (.XML, .DAT, .TXT, .XLS) files from Upstream and parse to Downstream using FTP stages.
- Used Change Data Capture stages for maintaining History data.
- Utilized SQL *Loader to load bulk data into Confidential Oracle data warehouse.
- Used Aggregator, Sort, and Merge and Dataset stages in parallel extenders to achieve better job performance.
- Ability to work effectively and efficiently in a team and individually with professional conduct and excellent interpersonal and technical communication skill set. Handling CRQ requests and managing calls on weekly basis.
- Exception handling in the ETL process based on the business rules
- In Production activities we will have manual process, extensively worked in automating the CIP process from manual to auto.
- Involved in Daily Standup meeting & Onsite Coordination Meetings & Business Analyst Functional Specification meetings on day to day basis.
- Worked on process documents for internal and external audit.
- Used Data Rule stage to Audit and Validate the data from Source and ETL data for comprehensive and complete result
- Prepared Run Book document which is used for Production support team, how to handle the job if it aborts and extensively worked on monthly GL Reports & MDM files.
Environment: IBM Infosphere Datastage11.5, DB2, UNIX, Sitescope alerts, Tivoli Scheduler
Confidential
Sr. Datastage Developer
Responsibilities:
- Understand the requirements and document their expectations, handling the current process, modifying and created the jobs to the updated requirements, handle the load process to data marts.
- Involved in discussion with Business team for scrutinizing the requirements for extracting the data from the source systems.
- Datastage migrating jobs from 9.1 to 11.5 version.
- Worked closely with the ETL / DB Admin team to ensure that all Database / ETL objects and components are correctly migrated for the production deployment.
- Implemented quality checks by using quality stages.
- Performed release management planning to ensure release are scheduling inline of existing process and the business deadlines.
- Once data loaded into Confidential database as per client requirement and then using SAP BO generate visualized reports for client need.
- Worked performance tuning at various levels of Confidential, Source for large datasets.
- Guiding peers and reviewing their code.
- Providing end to end support for UAT (User Acceptance Test) and production deployment.
- Tuned Data stage jobs for better performance by creating DataStage Hash files for staging the data and lookups.
- Performance tuning of SQL queries consisting of many tables with large amount ofdata.
Environment: Datastage 9.1, Oracle, PostgreSQL, UNIX.
Confidential
DataStage Developer
Responsibilities:
- Developing DataStage parallel jobs, sequence jobs, routines as per the requirement.
- Interaction with client in order to understand the business requirements and develop the jobs accordingly.
- Gathering Business requirements and done the modification in the jobs accordingly.
- Standardized job parameters, job flows and audit process to meet the Design Standards.
- Involved in Post Go-Live Support activities.
- Prepared Design Documents for project Go-Live and shared Knowledge Transfer to Production support team.
- Performed Root Cause Analysis, ETL code fix /data fix for Data issues raised by the Business analyst
- Participated in reviews of data modeling and business requirement analysis and assisted with defining requirements
- Successfully implemented pipeline and partitioning parallelism techniques and ensured load balancing of data.
- Used the ETL Data Stage Director to schedule running the solution, testing and debugging its components & monitor the resulting executable versions.
- Involved in Importing Metadata from Oracle, DB2 Databases. Used CDC Stage and CA to load Type 2 Dimensional Tables. Used Data Stage Designer to develop DataStage jobs, scheduled the jobs through DataStage director. Tuning of Data Stage Jobs for better query performance.
Environment: DataStage 9.1, MicroStrategy 9.1.3, Netezza, UNIX.
Confidential
Etl Consultant
Responsibilities:
- Worked on the Design, Build, Unit Test, Implementation of the NPS
- Worked on the Change Request which was raised by clients.
- Creating IBM DataStage Parallel Jobs to extract, transformation and loading of the data using DataStage design toll in the parallel processing mode.
- Extensively used Parallel Extender to load data into data warehouse with different techniques like Pipeline and Partition in SMP environment.
- Responsible for UNIT, System and Integration testing. Developed Test scripts, Test plan and Test Data. Participated in UAT (User Acceptance Testing).
- Involved in data stage mapping, data profiling and batch processing
- Data profiling based on the business requirements.
- Gathering Business requirements and working on mapping specs.
- Enhancing the existing jobs and testing in the Quality Assurance environment.
- Implemented multi-node declaration using configuration file (APT Config File) for performance enhancement.
- Involved in data stage mapping, data profiling and batch processing.
- Worked with the ETL Architect and technical teams on systems performance and other maintenance issues.
Environment: Data stage 8.1, Teradata, UNIX, Oracle database
Confidential
DataStage Developer
Responsibilities:
- Developed DataStage Job according to the approved functional Specification as per the client requirement.
- Used Technical Transformation document to design and build the extraction, transformation loading modules and followed the various naming specifications.
- Used Data Rule stage to Audit and Validate the data from Source and ETL data for comprehensive and complete result
- Developed parallel jobs using stages like Dataset, Sequential file, Aggregator, Merge, Transformer, Lookup, joins, Pivot Enterprise, peak stages and Database’s like Oracle.
- Testing the Jobs to assure that data is loaded according to the functional specification as per the client requirement.
- Involved in Unit Testing and preparing the Unit test cases.
- Running, monitoring of the jobs using Data Stage Director and checking logs
- Tuning jobs for better performances.
- Understand the testing effort by analyzing the requirements of project.
- Document, implement, monitor, and enforce all processes for testing as per standards defined by the organization.
- Implement / Review the Unit Test Cases documents.
- Worked on the Code Release documents/Code Backup process on daily bases.
- Code check-in/Checkout process by running Ctrl-M Scripts.
- Organize the status meetings and send the Status Report (Daily, Weekly etc.) to the Client.
- Scheduled batch jobs in AutoSys. Coordinated with System Operators to Schedule the batch jobs in AutoSys. Provided Level 3-production support
- Used Version Control for data stage to track the changes made to the data stage project components and for protecting jobs by making read only.
- Designed Documents for performing unit testing and string testing of developed code.
Environment: Data stage 8.5, SqlServer-2008, Autosys
Confidential
Data migration Analyst
Responsibilities:
- Worked on the Job Design, Build, Unit Test, and Implementation of the Confidential Migration.
- Worked on the Data stage job schedulers
- Created Test Data and Developed Test Scripts for the project.
- Tested the UNIX Confidential files whether the data is populated correctly as per client requirements.
- Worked on the Change Request which was raised by clients.
- Created jobs to extract the source from different sources.
- Created Jobs using various stages in data stage Designer.
- Analysis of Existing Source and Confidential System
- Analyzed the performance of the jobs and enhanced their performance.
- Designed the job using the stages like Aggregator, Transformer, Look-up, Filter, Remove Duplicate, Copy, Dataset, and Sequential file set.
- Extracteddatafrom sources like Oracle, Flat Files and HDFS files.
- Involved in low level design and developed various jobs and performeddataloads and transformations using different stages of DataStage and pre-built routines and functions.
- Developed DataStage jobs using star schema and followed development standard into different projects.
- Verification of functional specifications and review of deliverables.
Environment: DataStage 8.1, SqlServer-2008, Oracle 9i, PL/SQL, Erwin Tool 3.5.2, Shell Scripting, UNIX
Confidential
Report Analyst
Responsibilities:
- Communicate with Onsite team to get the functionality updates and daily status reports.
- Experience in working with MicroStrategy Security model including Users, Groups, Security Roles and Security filters.
- Perform quality assurance by unit testing for all reports.
- Involved in report tuning, caching, specifying query governing thresholds, and report Optimization.
- Provide production support for Microstrategy report users.
- Perform detailed data analysis, validation, and identify data quality issues to ensure consistency across all environments.
- Create highly interactive Microstrategy dashboards by using Visual Insights that replaced legacy reports.
- Created schema, metrics, reports, and documents supporting client business goals.
- Improved performance with Intelligence Cubes.
- Delivered visualizations and Widgets including Bubble Grids, ESRI Maps, Heat maps, Time Series, Waterfall graphs, Microcharts, and Scatterplots.
- Developed SQL queries to meet reporting requirements.
Environment: Microstrategy Web 8.1.1, DB2 Database, Hp Quality center
Confidential
DataStage Developer
Responsibilities:
- Worked as a developer from onsite to Co-coordinate with offshore team to implement the rollout process in Production environment.
- In upgrading technology Implemented Pilot project in individual restaurant.
- Handled the issues and getting them resolved with in the time based on the seniority so that the client business was not affected.
- Developing parallel jobs Using stages like Dataset, Sequential file, Aggregator, Merge, Transformer, Lookup, Joins and etc.,
- Running, monitoring of the jobs using Data Stage Director and checking logs in Active Batch Scheduler.
- Involved in testing the developed codes, fixing defects if any and redoing the test and fix upon delivery to the client manager.
Environment: DataStage 8.0, Microstrategy, Sql Server, Oracle, Win JDE Systems
Confidential
Junior Developer
Responsibilities:
- Involved in preparing technical specifications for WIN JDE.
- Utilize Edwards to create, test, and deploy a variety of reports, interactive applications, and batch applications.
- Set up user roles, Allowed Actions and Transfer Activity Rules within Object Management Workbench
- Perform package builds and deploys for full and update packages.
- Actively involved in microstrategy Report scheduling for monthly Metrix reports.
Environment: JD Edwards, Oracle