Senior Datastage Developer Resume
Houston, TexaS
SUMMARY
- Having 8+ years of experience in designing and implementing Data Warehousing Applications using IBM Infosphere DataStage with various versions like 8.1, 8.5,9.1, 11.3, 11.5 & 11.7.
- Hands on experience with IBM Infosphere DataStage Admin Tool to create the users and project.
- Experienced developing ETL solutions supporting star schema and snowflake designs using Kimball Design Methodology.
- Involved in RFP estimations in pre - sales for the projects with I&D Practices.
- Implemented DEVOPS tools such as GitHub, Jenkins & Maven for code migration.
- Implemented AWS successfully and data can be moved easily into Snowflake using an ETL solution like Stitch.
- Well experienced in CI/ CD pipeline utilizing DEVOPS
- Experience managing large teams as big as 5+.
- Internal DataStage training was conducted for couple of fresh resources.
- Involved in technical screening multiple in the organization and played pivotal in decision making for hiring the right candidates.
- Key strengths include Excellent communication skills, Proactive learning, Teamwork and Team Management, People Management, Client relation Management, interpersonal and collaborative sills.
- Has a Strong understanding of OLAP business intelligence applications.
- Experienced working in AIX environment.
- Experience working in Oracle Exadata SQL.
- Experience working in TeraData and B-tech scripts.
- Having good experience in Scheduling Tools (i.e.; Autosys).
- Designed and Implemented DataStage Migration projects.
- Experienced in developing Server and Parallel jobs.
- Well versed with Data Warehouse Architecture and Concepts.
- Handled numerous Data Warehouse, Integration, and Data Migration of the projects.
- Efficient in all phases of the development lifecycle, coherent with Data Cleansing, Data Conversion, Performance Tuning, and System Testing.
- Excellent knowledge of operating systems Windows, UNIX, Macintosh, and databases including Oracle, SQL Server, and DB2, PL/SQL, Procedures, Packages, SQL Server,
- Designed Mapping documents ETL architecture documents and specifications
- Participated in discussions with Project Manager, Business Analysts and Team Members on any technical and/or Business Requirement issues.
- Migrated jobs from development to QA to Production environments.
- Experience in Client handling and independent communication with users to resolve issues.
- Experienced in Performance tuning, Bug fixing, and Root cause analysis.
- Proficient in using ETL tools such as IBM WebSphere Data Stage and parallel job development.
- Proficient in using ETL tools such as IBM Migration tool to upgrade the Data Stage project and parallel job development.
- In-depth experience in dealing with different stages like CDC, Sequential File, Join, Sort, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Change Data Capture, and Aggregator, etc. Ability to work independently to recommend/develop solutions for ETL projects and also mentor the team.
- Well versed in handling Control-M jobs batch monitoring, scheduling process and testing.
- Experienced with database design/modeling tools (preferably ERWIN), modeling techniques (multidimensional, logical and physical models).
- Well Versed in estimating the requirements in POC and pilot phases and Prototypes creation.
TECHNICAL SKILLS
ETL Tools: DataStage 7.5.1,8.1, 8.5, 9.1, 11.3, 11.5 & 11.7 Designer, DataStage Director
ETL Admin Tool: DataStage Admin
ETL Migration Tool: DataStage Migration
Databases: Oracle, DB2, Netezza, My SQL server, Oracle Extra data SQL, PL/SQL, Teradata, DBT, Snowflake PostgreSQL, Teradata, Cosmos
Programming: Python, C, C++, C#, Shell script, Perl script, SQL
Cloud Technologies: Azure
ETL solutions: star schema and snowflake designs using Kimball Design Methodology
Tools: PyCharm, Eclipse, Visual Studio, SQL*Plus, SQL Developer, TOAD, SQL Navigator, Query Analyzer, SQL Server Management Studio, SQL AssistancePostman, Net Beams, SQL queries, Razer SQL, Tord, CA service, T-PAM
DevOps tools: GitHub, Jenkins & Maven
Operating Systems: Windows 7/8/XP/2008/2012, Ubuntu Linux, MacOS, Unix, AIX, Solaris
Database Modelling: Dimension Modelling, ER Modelling, Star Schema Modelling, Snowflake Modelling, ERWIN
Scheduling Tool: Control-M, Uniq, IWS, TWS, Autosys, DataStage Director
Visualization/ Reporting: Tableau, CDM, MS Office, Micro strategy
Code Migrations Tool: SVN, Manual Import & Export, CICD pipeline
Methodologies: Agile, Waterfall, Sprint wise release
PROFESSIONAL EXPERIENCE
Confidential, Houston, Texas
Senior DataStage Developer
Responsibilities:
- Analyzing the data for multiple reports for automation to filter and validate the data before migrating to Snowflake from ERIP database.
- Worked on retrieving data from different source systems like Netezza DB, SQL Server, DB2 database and also external sources like Salesforce tool to target database ERIP(DB2) database using IBM Data Stage parallel jobs.
- Working on historical data load from DB2 ERIP Aggregated data to Snowflake using IBM Data Stage tool.
- Working on incremental data load from Snowflake sharable object/secured view to BOD Snowflake tables using DBT ELT tool.
- Working on designing and developing parallel jobs using Data Stage Designer, Data Stage Director, and Data Stage Administrator.
- Working on creating parallel jobs to extract data from Netezza DB, DB2 database and flat files to load into target database (ERIP).
- Writing complex SQL queries for the respective report sections by gathering the business information from POC.
- Worked on monitoring the DataStage job on daily basis by running the shell script to make a force start if the job fails
- Creating tables, views, user defined functions in Snowflake Cloud Data Warehouse.
- Worked on creating data stage parallel jobs using different stages like Sort, Filter, Aggregator, Funnel, Join, Sequential File, Lookup and Transformer.
- Using Putty extensively to check job logs.
- Also worked on creating source table definitions in the DataStage repository.
- Also, working on define virtual warehouse sizing for Snowflake for different type of workloads.
- Build the Logical and Physical data model for snowflake as per the changes required.
- Participated in debugging the components and monitoring the results using DataStage director.
- Worked on analyzing queries and ensure creation of meaningful and repeatable SQL queries within Snowflake.
- Preparing the technical design document for analyzed report data during development phase to extract and load from source database to Cloud Snowflake data warehouse.
- Working on ETL pipelines in and out of data warehouse using combination of Python and Snowflakes Snow SQL writing SQL queries against Snowflake.
- Working on writing multiple and very complex SQL queries to transform data into the warehouse using DBT tool.
Confidential, New York
Sr. ETL Developer
Responsibilities:
- These are pure scratch development projects
- QRM-AMM (process non-gbm data related to loans)
- DWF(Process Global hub data to various departments)
- ISST US project involved as enhancements of Development and support.
- ISST Salesforce project is pure development and involved in the control-M side as well.
- The WEBDCGC Project is the pure migration project and finds the issues, bugs and fixes.
- The WEBDCGC project I has used the DataStage Migration tool for code migration and which is newly learned and successfully implemented.
- Well Versed in Estimating the requirements in POC and pilot phases and Prototypes creation.
- PNB project involved as Developer, mapper/Scrum master & Lead worked independently scratch development and closed POC and Sprint1 as single person.
- PNB project involved in Sprint1 development on words and 15 sprints successfully as an SME.
- ISST HK project involved Sprint1-3 development and delivered code successfully and worked independently.
- Worked extensively on different types of stages like Sequential file, Dataset, Lookup, Join, Merge, Funnel, Copy, Transformer, Filter, Peek, Pivot, Column Generator, Row Generator, CDC etc.
- Implemented best performance strategies.
- Created job list and using the job list we called DataStage jobs using CJC shell script.
- Handed French character to display as is in table & Files and converted French characters into a normal space character.
- Upgradation project issues fixed very and find the flow of the order of execution of jobs.
- Performed Aggregation Operations and Group Operations.
- Analyzing needs and Identifying risks.
- Performed transformations like cleansing, scrubbing of the data, and loaded into Oracle Server database.
- Experienced in creating schema files and used those fines in Column Import and Sequential File Stages.
- Experienced in writing SHELL scripts and calling them in Job Designing.
- Worked with multiple Look-ups.
- Worked with sorting stage, Modify stage, Switch stage, etc.
- In the DWF project, I has handled Cobal files using the Complex flat-file stage.
- Implemented AWS successfully and data can be moved easily into Snowflake using an ETL solution like Stitch.
Environment: DataStage 8.5,11.3,11.5,11.7 Db2, Oracle, Teradata, Cobal Files, Service Now, Jira, Unix, LinuxSolaris, Director, DataStage Webspear, DataStage Administrator, DataStage Manager, Unix Shell Scripting, Python, Control-M, Uniq, Autosys, CICD, SVN, Manual Import & Export, Manual Import & Export, star schema and snowflake designs using Kimball Design Methodology, AWS, Snowflake Data Cloud, Water fall, Agail, Sprint
Confidential, Sunnyvale, CA
Sr. ETL Developer
Responsibilities:
- Involved in pure scratch development.
- Involved in Extracting the data from different sources like Oracle and CSV files tan loaded into oracle Target DB.
- Involved in Designing to different stages using complex mappings.
- Involved in critical high- and low-level mapping and designing jobs.
- Involved in Unix shell script.
- Involved in find the control M ( M) characters and solve the issues with them.
- Involved in dis health care project crucial session like Payments department.
- Capturing and processing bulk data and loading into Delta data.
- Involved in different documentation preparation part.
- Track various ETL application run status and assist in activities to meet the daily SLA for business users.
Environment: DataStage 8.5,11.5 Db2, Oracle, Neteza, XML Files, Service Now, Jira, Unix, Director, Unix Shell Scripting, Python, Control-M, Uniq,, SVN, Manual Import & Export,HPQLM
Confidential, New York
Business Analysis
Responsibilities:
- Involved in Extracting the data from different sources like DB2, Oracle and CSV files tan loaded into Netezza.
- Involved in Designing to different stages using complex mappings.
- Involved in Analysis the data in source Databases and Data Cleansing in key process.
- Used SCD stage and implement the SCD1 & SCD2 concept.
- Involved in analyze the HLD(High Level Designing) and Identify the Source and Target mapping Dimensions and Facts.
- Involved in different documentation preparation part.
- Track various ETL application run status and assist in activities to meet the daily SLA for business users.
- Send Daily Reports and weekly reports to Management and End Users.
Environment: DataStage 11.5, Db2, Oracle, Service Now, Jira, Director, Unix Shell Scripting, Control-M, SVN, Manual Import & Export.
Confidential, Houston, Texas
ETL Sr. Developer
Responsibilities:
- Collection of data from various sources.
- Transforming and enriching the data collected.
- Loading the source data from Landing to the Reservoir Tables.
- Identify, analyze and fix the issues in the production system.
- Interface with various clients to understand the business issues related to the same and convert it to technical solutions.
- Generate Reports for various applications based on their run statistics. Reports are generated weekly/monthly or quarterly.
- Track various ETL application run status and assist in activities to meet the daily SLA for business users.
- Interface with business users to understand reporting requirements and assist in creating new analytical reports.
- Provided on call support for the client. Activity includes fixing and attesting issues post normal working hours. Accept incidents and work towards fixing the issues in the mission critical applications.
- Effectively used debugging stages like row generator to create mock data.
- Support like activities like Handling Incidents and Problem Ticket based on SLAs. Change Requests and Deployments to production.
- Send Daily Reports and weekly reports to Management and End Users.
- Identify and promote best practices for all activities related to support.
- Involved in Parallel testing & Test Major as well as Test minor also.
Environment: DataStage 8.5,11.5, Db2, Oracle, Netezza, Jira, Unix Shell Scripting, Control-M, SVN, Tord Company: IQ MEN DATAProject: Health Care
Confidential
ETL Developer
Responsibilities:
- Involved in Designing to different stages using complex mappings.
- Applied Sorting techniques while handling the sequential file data.
- Involved in Data Cleansing in key process.
- Used change capture to identifying the Delta data.
- Created Business keys and worked with Dimensional tables while loading the tables.
- Developed Data stage routines and execution.
Environment: DataStage 9.1, SQL Server, Oracle, Unix Shell Scripting, Control-M, SVN
Confidential
ETL Developer
Responsibilities:
- Involved in Developing ETL jobs using Data stage Parallel Extender, supporting all phases of the ETL process such as implementing Source to target mapping.
- Extensively used Data Stage Client Tools - Data Stage Designer, Director and Manager.
- Worked extensively on different types of stages like Sequential file, Dataset, Lookup, Join, Merge, Funnel, Copy, Transformer, Filter, Peek, Pivot, Column Generator, Row Generator etc.
- Used Data stage director to run and monitor the jobs.
- Implemented best performance strategies.
Environment: DataStage 9.1, SQL Server, Txt Files, XML, Oracle, Unix Shell Scripting, Control-M, SVN
Confidential
Data ware house Designer
Responsibilities:
- Involved in applying complex Transformation logic.
- Applied “Transformer” stage effectively in DS job designing.
- Used Change capture to identifying the delta data.
- Performed Aggregation Operations and Group Operations.
- Analyzing needs and Identifying risks.
Environment: DataStage 7.5.1,8.5, SQL Server, Oracle, Unix Shell Scripting, Control-M, SVN, Erwin