Ibm Infosphere Datastage Developer & Prodsupport Resume
Charlotte North, CarolinA
SUMMARY
- Over 11 years of experience Especially in building the data warehouses and System Analysis, Design, Development, Testing and Production Implementation.
- Strong Experience with data Warehousing, Data Integration & Migration and developing business applications using IBM Infosphere Information Server ( 11.5/8.5/8.1/8.0.1 ), Ascential IBM InfoSphere DataStage (7.5.2/6.0/5. x/4.x) Manager, Designer, Director and Administrator), Informatica Power Center 8.1, SSIS, SSAS extensive experience with both IBM InfoSphere DataStage Parallel Extender (EE) and Server Editions, Oracle, PL/SQL, SQL Server, DB2, SQL and Shell scripts.
- Extensive experience resolving technical issues using the IBM InfoSphere DataStage tool.
- Specializes in Data Analysis, Data Mapping, Data Conversion, Data Integration, Business Analysis, Data Quality Analysis, Functional Design, Technical Design and different aspects of data/information management.
- Works directly with clients and management to resolve conflicts and issues that may arise. Has worked extensively with SQL, including performing Query Optimizations.
- Handles Complex Systems, Project Integration, and Technical Designs. Possesses design, plan, and team coordination expertise.
- Accomplished data movement process that load data from DB2 into Teradata by using Teradata SQL and utilities such as BTEQ, FASTLOAD, FASTEXPORT, and MULTILOAD.
- Document processes necessary to maintain and expand the ETL processes to support future needs.
- Design and Build common re - usable ETL components to define audit processes and capture DQ exceptions, Job monitoring, and ETL logging processes.
- Create ETL processes to ensure data integrity (error handling) and document appropriate procedures.
- Expertise in Implementation of SQL Queries, PL/SQL Packages, Stored Procedures, Functions, and Triggers using Oracle PLSQL.
- Write System test cases and perform system and integration testing.
- Experience in writing UNIX scripts, Basic routines, and Control-M scheduling.
- Extensive experience interacting with Cross-Functional, global teams and communicating project information to multiple levels in an organization.
- Expertise in handling Data sources likes Oracle, UDBDB2, SQL SERVER, and Teradata.
- Good analysis skills, able to work independently or in a team environment and a self-motivated learner.
- Experienced in Quality stage tool as part of Data Analysis and Data Standardization.
- Experience in implementing the complex business rules by creating re-usable jobs, shell scripts transformations and PL/SQL stored procedures
- Experience in monitoring and administrating IBM InfoSphere DataStage server performance and usage.
- Created Schemas (Star and Snow Flake) to fit reporting, query and business requirements
- Involved in Administration and Support of ETL Platform.
- Knowledge of full life cycle development in Data Warehousing.
- Experience in IBM InfoSphere DataStage jobs specification documentation preparation.
- Expertise in using tools like Toad, Putty, Control-M and AutoSys.
- Excellent team member with problem-solving and trouble-shooting capabilities, Quick Lerner, highly motivated, result oriented and an enthusiastic team player.
- Good interpersonal skills, experience in handling communication and interactions between different teams.
TECHNICAL SKILLS
ETL Tools: IBM InfoSphere DataStage V 11.5/8.5/8.1/8.0.1 , IBM InfoSphere DataStage 7.5.1, QualityStage, SSIS, SSAS, SSRS, and Informatica 8.1, 8.5
Languages: PL/SQL, SQL, UNIX Shell Script
Databases: Oracle 9i/10g (10.2.0.4)/11g/12c, MS Access 2003, SqlServer 2005,2008 & 2012, Teradata V2R6/V2R5
Other Tools /Web Scheduling Tool: Toad 7.x, Control-M, AutoSys r4.5/r11.0/r11.3.6, Erwin 4.0/4.5, Remedy, PUTTY 0.62, WinSCP 4.2.5
Environment: AIX Unix 5.3, Sun Solaris 2.6 Windows 98, ME, 03, XP, 7.
Methodologies: Dimension Modeling, ER Modeling
Reporting tools: Crystal Report, Obiee 10g/11g/12c, Tableau 9x & 10x
PROFESSIONAL EXPERIENCE
Confidential, Charlotte, North Carolina
IBM InfoSphere DataStage Developer & ProdSupport
Responsibilities:
- Developed complete IBM InfoSphere DataStage project for mutual funds product from start using IBM InfoSphere DataStage 8.5 and copybook from the vendor and Informatica jobs.
- Converted all jobs from Informatica 8.1 to IBM InfoSphere DataStage 8.5.
- Loaded xml file from the third party vendor using datastage ‘XML INPUT Stage’ to Sqlserver db.
- Full tested jobs in both Informatica and IBM InfoSphere DataStage and validate the Results with QA to proceed with migration to SDLC env.
- Used IBM InfoSphere DataStage Designer, Director, and Administration for creating & implementing jobs.
- Develop etl jobs, T-Sql scripts and Jil files as per the business requirement. Usually we have meeting with business.
- Create Migration request for IBM InfoSphere DataStage, SQL, and AutoSys (Jil and Docit’s) from development to test Env.
- Extensively used Sequential File, Transformer, Join, Lookup, Filter, Funnel, Row Generator, ODBC Connector and Oracle Connector.
- Created User defined variable as per the requirement of our project using IBM InfoSphere DataStage administrator in dev and migrated the same to test with the help of a IBM InfoSphere DataStage admin.
- Scheduling the IBM InfoSphere DataStage job using AutoSys.
- Used Standardization, Match Frequency Stage in QualityStage.
- Performed through data profiling by using the Investigate stage of QualityStage.
- Developed UNIX shell script to run the IBM InfoSphere DataStage job, transfer files to the different landing zone.
- Created the TDD (Technical Design Document) for numerous projects for Mutual funds product.
- Helped out Team with FRD (Functional Requirement Document), SDD (Solution Definition Document) for a project which is in a starting Phase.
- Perform unit, integration for our project as needed and required.
- Used version control tools like StarTeam, Serena to migrate code to all SDLC Env.
- Validate the code migration to all SDLC Env.
- Modify already existing T-SQL as required after discussion with business team and migrated to SDLC environment.
- Write PLSQL, T-Sql queries to generate reports for other teams for their development efforts in the given span of time.
- Migrated XML data files to SqlServer db for Data Lineage Statistics.
- Analyze the request from business & other teams and do research and generate the PLSQL and T-Sql queries and provide the data as needed.
- Experienced in creating Data Lineage report, Impact analysis report and Business Lineage report through IBM Metadata Workbench.
- Migrated autosys jobs in SDLC env and move to production without any issues.
- Was part of IBM InfoSphere DataStage conversion project from DS 8.5 to 11.5, fully involved in testing and all code migration in SDLC Environment
- Help Web team & Business with incidents by running batch after the set of details created by the vendor to help resolve the incidents and problems.
- Create Change Request to Move data fixes from prodfix to prod after getting business approval.
- Develop and migrate Obiee and Tableau reports as per the requirement of business.
- Did Support the ODS (Operation Data Store) project as Prod Support to resolve incidents and Problems
- Monitoring Hadoop Application Daily Batch Jobs
- Involved in Hadoop capacity planning for new applications.
- Hadoop cluster support and maintenance
- Involved in HBase Data Modeling
- Involved in most of the RCA in Hive/Impala/PIG
- Was involved in upgrading cloudera from 5.1 to 5.5 and 5.5 to 5.10.1
- Certified Splunk user.
- Experience in Splunk development (creating apps, dashboards, alerts, charts, data models etc.)
- Designing and maintaining production-quality Splunk dashboards for our Application.
- Worked on Hadoop Jobs Performance tuning
- Was available on 24*7 Prod Support cycle for any MF/ODS batch job failure to debug and resolve in Production.
Environment: IBM WebSphere Information Server (Datastage, QualityStage) V8.5, 11.5,Informatica Power Center 8.1, MS SQL Server 2008, 2012(SSMS), Oracle 11g & 12c, Teradata V15, AutoSys r4.5/r11.0/r11.3.6, WinSCP 4.2.5, Putty 0.62, StarTeam, Serena, UNIX, Linux, Windows XP/7, OBIEE 10g/11g/12c and Tableau 9x & 10x, Splunk 6X.
Confidential, Charlotte, North Carolina
Data stage Developer
Responsibilities:
- Extensively used Ascential IBM InfoSphere DataStage Manager, Designer, and Director for creating and implementing jobs.
- Migrated jobs from DB2 to Teradata and Oracle to Teradata.
- Worked with Onshore/Offshore Development Teams to resolve IBM InfoSphere DataStage performance tuning and Job abort issues.
- Developed various jobs using stagesSequential files, Sort, Link Collector, DB2 UDB API, Oracle OCI and Teradata API
- Involved in Extracting, transforming, loading and testing data from DB2, Oracle OCI and Teradata API using IBM InfoSphere DataStage jobs
- Creating and setting up Data Stage Projects in Dev, Test and Prod Environments.
- Migration of jobs from Development to Test Environment using IBM InfoSphere DataStage Manager.
- Created, optimized, and Executed Teradata SQL test queries to validate in target mappings/source views, and to verify data in target tables.
- Analyzed existingSQL and IBM InfoSphere DataStage jobs for better performance
- Importing Table definitions and Metadata using IBM InfoSphere DataStage Manager.
- Created user defined environmental variables using IBM InfoSphere DataStage Administrator and Involved in Administration and support of ETL Platform in Dev env.
- Scheduling IBM InfoSphere DataStage jobs in IBM InfoSphere DataStage Director and Crontab.
- Monitoring IBM InfoSphere DataStage Jobs and clearing the salves of the job which are created while developing jobs and unlocking jobs from IBM InfoSphere DataStage Administrator and Linux
- Developed Shell scripts for running IBM InfoSphere DataStage Jobs and transferring files to other internal teams and External vendors.
- Performed Unit testing for jobs developed to ensure that it meets the requirements.
Environment: IBM Websphere Information Server V7.5.2,DB2, Oracle11g, Aqua data studio, Teradata V2R6, Cron, UNIX, Linux, Windows XP.
Confidential, Los Angeles, CA
Data Stage Developer
Responsibilities:
- Used Web Sphere IBM InfoSphere DataStage to Design, Execute, Manage and Deploy IBM InfoSphere DataStage jobs
- Used Designer client for basic, advanced search and impact analysis and to import and export components for migrating jobs between different environments.
- Worked extensively with different stages in IBM InfoSphere DataStage like Join, Funnel, Transformer, Surrogate Key Generator, SCD, Range and Case Lookup.
- Used Information Analyzer Profile Stage to configure different data sources and create projects and attach imported metadata to projects in IBM IS Console.
- Performed Column Analysis for business analyst's review before designing jobs in the console.
- Created Data Connections and Parameter Sets or Environment Variablesto use them for the project across dev, test and production servers.
- Used Director Client to Validate, Run and Schedule the jobs that are run by WebSphere IBM InfoSphere DataStage server.
- Used Administrator Client for general and project-related tasks and NLS mappings.
- Used Standardization rules, Match Specifications, WAVES in QualityStage.
- Used IBM IS Web Console for administration areas: Security, Licensing, Logging, and Scheduling.
- Created, optimized, reviewed, and Executed Teradata SQL test queries to validate transformation rules used in target mappings/source views, and to verify data in target tables.
- Analyzed requirements and developed cluster and grid architecture for enterprise application integration.
- Involved in Migration of jobs from IBM InfoSphere DataStage 7.5x2 to IBM InfoSphere DataStage 8.1 version.
- Created/Enhanced Teradata Stored Procedures to generate automated testing SQLs.
- Used IBM FastTrack to create source-to-target mappings and automatically generate jobs.
- Used Autosys to schedule jobs and e-mailed the status of jobs to operations team daily.
Environment: IBM Websphere Information Server V8.1/8.0.1,Oracle11g, Teradata V2R6, Erwin 4.0, Windows 2003.
Confidential, Seattle, WA
ETL Developer
Responsibilities:
- Strong knowledge of Data Warehousing concepts, Teradata utilities (BTEQ, FASTLOAD, FASTEXPORT, MULTILOAD, Teradata Administrator, SQL Assistant, PMon), UNIX scripting, Ascential IBM InfoSphere DataStage and Data Modeling.
- Extensively used standardize stage (QualityStage) to validate the data based upon the rule sets.
- Involved in Data Quality meetings. (QualityStage)
- Design and create stored procedures for the application.
- Was involved in setting up the application.
- Involved in designing UNIX shell scripts and use them in IBM InfoSphere DataStage.
- Used the IBM InfoSphere DataStage Designer to develop processes for Extracting, Cleansing, Transforming, Integrating, and Loading data into Data warehouse.
- Modifying the jobs as per the migration from DB2 to Teradata.
- Requirement analysis and gathering to provide technical and architectural support to the team.
- Documented the Purpose of Mapping so as to facilitate the personnel to understand the process and in corporate the changes as and when necessary.
- Primarily involved in Job Design, Technical Reviews and Troubleshooting of jobs.
- Installed and Configured Director, Manager, Administrator and Designer components of IBM InfoSphere DataStage.
- Created & Deployed SSIS (Sql Server Integration Services) Projects, Schemas and Configured Report Server to generate reports through SSRS Sql Server 2005.
- Used to create adhoc reports by using Sql Server Reporting Services for the business team.
- Wrote Mapping documents for all the ETL Jobs( Interfaces, Data Warehouse, Data Conversion activities)
- Experienced with planning, architecture, and design of Teradata data warehousing and SQL optimization.
- Involved in resource planning, scheduling, and tracking, effort estimation.
- Created IBM InfoSphere DataStage jobs and Job Sequences and tuned them for Better Performance.
- Involved in FTP’ing files from different servers and process them.
Environment: IBM InfoSphere DataStage 8.0.1/7.5.1 , DB2, Teradata V2R5, Sql Server 2005, Control-M, UNIX, Windows XP.
Confidential, Chicago, IL
IBM InfoSphere DataStage Developer
Responsibilities:
- Extensively involved in different Team review meetings and conferences with a remote team.
- Worked on the logical and physical design of the Data warehouse. Identified sources/targets and analyzed source data for dimensional modeling.
- Extensively involved in designing and developing of Star Join Schema.
- Developed various Server and Parallel jobs using Oracle, ODBC, FTP, Pivot, Hashed file, Aggregator, STP, Filter, Funnel, Copy, Change Capture, Merge, Lookup, Join, Sort, Merge, Lookup stages.
- Extensively worked on various QualityStage stages like Standardize, Match, Investigate and Survive stages to validate the data according to the business requirements.
- Performed Unit Testing and tuned for better performance with updates on data warehouse tables using IBM InfoSphere DataStage Director for jobs Monitoring and Troubles Shooting.
- Developed the data warehouse repository using IBM InfoSphere DataStage Manager by importing the source and target database schemas.
- Created shared containers to use in multiple jobs.
- Extensively worked on IBM InfoSphere DataStage Job Sequencer to Schedule Jobs to run jobs in Sequence.
- Developed PL/SQL Procedures, Functions, Packages, Triggers, Normal and Materialized Views.
- Worked with Reporting team for extensively reporting using Data mart for Slice & Dice, Drill Down and Drill through.
- Defect Tracking, defect reporting, analyzing results and documentation.
- Performed functional, load, Integration, testing, User Acceptance testing, End to End testing.
Environment: Ascential IBM InfoSphere DataStage 7.5.1, UDBDB2, Oracle 9i, Sun Solaris 2.6.
Confidential
SqlServer/SSIS Developer
Responsibilities:
- Developed and created stored procedures, complex queries, triggers, views, and functions for databases
- Developed and optimized DTS packages
- Developed SQL Server applications, translate data and manage implementation to ensure successful execution of the application
- Involved in extracting the data using SSIS from OLTP to OLAP. Defined and scheduled several DTS packages to move data between servers using BIDS (Business Intelligence Development Studio).
- Used SSIS to create ETL packages (.dtsx files) to validate, extract, transform and load data to data warehouse databases.
- Used SQL Profiler for troubleshooting, monitoring, optimization of SQL Server and SQL code
- Work with end users to define, implement, and maintain their reporting requirements
- Work with Backup and Restore strategies
- Generated the weekly, monthly, and quarterly report by using Crystal Report
Environment: SQL Server 2000/2005, SSIS, MS Access, SQL Profiler, Crystal Reports, windows 98/XP, Visual Studio.