We provide IT Staff Augmentation Services!

Ibm Datastage/informatica Cloud/technical Lead Resume

4.00/5 (Submit Your Rating)

SUMMARY

  • Confidential has over 10+ years of strong experience with specific focus on Business Intelligence and Data Warehousing.
  • Experienced in both BI and ETL Tools like IBM Datastage 7.5/8.1/8.5/11.3/11.5,Hyperion Interactive Reporting (Brio), Business Objects, Informatica, Microsoft Power BI, Pentaho and databases like Oracle, SQL Server and MySQL, Netezza and Scheduling tools like Autosys and has done various implementations across multiple projects in client server environment in these ETL/BI tools.
  • Have good Experience in Data Modeling, Star Schema/Snowflake Schema modeling, FACT & Dimensions tables, Physical & logical data modeling.

TECHNICAL SKILLS

Programming/ Scripting: C,C++,Basic Java, SQL, PL/SQL

Concepts: Datawarehousing/Data Modelling

Database: DB2,Oracle 9i/10g,Sql Server, My Sql,Netezza 4,Azure Sql DW

Scheduling Tools: Autosys,Unix Crontab Scheduler

Operating System: Windows, Linux

Project Management: Microsoft Project Plan, Agile tools like Star Team

Tools: IBM Datastage,IBM Cognos,Business Objects,Informatica,Microsoft Power BI, Hyperion Interactive Reporting

Others: Knowledge on Agile/Waterfall Methodologies, SDLC, Erwin 4.0, Visio 2003, SQL*Plus, SQL*Loader

Domain Knowledge: Insurance, Manufacturing

PROFESSIONAL EXPERIENCE

Confidential

IBM Datastage/Informatica Cloud/Technical Lead

Responsibilities:

  • Analyzing and evaluating existing Watts BI Application and identifying scope for architecture improvement
  • Designed/Developed Datastage parallel jobs/sequences using different processing stages like Transformer, Aggregator, Lookup, Join, Sort, Copy, Merge, Funnel, CDC, Change Apply and Filter
  • Done performance tuning of datastage jobs in the Project/Job/Database levels
  • Involved and Lead Datastage Administration tasks which involved datastage patch installation which helped to avoid the repeating datastage errors and reduced the overall batch run time
  • Configured Datastage Metadata repository for Reporting
  • Developed a metadata Dashboard in Microsoft power bi which helped client to get the history of job statistics, the jobs which takes most time/cpu and datastage job inventory details
  • Helped the team in understanding the performance of datastage/ssis jobs with Microsoft azure sql db/SQL DWH
  • Done Proof of Concept in Informatica cloud version for the client to understand the performance, required drivers, the cloud services to be used like data replication, data synchronization from ICS.
  • Interacted with Microsoft team in understanding the cloud requirements, cloud computing charges, performance of Microsoft Azure SQL DB/SQL warehouse
  • Created an automatic script to reset all the failed jobs in production
  • Worked Directly with National Sales Team in providing the business critical files using automated datastage jobs
  • Created reports using Cognos and worked in developing/creating/deploying cognos packages

Confidential

IBM Datastage /Technical Lead

Responsibilities:

  • Datastage jobs were developed in multiple modules with multiple staging tables were data was sourced from PACE and EDI and data was loaded to SRP database with multiple complex business logics
  • Designed and Developed Datastage Framework which can be leveraged across multiple projects and can be useful for the below listed goals
  • Extensively used parallel stages like Join,Merge,lookup,slowly changing dimensions, change data capture stage.modify,peek for development and debugging purpose
  • Created Database stored procedures/functions for reconciliation framework between source and target after delta loads
  • Reject functionality was implemented in all the jobs using shared container for data quality check and for data validation purpose
  • Multi Instance jobs were developed to load into same table from different source systems during informatica to datastage conversion of POINT jobs
  • Used UNIX scripts for Import/Export of jobs during Datastage version migrations which saved considerable development time.
  • Designed and developed config table approach for loading point files which are of identical file structure except for header
  • Implemented Complex Database Procedure logics in datastage during informatica to datastage conversion of POINT jobs which helped in reducing the total batch time and improved efficiency
  • Used Dynamic sql as source query to take from Parameter files for datastage loads

Confidential

IBM Datastage /Technical Lead

Responsibilities:

  • Designed and Developed Datastage jobs between source to operational staging targets using star schema and implemented logic to slowly changing dimensions
  • Used change data capture stage to distinguish between insert/update instead of doing in the connector and improved job efficiency
  • Designed and Developed Datastage framework for data pull from Source ERP which helps in following
  • Ability to change source table dynamically which helped in pulling data from Source archive tables
  • Ability to add Run time filters to pull historic data from Source archive tables if any
  • Designed and Developed Datastage framework for automatic data correction which helped in updating the data in target if any lookup data got updated later in the source systems
  • Done Data profiling was done before data load to the target systems
  • Created database stored procedures for the population of reporting tables which reduced report execution times
  • Created Datstage jobs to sent Datastage job logs in mail for debugging purpose
  • Created Unix Scripts for automatic purging of datastage logs
  • Implemented looping of datastage run in sequencer based on the file availability in source
  • Created Autosys jobs for scheduling and manifest jobs for file transfer

Confidential

IBM Datastage /Technical Lead

Responsibilities:

  • Created database views in PACE by understanding the logic written in GEMS as part of GEMS retirement.
  • Created hash tables with referential integrity for faster table lookup and transforming the data representing valid business outputs.
  • Created database toolbox scripts by accepting run time parameters to execute in production whenever required
  • Created Datstage jobs for Performance and transaction extract and saved job execution time as compared to GEMS
  • Done performance tuning in Netezza using various techniques involving distribution analysis, data - type analysis,zonemaps, CBTs, configuration parameters etc.
  • Done the datastage Migration from 8.5 to 11.3
  • Experienced in developing parallel jobs using various Development/debug stages (Peek stage, Head & Tail Stage, Row generator stage, Column generator stage, Sample Stage) and processing stages (Aggregator, Change Capture, Change Apply, Filter, Sort & Merge, Funnel, Remove Duplicate Stage)

Confidential

IBM Datastage Developer

Responsibilities:

  • Designed and Developed the plan analyzer application alone for 7 months and resolved all issues and defects without crossing the SLA’s
  • Involved in Designing the ETL process to Extract translates and load data from OLTP Oracle database system to BI data warehouse
  • Worked on different production support issues,tickets,problems
  • Helped the development team in Performance tuning by removing unwanted stages in datastage and by using proper partitioning techniques
  • New Dimension and fact tables were designed and used datastage to load the data from multiple file systems

Confidential

IBM Datastage Developer

Responsibilities:

  • Converted datastage sequential jobs to parallel jobs as per business requirement
  • Used and verified the partitioning techniques and correct use of keys for better performance of jobs
  • Created datastage Parameter sets for multiple source systems
  • Supporting the appilcation and monitoring Datastage Jobs
  • Used Parallelism concepts for distributing loads among different processors by implementing and pipeline and partitioning of data
  • Created Reports using Hyperion Interactive report studio and implemented automatic report creator using java scripts embedded in Hyperion
  • Designed and Develop Datastage Jobs using Designer and to monitor the jobs in director
  • Migrate and Manage the jobs using Datastage Manager
  • Build UNIX scripts to automate and schedule the Datastage jobs for their daily/weekly/monthly runs.
  • Worked on different production support issues and to support the daily batch runs and to troubleshoot the issues
  • Create Universes through Business Objects Designer
  • Generate reports/charts using the Business Objects/Web Intelligence reports
  • Creation of new Business Objects users and managing their accounts through Business Objects Supervisor

We'd love your feedback!