Ab Initio Developer Resume
NY
SUMMARY
- 8 years of strong data warehousing experience using ETL tool Ab Initio, GDE (3.1.2), Co>Op (3.1.4).
- Extensively used EME to create Repository/Project parameters, Version control and Sand - Box creation.
- Extensively used AIR commands to check in/check-out, perform dependency analysis for Common projects, higher environment migrations.
- Expertise in data modeling, business requirements analysis, data extraction, transformation, loading, migration, integration in a complex, high-volume environment using Ab Initio.
- Strong experience working with various Heterogeneous Source Systems like Oracle (11g, 10g, 9i), SQL Server ( 2000/2005/2008 ), DB2 and Flat files.
- Proficient with various Ab-Initio Parallelism and Multi File System techniques and has thorough knowledge of PL/SQL and UNIX Korn Shell scripting to maximize Ab Initio parallelism capabilities.
- Strong experience on developing re-usable generic / dynamic Ab Initio applications for high-volume DWH environment.
- Strong skills on Ab Initio graph programming and Data Manipulation Language (DML).
- Strong knowledge inTeradata utilities (BTEQ, FASTLOAD, FASTEXPORT, MULTILOAD) and processing of legacy Mainframe files.
- Good understanding in design, development of Data warehouses/Data Marts, Dimensional Modeling, Fact Tables, Dimensional Tables (Type 1, Type 2, Type 3), Slowly Changing Dimensions.
- Worked extensively on Data Warehouse applications development in Oracle, DB2, SQL Server environments, using ETL Tools Ab Initio, PL/SQL and UNIX Shell Scripts.
- Strong working knowledge of Data Modeling methodologies using Star schema and Snowflake schema.
- Experience in integration of various data sources such as flat files, ASCII, EBCDIC files, XML files, DB tables etc.
- Expertise knowledge in using various Ab Initio components such as Join, Reformat, Scan, Rollup, Normalize, De-normalize, Partitioning and De-partitioning components.
- Excellent knowledge in gathering user and business requirements from client personnel and management, design and coding ETL procedures for large data warehouse projects.
- Effective Team Player with excellent quantitative, analytical, debugging, problem solving, programming, written and verbal communication skills.
TECHNICAL SKILLS
DWH TOOLS: Ab Initio GDE 3.1.2, Co>Op 3.1.4., Informatica7.x 8.x, Business Objects 5.5, XI R2
Databases: Oracle 12c/11g/10g/9i, SQLServer 2000/2005/2008 , DB2.
Programming: SQL, PL/SQL, UNIX Shell Scripting, C, C++, Visual Basic 6.0, .NET.
Scripting Languages: HTML, VB Script, Image Ready & Photoshop 7.0.1.
Platforms: UNIX ( Confidential -AIX, Red Hat Linux, Sun Solaris,), Windows NT/XP, Mainframe (OS/390).
Testing Tools: QTP 11.5/10.0, HP ALM 12.0.
PROFESSIONAL EXPERIENCE
Confidential
Ab Initio Developer
Responsibilities:
- Developed and supported the extraction, transformation and load process (ETL) for the Data Warehouse from heterogeneous source systems using Ab Initio.
- Implemented a number of Ab Initio graphs using Data parallelism and Multi File System (MFS) techniques.
- Used Ab Initio GDE to generate complex graphs for the ETL process using Join, Rollup and Reformat transform components and executed using Co>Operating System.
- Configured the source and target database connections using .dbc files.
- The design and implementation of the Data model for the Data Warehouse using Star Schema.
- Created .xfr and .dml files for various transformations and specifying the record format.
- Involved in automating the ETL process through scheduling.
- Deploy and test run the graph as executable Korn shell scripts in the application system
- Modified the Ab Initio components parameters, utilize data parallelism and thereby improve the overall performance to fine-tune the execution times.
- Performed version management tasks to add, remove, check in, check out, lock, unlock and produce reports on versions to summarize the changes for a project.
- Design and developed multiple transforms graphs, which migrates historical transactional data from legacy systems (Mainframe system) to UNIX operating system
- Excellent in creating the Job Wrapper Scripts for every deployed graph.
- Utilized Phases, Checkpoints to avoid deadlocks and multi-files in graphs and also used Run program, Run SQL components to run UNIX and SQL commands.
- Provided application requirements gathering, designing, development, technical documentation, and debugging. Assisted team members in defining Cleansing, Aggregating, and other Transformation rules.
- Involved Able to interact effectively with other members of the Business Engineering, Quality Assurance, users and other teams involved with the System Development Life cycle.
Environment: Ab Initio GDE 3.1.2, Co>Op 3.1.4, UNIX, Db2, SQL Assistant, Putty, SQL\PL SQL, Windows XP, MS Office, Korn Shell Scripts, XML, SQL Server 2008, Oracle 11g.
Confidential
Ab-Initio Developer
Responsibilities:
- Involved in Developing the Ab Initio Graphs for the applications.
- Worked in the BASEL project in RDS Team on Release1.
- Involved in all the stages of SDLC during the projects. Analyzed, designed and tested the new system for performance, efficiency and maintainability using ETL tool Ab Initio.
- Performed data validation before moving the data into staging areas using in built functions like is valid, first defined, is blank, is defined, string length, and string index.
- Extensively used Partition components and developed graphs using write Multi-Files, Read Multi-Files, Filter by Expression, Run Program, Join, Sort and Reformat.
- Used multi-file system for parallel processing to achieve better performance and implemented component level, pipeline and data parallelism in Ab Initio Worked with xml read, write and reformat components for element-attribute data, structured text data and mixed data representation using event processing and object processing model.
- Extensive use of xfr’s to apply Business logics and mapping validation.
- Maintain and manage critical client relationships Confidential moderate levels while adding value to their organization. Keep all Application Leads well-informed while instilling.
- Implemented an 8 way multi file system that is composed of individual files on different nodes that are partitioned and stored in distributed directories (using Multi directories).
- Various inbuilt functions like lookup, lookup local, string filter out, datetime add were effectively used in various transform functions.
- Created User defined functions for the project requirements.
- Created wrappers that check for dependencies including completion of previous run and upstream processes and check for rejects and handle exceptions using the information in the parameter files.
- Development of UNIX Korn shell scripts to automate job runs or Support the redaction infrastructure and SQL and PL/SQL Procedures to load the Data into Database.
- Used EME extensively for version control, check-in and check-out.
- Handled frequent change requests to the existing tables on a monthly basis by adding new columns to the existing tables, changing data type of the columns etc.
- Responsible for writing unit test plans.
Environment: Ab Initio GDE 3.1.2, Co>Operating System 2.14.62/2.12.2 , UNIX, Windows XP, DB2, SQL Server 2008, Korn Shell Scripts, Oracle 10g.
Confidential, NY
Ab Initio Developer
Responsibilities:
- Conducted user requirement sessions to get the requirements for the EPM Analytics and reporting.
- ETL Developer involved in creation of Enterprise Project Management (EPM) Data Mart for the enterprise project level reporting and analytics
- Had a walkthrough of the Prism (EPM Vendor software) tables to have better understanding of the attributes/elements presented in the software related to projects, project requests, service requests and tasks.
- Followed the enterprise standard of creating Normalized Standard Layer and Dimensional Presentation Layer for the Data Mart creation.
- Did the data profiling using SQL and PL/SQL code to understand the data and relationships on the operational system.
- Involved in the creation of Logical and Physical Models for the EPM Standard Layer and Presentation Layer using Erwin Modeling tool and also created DDLs for DBA to create Oracle Structures.
- Extensively involved in various data modeling tasks including forward engineering, reverse engineering, complete compare, match and merge, creating DDL scripts, creating subject areas, creating DDL scripts, publishing model to PDF and HTML format, generating various data modeling reports etc.
- Identified and tracked the slowly changing dimensions and determined the hierarchies in dimensions. Used Kimball methodologies for Star Schema Implementation.
- Created Mapping Documents and ETL design documents for both Presentation Layer and Standard Layer. Followed Enterprise Level Metadata and Audit standards while creating design and source-to-target mapping documents.
- Coordinated with ETL developers from Indian Offshore Company to develop Ab Initio ETL process to populate both Standard and Presentation Layers. Reviewed the entire ETL process for the performance tuning, audit and backfill and moving forward. Did the Integration testing in both the Layers. And also reviewed the audit checks. Validated the data against the Operational EPM reports.
- Created several automated Unix Shell scripts to create wrappers for Ab Initio code to do parameter passing and also to load Balance and Control files to Oracle B&C database.
- Handed over the production maintenance phase to Offshore Team.
- Coordinated with BO developer for the creation of BO Universe and created templates for the daily/monthly reports to be created. And also helped him in creation of Dashboards with useful KPIs.
- Coordinated with BO developer to create several OLAP cubes for the dimensional analysis.
- Conducted user trainings to help them understand the Presentation Layer structures and available Cubes and Reports for analysis.
- Created complete metadata (data lineage) from ETL to Reporting and loaded to Enterprise Metadata Repository.
Environment: Ab Initio GDE1.13, Co>Op2.13, UNIX, Oracle 10g, DB2, SQL Server 2005, Windows’ XP.
Confidential, Plano, TX
Ab Initio Developer
Responsibilities:
- Involved with business users to prepare functional specification and technical design documents for ETL process for complete data warehouse cycle for Confidential &T wireless customer support and sales.
- Developed Jobs and used Ab Initio as an ETL tool to load the final loads
- The project is to centralize the reporting system, previously used a hard coded program.
- Developed various Ab Initio graphs for customer credit, contact, account detail, account XRef, data inserts & updates, data validate graphs, TN inserts & updates, calling plan, network service XRef graphs and refresh graphs.
- Used various Ab Initio components of partition, de-partition, database, datasets, transform, FTP and sort to build graphs in GDE
- Developed Ab Initio graphs for data validation using validate components.
- Created Ab Initio multi file system (MFS) to take advantage of partition parallelism.
- Developed several stored procedures and functions to make the existing code to be executed and make it more dynamic which is now considered to be the centralized program for the existing running programs and the new EDW project.
- Wrote several SQL* loader programs to load small loads into temporary tables for the data, which may be required to move among different UNIX servers and databases while the program is running
- Developed several KShell(Korn-Shell) programs, functions and packages to do the pre - inspection, post - inspection, pre - extraction inspection of the data getting loaded every week and populate errors, which are again used to generate error reports responsible for the automation of Ab Initio graphs using KShell(Korn-shell) scripts.
- Expertise in unit testing, system testing using of sample data, generate data, manipulate date and verify the functional, data quality, performance of graphs.
- Documentation of complete graphs and its components.
Environment: Ab Initio GDE1.13, Co>Op2.13, UNIX, Oracle 10g, DB2, SQL Server 2005, Windows’ XP.
Confidential, Cincinatti, OH
Ab Initio Developer
Responsibilities:
- Developed and supported the extraction, transformation and load process (ETL) for the Data Warehouse from heterogeneous source systems using Ab Initio.
- Implemented a number of Ab Initio graphs using Data parallelism and Multi File System (MFS) techniques.
- Used Ab Initio GDE to generate complex graphs for the ETL process using Join, Rollup and Reformat transform components and executed using Co>Operating System.
- Configured the source and target database connections using .dbc files
- The design and implementation of the Data model for the Data Warehouse using Star Schema.
- Created .xfr and .dml files for various transformations and specifying the record format.
- Involved in automating the ETL process through scheduling.
- Deploy and test run the graph as executable Korn shell scripts in the application system
- Modified the Ab Initio components parameters, utilize data parallelism and thereby improve the overall performance to fine-tune the execution times.
- Utilized Phases, Checkpoints to avoid deadlocks and multi-files in graphs and also used Run program, Run SQL components to run UNIX and SQL commands.
- Provided application requirements gathering, designing, development, technical documentation, and debugging. Assisted team members in defining Cleansing, Aggregating, and other Transformation rules.
- Involved Able to interact effectively with other members of the Business Engineering, Quality Assurance.
Environment: Ab Initio GDE 1.13, Co>op 2.13,UNIX, Db2, SQL Assistant, Putty, SQL\PL-SQL,Windows’XP, MS Office, Shell Scripts, XML,Oracle 9i.
Confidential
Ab Initio Developer
Responsibilities:
- Developed high level and low level design document for processing each feed and documenting the various implementation done during the course of the Project.
- Involved in source to target mapping discussions and participating in various data cleansing and data quality exercises.
- Developed various graphs which include extracting various XML files and loading it into the database.
- Phasing and check pointing were used in the graphs to avoid deadlock and recover completed stages of the graph, in case of a failure.
- Various Ab Initio commands such as m ls, m cp, m mv, m db, m touch were used extensively to operate with multifiles.
- Performed data cleansing and data validation by using various Ab Initio functions like is valid, is defined, is error, is null, string trim etc.
- Involved in code reviews, performance tuning strategies Confidential Ab Initio and Database level.
- Involved in moving applications from AIX to Linux server and modified the shell scripts for that application in order to run on Linux server.
- Involved in Migration of code from DEV to QA and also from QA to PROD by using Heats (Home Depot Utility).
- Involved in processing large scale Data Processing Systems using Ab Initio Conduct>It.
- Created HDDTM (Home Depot ETL process Dynamic Task Manager) plans, Go Scripts and child plans to run the jobs in sequence.
- Involved in Production support to monitor the jobs and schedules through Confidential Maestro 8.5 Tivoli Workload Scheduler.
- Involved in unit testing of the graphs and also prepared test cases document
Environment: Ab Initio GDE1.13, Co-Op2.13, UNIX, Oracle 9i, SQLServer Navigator 5.0,SQL Server2000, Cygwin, AMS Software, Maestro, DB2, Teradata, Windows’XP, Crystal Reports 9.0nt.