We provide IT Staff Augmentation Services!

Etl Architect (data Stage And Teradata) Resume

4.00/5 (Submit Your Rating)

Plano, TX

SUMMARY

  • IBM InfoSphere (DataStage) & Teradata Certified Professional wif 15 years of IT experience in analysis, architect, design, development, testing, deployment, data profiling, data governance, data modeling, project management and production support of Data Mart, Data Warehouse, and IBM InfoSphere Information Server (DataStage) 8.x/7.x ETL systems.
  • Strong hands - on experience in IBM InfoSphere Information Server 8.x/7.x systems (DataStage), Oracle 10g, IBM Netezza appliance4.x/6.x and Teradata V13 wif Water fall and agile development methods.
  • Proficient in Business Analysis, Data Profiling, Data Quality Analysis, Data Modeling, Database Design, Data Warehouse Design, Data Migration and SDLC (both Traditional Waterfall and Agile).
  • Architect/Design system solutions for Data Mart, Data Warehouse systems wif IBM InfoSphere Information Server (DataStage), Netezza and Teradata.
  • Architect and design Star & Snowflake based logical & physical data models for Data Mart & Data Warehouse systems using data modeling tools like Erwin 4.0
  • Extensively used PVCS and IBM Rational ClearCase as a Version control management tools.
  • Extensively worked wif multiple scheduling tools like: Control-M, ASG Zena, AutoSys, and DataStage Director.
  • Built end-to-end integration solutions by utilizing various technologies and tools including IBM DataStage, Flat Files, XML files, Oracle, Netezza, Teradata, SQL server, DB2, and Access Database.
  • Excellent knowledge and experience in SQL, PL/SQL, Stored Procedures, Database Triggers, system performance tuning, and UNIX/LINUX shell scripts.
  • Hands on Experience wif Teradata utilities like BTEQ, FASTEXPORT, MULTI LOAD, FASTLOAD, Mload, and Tpump.
  • Extensively used Netezza utilities like NzAdmin, Nzmigrate, Nzload tools.
  • Experience in developing test plans, test cases, test scripts, and test validation data sets for Data Mart, Data Warehouse, and ETL systems.
  • Expertise in all phases of testing including Unit Testing, Functional Testing, System Testing, Regression Testing, Integration Testing, End to End Testing, Usability Testing, Load/Volume Testing, Performance Testing, and User Accepting Testing.
  • Experience in providing support in post-deployment phase and project transition to product support.
  • Detail oriented wif good problem solving, organizational, analysis, highly motivated and adaptive wif the ability to learn quickly.
  • Ability to work effectively and efficiently in a team and individual environments wif excellent interpersonal, technical and communication skills.

TECHNICAL SKILLS

Languages: C, C++, SQL, PL/SQL, Pro*C, UNIX shell scripts, Java and Java script

Database: Oracle11g,10g/9i//8i/7.x, Teradata V2R5/V13, Netezza 4.x/6.x, SQL Server 2008/2012, DB2 and MS Access

Tools: CA Erwin 8.6/4.0, TOAD, SQL*Navigator, SQL Developer, IBM Rational Clear Case, PVCS, Remedy, HP service desk, WinSQL and HEAT

Special Software: IBM InfoSphere Information Server 8.7/8.1, IBM DataStage 7.5.2, Cognos, MicroStrategy, Control-M, AutoSys, IBM Connect Direct, and Microsoft Project Professional Server 2007

PROFESSIONAL EXPERIENCE

Confidential, Plano, TX

ETL Architect (Data Stage and Teradata)

Environment: IBM DataStage7.x/ 8.x, Teradata, Oracle, UNIX Scripts, Control-M, Erwin

Responsibilities:

  • Working as an Architect for DataStage & Teradata and Lead the 12 members of team.
  • Architect, and design new enhancement requests (RFQ) through detailed requirement analysis and discussion wif business analyst and finalized the source systems and prepared impact analysis and high level design documents.
  • Prepared Data Stage and Teradata technical design documents for problems / change requests posted by business.
  • Prepared the source to Confidential data Mappings document and provide technical support to development teams in all data related queries.
  • Discussed wif Enterprise Architect team and secure approvals for Impact analysis and design documents.
  • Proposed solutions to resolve the performance issues in the nightly batch flow.
  • Built end-to-end integration solutions using IBM DataStage 8.7 to implement new interfaces using various stages like Join, Merge, Funnel, Lookup, Sort, Transformer, Copy, Remove Duplicate, Slowly Changing Dimension, Change Data Capture, Filter, Peek, Column Generator, Pivot, Surrogate Key Generator, Aggregator and Shared Containers.
  • Loading the data into Teradata Data warehouse using utilities like BTEQ, FASTEXPORT, MULTI LOAD, and compression.
  • Define appropriate Testing (Unit, SIT, Performance, and UAT), Quality Assurance, and Quality Control Strategy.
  • Review the documents, codes, testing plans, deployment plans and enforce the client specific standards and best practices in the newly developed applications.
  • Recommended audit checks for new ETL applications using UNIX shell scripts and add data validation checks including business rules and referential integrity checks.

Confidential

ETL Architect (Data Stage and Teradata) & Data Architect

Environment: IBM DataStage Server 7.5.2/8.1/8.7 , Teradata, Oracle, UNIX Scripts, Control-M, Erwin

Responsibilities:

  • Lead the team of 10 and worked as a Data Architect & Technical Architect for Data Stage & Teradata in ADM GDW team; handled following projects: BGL-Bordereaux data feed, Wills Referral data feed, OS Bank Data Feed, HMRC, CSDC Rewards and Verde.
  • Analysed the business problems mentioned in RFQ and engaged in data profiling activities and prepared Impact Analysis document wif proposed solutions.
  • Coordinated wif Enterprise Architect team to prepare and update logical, Physical data models using Erwin 4.0 and data profiling activities.
  • Participated and reviewed in data governance activities and recommended to re-define the rules and procedure to attain maximum data quality.
  • Architect and design the end-to-end data integration solutions using IBM DataStage 8.7 and Teradata V13 to implement new interfaces.
  • Prepared the source to Confidential data mappings document and provided technical support to development teams in all data related queries.
  • Prepared design document for DataStage and Teradata Change Requests and finalize End to End Design for required problems / change requests listed for GDW small change team.
  • Prepared the Detailed Technical Design document wif GDW standards and processes and secure approvals from GDW panels.
  • Conducted peer review for design, code, test scenarios and deployment plan reviews.
  • Coordinated wif development team to adhere the GDW SDLC process from requirement analysis to deployment of the change wif coding standards and best practices.
  • Actively involved wif all other cross functional support teams to ensure the smooth delivery as per project plan.
  • Participated weekly status calls and provides updated status to all stake holders both Wipro and LBG mgt folks.
  • Performed troubleshooting, performance tuning and performance monitoring for enhancement of DataStage jobs.
  • Developed Data Stage and Teradata related proof of concepts for specific business logics using various stages like Join, Merge, Funnel, Lookup, Sort, Transformer, Copy, Remove Duplicate, Slowly Changing Dimension, Change Data Capture, Filter, Peek, Column Generator, Pivot, Surrogate Key Generator, Aggregator and Shared Containers.
  • Provided Technical training in Data Stage & Teradata to build the competency resource pool.

Confidential

Technical Architect for Data Stage & Netezza / Data Architect

Environment: IBM DataStage Info. Server 7.5.2/8.1, Netezza, Oracle, UNIX Scripts, Control-M, Erwin

Responsibilities:

  • Lead the team of 12 and worked as a Technical Architect for Data Stage&Netezza
  • Participated weekly meeting wif Clients enterprise Architect team to discuss all in-flight projects architecture design status and open issues.
  • Prepared weekly report wif list of open issues and provided recommendations to address the issues.
  • Architect and design end-to-end integration solutions using IBM DataStage 8.1 to implement new interfaces.
  • Performed data profiling against given source systems and prepared the data quality report.
  • Prepared and updated data models and discussed wif Enterprise architect team to finalize the logical and physical data models.
  • Prepared source to Confidential data mapping document and provided support to respective development team for data mapping related queries.
  • Built end-to-end integration solutions using IBM DataStage 8.7 to implement new interfaces using various stages like Join, Merge, Funnel, Lookup, Sort, Transformer, Copy, Remove Duplicate, Slowly Changing Dimension, Change Data Capture, Filter, Peek, Column Generator, Pivot, Surrogate Key Generator, Aggregator and Shared Containers.
  • Actively involved in all Confidential Media platform related Proof of Concepts.
  • Conducted peer review for design, code reviews, test scenarios reviews and deployment plan reviews and recommended coding standards and industry best practices.
  • Participated in program solution requirements, Data model discussions, Design reviews / approvals, Complete High level Design.
  • Identified and Designed and Developed the reusable components, Promoted design/develop for performance idea; ensure the client’s standards are followed by development teams.
  • Prepared NZ Scripts, stored procedures using NZSQL and NZload.
  • Prepared and maintained NZscripts to generate statistics and alert messages for all Confidential Media specific development projects.
  • Worked as a Netezza Admin and coordinated wif IBM support team to setup and configure the Netezza development environment.
  • Experimented different Netezza workload management features to enhance the performance.
  • Created new process templates and checklists. Ensure to in corporate all lessons learnt in new projects.
  • Provided Technical training in Data Stage and Netezza to build the competency resource pool for upcoming projects.

Confidential, Irving, TX

ETL Architect (Data Stage & Netezza) and Data Architect

Environment: DataStage 7.5.2/8.1, Netezza, Oracle, PL/SQL, Pro*C, UNIX Scripts, Control-M, Erwin

Responsibilities:

  • Lead the BI- support team (Onsite / Offshore) of 15 and delivered 24*7 supports.
  • Kept the consistent track record like more TEMPthan 97% of SLA for all critical incidents.
  • On an average 20 % of incidents flow has been reduced every quarter.
  • Around 100 (per Quarter) critical incidents / repeated incidents are converted in to problem tickets. Based on priority PB tickets has been implemented and improved the performance and data quality.
  • Approximately 10% of new applications were added in to Production every quarter and maintained the SLA wif existing resources. Cost to the company and customer was very much reduced.
  • Worked as an ETL Architect for large number IT strategic projects like Netezza upgrade, Data Stage Upgrade, Microstrategy upgrade, Retek/RMS data warehouse (Oracle) upgrade, Retek/RMS report migration, Audit Balance and Control, Vendor Score Card, etc.
  • Performed source data analysis on RMS (Oracle Retek Merchandising System) for various data warehousing projects.
  • Participated in data governance discussions wif enterprise architect team and external team to re-define the rules and procedures for enterprise level data quality.
  • Participated weekly status meeting wif Clients leadership team and enterprise Architect team to discuss all in-flight projects architecture design status and open issues.
  • Prepared weekly report wif list of open issues and provided recommendations to address the issues.
  • Understand business processes and collaborate wif business users/analysts to get specific user requirements.
  • Architect and design the logical and physical data models using Erwin and presented wif Enterprise architect team for approvals.
  • Actively involved data profiling activities for TLD / Loyalty program initiatives.
  • Prepared source to Confidential data mapping document and provided support to respective development team for data mapping related queries.
  • Architect and design the end-to-end integration solutions using IBM DataStage 8.1 to implement new interfaces.
  • Built end-to-end integration solutions using IBM DataStage 8.7 to implement new interfaces using various stages like Join, Merge, Funnel, Lookup, Sort, Transformer, Copy, Remove Duplicate, Slowly Changing Dimension, Change Data Capture, Filter, Peek, Column Generator, Pivot, Surrogate Key Generator, Aggregator and Shared Containers.
  • Worked as a DataStage Admin and performed the activities like installed and configured DataStage test environments, created / migrated DS projects, added the users, groups wif required privileges and maintained regular monitoring and clean-up activities.
  • Prepared and Peer reviewed the test plans, test cases, test scripts, and test validation data sets for Data Mart, Data Warehouse, and IBM DataStage integration/ETL processes.
  • Performed software testing including Unit Testing, Functional Testing, System Integration Testing, Volumetric Testing, Performance Testing, and User Accepting Testing.
  • Architect and design the Customer module for Master Data Management.
  • Reviewed and recommended to automate all the new DataStage ETL jobs using UNIX shell scripts through Control-M scheduler to add data validation checks including business rules and referential integrity checks.
  • Worked as a Netezza Admin and analysed the Netezza distributions on large tables and provided recommendations for performance improvements.
  • Prepared custom scripts using NZSQL and nzload for project specific proof of concepts.
  • Applied IBM’s best practice guidelines like regular Statistics collection, using groom option to recover the free space to improve the Netezza performance.
  • Worked as a point of contact for all Netezza related discussions.
  • Automated Netezza query history database alerts and prepared alert report and discussed wif Enterprise architect team and recommended performance tuning options.
  • Worked wif IBM support to analyse current workloads and configured different groups in Netezza and utilized the Netezza’s work load management features to fine tune the performance.
  • Defined various process / procedures to streamline the batch process and business communications.

Confidential

Sr. ETL DataStage Developer / Tech Lead

Environment: Ascential DataStage 7.5.1, Oracle, Netezza, UNIX Shell scripts, Autosys, Erwin

Responsibilities:

  • Worked as a Data warehouse ETL Developer and Technical lead for 4 members of team at offshore and provided application support for RMS batch process.
  • Created and updated Logical and physical data models using Erwin.
  • Developed functional specifications for data Extraction, transformation and load processes for implementation.
  • Designed and Developed UNIX shell Scripts for file validation and scheduling Data Stage jobs
  • Designed the DataStage jobs using Transformer, sequential, Aggregator, Data Set, File Set, Remove Duplicates, Sort, Join, Merge, Lookup, Funnel, Copy, Modify, and Filter stages and integrated wif job sequences.
  • Performed debugging and performance tuning activities for all DataStage specific jobs.
  • Used different Parallel Extender Partitioning techniques in the stages to facilitate the best parallelism in the Parallel Extender jobs.
  • Analysed the Netezza distributions on large tables and provided recommendations for performance improvements.
  • Prepared custom scripts using NZSQL and nzload for new enhancements.
  • Applied best practice guidelines like regular Statistics collection, using groom option to recover the free space to improve the Netezza performance.
  • HEAT TEMPhas been used as incident management system.

Confidential

Sr. ETL DataStage Developer

Environment: IBM DataStage 7.5.1, Microstrategy, DB2 UDB, UNIX Scripts, Control-M, Erwin

Responsibilities:

  • Lead the team of 5 and Involved in the design of EDW Stores architecture, code reviews of Datastage jobs and implemented best practices in Datastage jobs.
  • Created end-to end Process flow diagram for all ETL jobs.
  • Designed the DataStage jobs, job sequences and Shared Containers to implement the business requirements and design specifications.
  • Extensively worked wif Job sequences using Job Activity, Email Notification, Sequencer, Wait for File activities to control and execute the Data stage Parallel jobs.
  • Developed functional specifications for data Extraction, transformation and load processes for implementation.
  • Designed and Developed UNIX shell Scripts for file validation and scheduling Data Stage jobs
  • Developed DataStage jobs using Transformer, sequential, Aggregator, Data Set, File Set, Remove Duplicates, Sort, Join, Merge, Lookup, Funnel, Copy, Modify, and Filter stages and integrated wif UNIX shell scripts and scheduled in Control-M.
  • Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
  • Convert complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
  • Handled the tasks of conducting peer reviews for design, code reviews, test plan reviews and standard ETL documentation reviews.

Confidential

ETL-DataStage Developer / Tech Lead

Environment: Ascential DataStage 7.5.1 (Server Edition), Microstrategy, Teradata, SQL Server 2005, DS job Control, Erwin

Responsibilities:

  • Lead the 10 members of ETL and BI Reporting team at offshore.
  • Responsible for developing detailed ETL specifications based on business requirements and test the ETL applications following all ETL standards.
  • Development, execution and documentation of system and integration test plans and update and maintain Metadata
  • Developed data stage jobs for different subject areas and integrated wif client supplied DS job control batches.
  • Developed reusable components such as Templates, Created source and Confidential partitions to concurrently load the data into ODS and Data mart.
  • Validate, schedule, run, and monitor the ETL jobs using IBM DataStage Director.
  • Involved in development, testing & post implementation support.
  • Developed BTeq scripts to import and export data from Teradata database.
  • Used FastLoad and Mload utilities for various extraction and load requirements.

Confidential, Minneapolis

ETL - DataStage Developer

Environment: IBM DataStage 7.5.1, Oracle, DB2 UDB, UNIX Scripts, Control-M

Responsibilities:

  • Develop Parallel DataStage jobs using various stages like Join, Merge, Funnel, Lookup, Sort, Transformer, Copy, Remove Duplicate, Filter, Peek, Column Generator, Pivot and Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems.
  • Design and develop the DataStage jobs and Job Sequences and prepared the complete data mappings documents.
  • Develop UNIX shell scripts to execute DataStage jobs.
  • Develop test plans, test cases, test scripts, and test validation data sets for Data Mart, Data Warehouse, and ETL processes.
  • Validate, schedule, run, and monitor the ETL jobs using IBM DataStage Director.
  • Develop UNIX scripts to automate the Data Load processes to the Confidential Data warehouse.
  • Perform software testing including Unit Testing, Functional Testing, System Integration Testing, Load/Volume Testing, Performance Testing, and User Accepting Testing.
  • Implement the application in the Production environment and provide support in post-deployment phase and involve in project transition to production support.

We'd love your feedback!