We provide IT Staff Augmentation Services!

Etl/big Data Test Engineer Resume

3.00/5 (Submit Your Rating)

SUMMARY

  • Around 8 years of total IT Experience with expertise knowledge in Data Warehousing & Bigdata ecosystem components (HDFS, Hive, Spark, HBase, Hive, Pig, Sqoop) and Python.
  • Proficient in understanding test requirements for Data Warehousing & Big Data landscape and expert in strategizing End to End QA execution for Data Warehousing & Hadoop components
  • Experience in interacting with business analysts, developers and technical support and business teams.
  • Experience in automating ETL data validation
  • Experience in Data migration from existing relational database to Hadoop.
  • Experience in developing and providing support in running Hive queries.
  • Performed Importing and exporting data into HDFS and Hive using Sqoop.
  • Good Knowledge in Healthcare, Banking and Pharmaceuticals.
  • Good understanding concepts on Business Intelligence.
  • Expertise in Defect management, Bug tracking, Bug Reports and generating the graphs using Test Management Tools such as JIRA, DB Symphony.
  • Test estimation, planning & schedule preparation for Data warehousing/BIG data implementation
  • Experience and Compliance with full SDLC processes and having good knowledge on Agile - SCRUM and Waterfall Model.
  • Experience in leading offshore team and familiar with Offshore/Onshore Method.
  • Involved in data loading from Unix to HDFS and created Hive Databases, Tables.
  • Extensive experience in Black Box Testing Functional Testing, Integration Testing, System Testing, Regression Testing, Performance Testing on Warehouse Applications.
  • Expertise in writing Shell Scripts in UNIX environment.
  • Experience in Testing and Production Support environment for 6 years and have around 2 year of onsite experience.
  • Experience in ITIL Process and L2 support.

TECHNICAL SKILLS

Operating System: UNIX, Microsoft Windows

Programming/Scripting Languages: SQL, PL/SQL, UNIX Shell Scripts, Python, Pig Latin,Java

BIG Data Ecosystem: Hadoop, Pig, Hive, Sqoop, Spark

Database & DWBI Tools: Oracle, Netezza, SQL server, Teradata, INFORMATICA, Tableau

Other Utilities: Toad, SQL Developer, SQL workbench, HP Quality control

Testing Methodologies: Functional, Regression, Automation and Agile

ETL Automation Tool: QuerySurge, ETL Validator

PROFESSIONAL EXPERIENCE

Confidential

ETL/Big Data Test Engineer

Responsibilities:

  • Test estimation, planning and schedule preparation for data warehouse implementation
  • Worked with Business analysts to understand High Level/Detail Design requirements in order to transform business requirements into functional specifications.
  • Responsible for reviewing Functional specs, user documentation and use cases and developing test cases out of it.
  • Responsible for planning and directing Quality Assurance and Software change control policies.
  • Executing smoke test/Build acceptance test/Migration certification on each build.
  • Provide guidance and assistance to QA analysts and testers in the preparation of test cases and test scripts, prepare/update user documentation.
  • Responsible for handling the most complex quality assurance and test environment problems and issues.
  • Created data pipeline using Sqoop, HIVE to extract the data from different sources systems
  • Responsible for writing Hive SQL queries for performing Analytic function across different layers of data.
  • Responsible for writing Hive SQL/pig, Python scripts to validate the HDFS Data.
  • Responsible for Data migration from existing relational database to Hadoop.
  • Responsible for developing and providing support in running Hive queries.
  • Performed Importing and exporting data into HDFS and Hive using Sqoop
  • Developed SQL queries for Back-end testing/Database testing and participated in end to end testing.
  • Proficient understanding of working with ETL Automation Tools like QuerySurge.

Environment: Hadoop Horton Works, Hive, Pig, Sqoop, Linux, Oracle, QuerySurge tool.

Confidential

ETL Tester

Responsibilities:

  • As Onsite lead involved in Gathering and Analyzing Business Requirements, High Level Designing and Detail Technical Design of ETL application.
  • Analyzed Test Plans and Test Cases based on Requirements and General Design Documents, involved in both Manual and Automation Testing.
  • Interacting with Business Analysts for Business Requirements, testing scope reviews, inspections and test planning
  • Test Design, System and Integration testing of Personal lines Warehouse using ETL and BI approach.
  • Developed different mappings by using different Transformations like Aggregator, Lookup, Expression, update Strategy, Joiner, Router etc to load the data into staging tables and then to target using Informatica.
  • Extensively used SQL Queries to verify and validate the Database Updates.
  • Involved in the review of test coverage document by analyzing the requirements and deriving test scenarios and traceability matrix.
  • Performed extensive Data Integrity testing by executing SQL Statements on Oracle SQL database.
  • Designed and developed UNIX shell scripts as part of the ETL process to automate the data validation in Production Environment.
  • Organized Project Management Review meetings with various stake holders and collected various metrics for analysis
  • Timeline planning of various deliverables from offshore and assisted the team in developing SQL queries for complex data validations and always delivered quality results on time.
  • Proficient understanding of working with ETL Automation Tools like ETL Validator.
  • Used JIRA for Test Estimation, Test Planning, Test Designing, Test Analysis, Test Execution, Defect Tracking and Test Result
  • Db symphony tool is used to raise service requests.
  • Having good experience in L2 support and followed ITIL process. Closed all the tickets within SLA.

Environment: UNIX shell scripting, SQL, Informatica, Netezza CTRLM, Genoes, ETL Validator

Confidential

Software Engineer

Responsibilities:

  • Documented user requirements translated requirements into system solutions and develop implementation plan and schedule.
  • Involve in Business process analysis and technical design sessions with business and technical staff to develop requirements document, and ETL source to target specifications. Perform impact analysis for change requests and coordinate change management with the deployment teams.
  • Perform data analysis on source system to provide inputs for building logical Data model for fact and dimension. Coordinate with DBA for physical data model implementation.
  • Design and develop PL/SQL procedures and call them through stored procedure transformations in the mapping.
  • Develop Shell Scripts to apply various slicing & dicing operation such as split, sort, concatenate, merge & FTP data files.
  • Create the Unit test cases & Support System, Integration & User acceptance
  • Monitor the production cycles for Daily, Weekly & Monthly loads.

Environment: XML, JavaScripts, DB2, Netezza, UNIX, Control-M.

Confidential

Software Engineer

Responsibilities:

  • Prepared detail technical designs, Test Case.
  • Developed a module named Review which included the creation of packages, procedures, functions and views in oracle.
  • And Involved in data conversion activities from old system named ICAR (DB2 database) to INTENAL 8D (Oracle database). The activities involved being creation of conversion scripts and execution of the same
  • Have involved in unit testing and debugging of the scripts and packages developed.
  • Responsible for reviewing Functional specs, user documentation and use cases and developing manual test cases out of it.
  • Developed SQL Queries for Back-end testing/Database testing and performed end to end testing.
  • Reached Testing Goals by doing Data Completeness, Data transformation, Data Quality, Performance and Scalability.
  • Expertise with System Testing, Functional Testing, Regression Testing.
  • Prepared Traceability Matrix with requirements versus test cases.
  • Involved in identifying the defects and developed Defect tracking.
  • Created Test cases by taking input from Business Analysts
  • Designed and Developed data validation, load processes and test cases using PL/SQL, SQL.
  • Used TOAD Software for Querying ORACLE
  • Documentation to describe program development, logic, coding, testing, changes and corrections.
  • Analysis of requirements, existing system, Identification of required dimensions and facts.

Environment: Oracle 9i, PL/SQL, SQL Server, TOAD.

We'd love your feedback!