Data Engineer Resume

SUMMARY:

9+ years of experience in Information Technology with diverse experience in Analysis, Design, Development, Testing, Implementation and support phases of different projects in the Telecomm and Retail industry.
A creative thinker with the ability to manage multiple high - level projects concurrently. High performance consistently obtained through a diverse knowledge of languages, applications and experience.

TECHNICAL SKILLS:

WORK EXPERIENCE:

Confidential

Data Engineer

Responsibilities:

Being part of the process of corporate ETL process modernization, am part of the analysis, design and development of a new solution which integrates Scala, Spark, Hive, Parquet, json, Oracle and Cloudera to deliver Bell Fibe TV Viewership data correction.
Responsible for reviewing the Python code, extracting the business logic and business rules related to TV viewership, programs and commercial schedules.
Developed Hive/Pyspark modules for viewership analytics for Bell Media.
Developed data pipelines to apply various techniques to cleanse, validate, and process the data into an agreed-upon structure.

Confidential

Hadoop Analyst

Responsibilities:

Worked on Segmentations to analyze different audience based upon mobile browsing behavior.
Explored Spark for performance improvement and optimization of the existing algorithms in Hadoop, using Spark-SQL, Data Frame.
Worked on various RDD APIs available in Spark/Scala, performed RDD transformation and developed dataframe.
Worked on handling Hive queries using Spark SQL that integrate with Spark environment.
Prepare and execute hive queries based on business use cases and store outputs into resultant hive tables. These tables are further access by reporting tools for visualization and preparing business reports.
Importing and exporting data into HDFS (Hadoop File System) and Hive using Sqoop.
Expertise in writing Hadoop Jobs for analyzing data using Hive.

Confidential

Application Engineer

Responsibilities:

Lead the Retail Integration Bus (RIB) team to configure topic, consumer and producer for real time basis inflow and outflow of different types of messages to/from Retail Applications.
Designed technical documents keeping in view the business’s custom integration architecture and accordingly configure the system.
Different producers configured to publish messages to topic related to Transfers, Shipments, Items, and RTV etc to send to external applications Eg: Data Warehouse.
Also configured topic from where custom subscribers subscribe messages from different message family like Purchase Orders, Receiving and Inventory Adjustments.
Involved in system testing of custom adapters by closely working with different teams (business and IT) responsible for publishing and consuming messages.

Confidential

D ata Analyst

Responsibilities:

Designed and developed Sqoop jobs for data ingestion from RDBMS to HDFS and hive tables.
Collected and aggregated large amounts of streaming log data into the Hadoop cluster using Flume.
Developed Simple to complex Map/reduce Jobs using Hive.
Designed and created Hive managed and external tables to store the transformed data.
Support and maintenance of Sqoop jobs and programs.

Confidential

Senior Software Engineer

Responsibilities:

Lead the implementation of Oracle Retail Price Management (RPM v13.2.4). Conducted demo sessions, identified user requirements and gaps in the functionality by closely working with end users.
Responsible for writing design documents, coding with established coding standards, writing and executing test cases, preparing application training material and educating the business users for application usage.
Responsible for Smoke testing, Unit testing and Integration testing of Oracle Retail applications. Also created test cases for testing team to ensure utmost quality for all the applications being supported for the client.
Involved in system improvement tasks and performance tuning of Pl/Sql code.
Responsible for Emergency fix, Minor and Major Enhancements.

Confidential

Software Engineer

Responsibilities:

In the Development project, with the deep understanding of business requirements, has written functional design, technical design and code using Oracle Pl/Sql and UNIX shell script.
Involved in the development of application, writing macros, code debugging and providing fix for the errors in a VBA (Visual Basic for Application) application.
Developed Teradata code review tool and Oracle to Teradata Migration tool using VBA.
Responsible of doing analyses, design, development and testing for major enhancements. Suggested major enhancements and worked on that to make the system efficient for business users.