Junior Data Engineer Resume
5.00/5 (Submit Your Rating)
SUMMARY:
- To help companies get more out of their data. My interests are in the fields of Data Quality, Data Observability and Data Reliability which are pre - requisites for Data Synthesis.
- I am ideally searching for a position with a team building out a DataPlatform and looking to really make the most of their data.
PROFESSIONAL EXPERIENCE:
Confidential
Junior Data Engineer
Responsibilities:
- Development and deployment of ETL/ELT migration pipelines for full and incremental loading from on-prem server.
- Created lift-and-shift pipelines from SQL Server to Azure Managed Postgres Instance.
- Database Denormalization ETL/ELT with PostgreSQL and Azure Data Factory.
- Worked with stakeholders to create metadata workbooks for mapping denormalized tables.
- Created multi-layer aggregation process for denormalized schema.
- Created pipelines with ADF to generate and store metadata for denormalized schema.
- Created custom methods for catching delta data for updating the denormalized schema.
- Report Conversion and Delivery with PostgeSQL and Azure Data Factory and Logic Apps.
- Translated existing reports from MSSQL to PostgreSQL language.
- Created publishing pipelines for access and delivery of reports on schedule.
- Created an Azure Logic App for generating SAS keys for reports in Azure Blob Storage.
- Developed Logging Method for Data Acquisition.
- Table design for logging multiple acquisition methods in PostgreSQL.
- Created generic pipeline in ADF to log variety of actions from a variety of pipelines.
- Development of a currency conversion solution
- Serverless Azure Function development for data acquisition in python.
- PostgreSQL table design and management.
- Sisense ElastiCube development for integration into the suite of dashboards.
- Lead Support of an Azure-based Flask Microservice for Custom “Drag and Drop” Reporting Tool.
- Lead a team of contractors to develop a replacement reporting tool to free up $500k+ in capital expenditure.
- Developed multiple Flask REST APIs for querying PostgreSQL and Azure MSSQL Managed Instances.
- Created automated functional/unit/integration testing with Azure Dev Ops and Pytest.
- Maintained CI/CD pipelines for Azure App Services and Consumption based Functions in Azure Dev Ops.
- Designed and developed an event-driven serverless architecture for report deliveries.
- Worked with a Python NetworkX Path-Algorithm to manage dynamic joining of datasets.
Product Support Specialist
Confidential
Responsibilities:
- End-User account database management for CryWolf False Alarm Management.
- Streamlining and creating new Standard Operating Procedures for the Atlanta False Alarm Reduction Program and New Orleans False Alarm Reduction Program.
- Maintained and built relationships with stakeholders in state/local governments.
- Worked with stakeholders to explain concepts in a simple and easy to understand fashion.
- Dealt with escalations and remediation.
- Acted as a stakeholder for conversations with the developer on improvements to the system.
- Required business and technical understanding of processes.
- Helped target low-cost updates and operations to reduce call volume and increase citizen satisfaction.
- Proposed more advanced, long-term architectural changes such as migrating to document-based storage and flexible on-demand ETL for ingesting data from 3rd Party systems.