Data Engineerskills: Azure Databricks (pyspark), N Resume
3.00/5 (Submit Your Rating)
Austin, TX
SUMMARY
- 7 years of experience in Database Development, Business Intelligence and Data visualization activities.
- Experience in Data Extraction, Transformation and Loading of data from multiple data sources into target databases, using Azure Databricks, Azure SQL, PostgreSql, SQL Server, Oracle
- Expertise in database querying, data manipulation and population using SQL in Oracle, SQL Server, PostgreSQL, MySQL
- Exposure on NiFi to ingest data from various sources, transform, enrich and load data into various destinations
- Experience in Data modeling. Designed databases, tables and views for the application.
- Experience in implementing Triggers, Indexes, Views and Stored procedures.
- Optimized query performance and populated test data.
- Excellent understanding of Software Development Life Cycle and Test Methodologies from project definition to post - deployment.
- Experience in working Agile (Scrum, Sprint) and waterfall methodologies
- Ability to collaborate with testers, business analysts, developers, project managers and other team members in testing complex projects for overall enhancement of software product quality.
- Expertise in Bug tracking using Bug tracking Tools like Request Tracker, Quality Center.
- Conducted website testing and coordinated with clients for successful Deployment of the projects.
- Tested web services using SoapUI, XML
- Functioning as Subject Matter Expert (SME) and acting as point of contact for Functional and Integration testing activities
- Self-starter and team player with excellent communication, problem solving skills, interpersonal skills and a good aptitude for learning.
TECHNICAL SKILLS
Database: SQL Server, Oracle, Postgres, MySQL, DB2
Technologies: Azure, Databricks, Kafka, Nifi, PowerBI, Share point, Azure Storage
Languages: Python, SQL, T-SQL, PL/SQL, HTML, XML
Operating Systems: Windows, Linux, UNIX.
Source Control: Git, Subversion, CVS, VSS.
PROFESSIONAL EXPERIENCE
Confidential, Austin, TX
Data Engineer
Skills: Azure Databricks (PySpark), Nifi, PoweBI, Azure SQL, SQL, SQL Server, Data Visualization, Python, Data Migration
Responsibilities:
- Experience in Developing ETL solutions using Spark SQL in Azure Databricks for data extraction, transformation and aggregation from multiple file formats and data sources for analyzing & transforming the data to uncover insights into the customer usage patterns.
- Experience working on NiFi to ingest data from various sources, transform, enrich and load data into various destinations (kafka, databases etc)
- Worked on visualization dashboards using Power BI, Pivot Tables, Charts and DAX Commands.
- Designed and developed Business Intelligence applications using Azure SQL, Power BI
- Designed and implemented stored procedures, views and other application database code objects.
- Maintained SQL scripts indexes and complex queries for analysis and extraction.
- Expertise in various phases of project life cycles (Design, Analysis, Implementation and testing).
- Participated in Business Requirements gathering and documentation
- Developed and collaborated with others to develop, database solutions within a distributed team
Confidential, Austin, TX
Database Developer
Environment: SQL Server, PostgreSQL, Tableu
Responsibilities:
- Experienced with MySQL and PostGreSQL
- Designed and implemented stored procedures views and other application database code objects.
- Maintained SQL scripts indexes and complex queries for analysis and extraction.
- Performed quality testing and assurance for SQL servers.
- Worked with stakeholders, developers and production teams across units to identify business needs and solution options.
- Created dashboards for analyzing POS data using Tableau 8.0.
- Created Scatter Plots, Stacked Bars, Box and Whisker plots using reference, Bullet charts, Heat Maps, Filled Maps and Symbol Maps according to deliverable specifications.
- Experience with creating Worksheets and Dashboard.
- Experience with Tableau for Data Acquisition and data visualizations.
- Created the Test Evaluation and Summary Reports.
- Experience in BI interactive Dashboard.
- Worked on workbook Permissions, Ownerships and User filters.
Confidential
Junior Database Developer/ Tester
Environment: SQL Server, Oracle
Responsibilities:
- Worked on SQL Server and Oracle databases design and development.
- Created Stored Procedures, Triggers, Functions, Indexes, Views, Joins and T-SQL code for applications.
- Upgraded SQL Server. The database is used to store the information about the company’s financial accounts. Roles include scheduling database backup, recovery, users access, importing and exporting data objects between databases using DTS (data transformation service), linked servers, writing stored procedures, triggers, views etc. for reports.