SUMMARY:

• Offering 9+ Years of experience can be headhunted for a Lead level position across any functional sectors within an IT organization of repute
• Experience on Migrating SQL database to Azure data Lake, Azure data lake Analytics, Azure SQL Database, Data Bricks and Azure SQL Data warehouse and Controlling and granting database access and Migrating On premise databases to Azure Data lake store using Azure Data factory.
• Experience in Developing Spark applications using Spark - SQL in Databricks for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.
• Good understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, Driver Node, Worker Node, Stages, Executors and Tasks.
• Good understanding of Big Data Hadoop and Yarn architecture along with various Hadoop Demons such as Job Tracker, Task Tracker, Name Node, Data Node, Resource/Cluster Manager, and Kafka (distributed stream-processing) .
• Experience in Database Design and development with Business Intelligence using SQL Server 2014/2016, Integration Services (SSIS), DTS Packages, SQL Server Analysis Services (SSAS), DAX, OLAP Cubes, Star Schema and Snowflake Schema.
• Excellent communication skills with excellent work ethics and a proactive team player with a positive attitude.
• Domain Knowledge of Finance, Logistics and Health insurance.
• Strong skills in visualization tools Power BI, Confidential Excel - formulas, Pivot Tables, Charts and DAX Commands.
• Expertise in various phases of project life cycles (Design, Analysis, Implementation and testing).
• Led database administration and database performance tuning efforts to provide scalability and accessibility in a timely fashion, provide 24/7 availability of data, and solve end-user reporting and accessibility problems.

SKILLS:

• Azure Data lake, Data factory
• Azure Databricks, Azure SQL database, Azure SQL Datawarehouse
• Programming Scala, Python, Spark SQL
• MSBI (SSIS, SSAS, SSRS)
• Data Visualization
• Data Migration
• SQL Server programming
• Confidential Power BI
• Analytic Problem-Solving

PROFESSIONAL EXPERIENCE:

Confidential, Redmond, WA

Azure Data Engineer

Responsibilities:

• Analyze, design and build Modern data solutions using Azure PaaS service to support visualization of data. Understand current Production state of application and determine the impact of new implementation on existing business processes.
• Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL and U-SQL Azure Data Lake Analytics . Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in In Azure Databricks.
• Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.
• Developed Spark applications using Pyspark and Spark-SQL for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.
• Responsible for estimating the cluster size, monitoring and troubleshooting of the Spark databricks cluster.
• Experienced in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning.
• To meet specific business requirements wrote UDF’s in Scala and Pyspark.
• Developed JSON Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the data using the Sql Activity.
• Hands-on experience on developing SQL Scripts for automation purpose.
• Created Build and Release for multiple projects (modules) in production environment using Visual Studio Team Services (VSTS).

Confidential, Richmond, VA

Data Engineer

Responsibilities:

• Designed SSIS Packages to transfer data from flat files, Excel SQL Server using Business Intelligence Development Studio.
• Extensively used SSIS transformations such as Lookup, Derived column, Data conversion, Aggregate, Conditional split, SQL task, Script task and Send Mail task etc.
• Performed data cleansing, enrichment, mapping tasks and automated data validation processes to ensure meaningful and accurate data was reported efficiently.
• Creating dashboards Actuals vs Goals for Fundraising and Biomed, and Organization 360 with power BI.
• Developed complex calculated measures using Data Analysis Expression language (DAX).

Confidential, CA

SQL BI Developer

Responsibilities:

• Involved in complete Software Development Life Cycle (SDLC) process by analyzing business requirements and understanding the functional workflow of information from source systems to destination systems.
• Designed and developed SSIS Packages to import and export data from MS Excel, SQL Server 2012 and Flat files.
• Involved in complete SSIS life cycle in creating SSIS packages, building, deploying and executing the packages in both the environments (Development and Production).
• Used various Transformations in SSIS Dataflow, Control Flow using for loop Containers and Fuzzy Lookups etc.
• Involved in ETL architecture enhancements to increase the performance using query optimizer.

Confidential, Chicago, IL

MS SQL/MSBI Developer

Responsibilities:

• Analyzed business requirements, facilitating planning and implementation phases of the OLAP model in Team meetings
• Participated in Team meetings to ensure a mutual understanding with business, development and test teams.
• Encapsulated frequently executed SQL statements into stored procedures to reduce the query execution times.
• Created SSIS packages to implement error/failure handling with event handlers, row redirects, and loggings.
• Managed packages the in SSISDB catalog with environments; automated deployment and execution with SQL agent jobs.
• Involved in the design of Data-warehouse using Star-Schema methodology and converted data from various sources to Sql tables.
• Designed complex data intensive reports in Power BI utilizing various graph features such as gauge, funnel.

Confidential, Houston, TX

Sr MSBI/Power BI Developer

Responsibilities:

• Obtained user approvals from the client for the collected requirements to ensure similar understanding between development team and business.
• Extensively utilized SSIS packages to create complete ETL process and load data into database which was to be used by Reporting Services.
• Identified the dimension, fact tables and designed the data warehouse using star schema.
• Developed Multi-Dimensional Objects (Cubes, Dimensions) using SQL Server Analysis Services (SSAS).

Confidential

ETL BI Developer

Responsibilities:

• Participated in discussions with Team leader, Group Members and Technical Manager regarding any Technical and Business Requirement issues.
• Developed SSIS packages to Extract, Transform and Load (ETL) data into the data warehouse database from heterogeneous databases/data sources.
• Creating, maintaining the users, roles and granting privileges.

Environment: s: MS SQL Server 20012, SSIS, SSRS, MS Visual Studio 2012, Confidential office

Confidential

Sr MSBI Developer

Responsibilities:

• Designed and developed various SSIS packages (ETL) to extract and transform data and involved in Scheduling SSIS Packages.
• Created ETL metadata reports using SSRS, reports include like execution times for the SSIS packages, Failure reports with error description.
• Created OLAP applications with OLAP services in SQL Server and build cubes with many dimensions using both star and snowflake schemas