SUMMARY

• Overall 9+ years of experience in BI Development, Analysis Datacenter Migration, Azure Data Factory (ADF) V2. Managing Database, Azure Data Platform services (Azure Data Lake (ADLS), Data Factory (ADF), Data Lake Analytics, Stream Analytics, Azure SQL DW, Azure Synapse, HDInsight/Databricks, NoSQL DB), SQL Server, Oracle, Data Warehouse etc.
• Build multiple Data Lakes. Build how the data will be received, validated, transformed and then published
• Experience in implementing hybrid connectivity between Azure and on - premises using virtual networks, VPN and Express Route
• Plan and Develop roadmaps and deliverables to advance the migration of existing solutions on-premises systems/applications to Azure cloud
• Experience with Azure transformation projects and Azure architecture decision making Architect and implement ETL and data movement solutions using Azure Data Factory (ADF), SSIS, Azure Synapse
• Develop Power BI reports & effective dashboards after gathering and translating end user requirements
• Recreating existing application logic and functionality in the Azure Data Lake, Data Factory, SQL Database and SQL data warehouse environment
• Develop dashboards and visualizations to help business users analyze data as well as providing data insight to upper management with a focus on Confidential products like SQL Server Reporting Services (SSRS) and Power BI.
• Engage with business users to gather requirements, design visualizations and provide training to use self-service BI tools.
• Developed and maintained multiple Power BI dashboards/reports and content packs
• Created POWER BI Visualizations and Dashboards as per the requirements
• Used various sources to pull data into Power BI such as SQL Server, Excel, Oracle, SQL Azure etc.
• Plan and Develop roadmaps and deliverables to advance the migration of existing solutions on-premises systems/applications to Azure cloud
• Architect & implement medium to large scale BI solutions on Azure using Azure Data Platform services (Azure Data Lake, Data Factory, Azure Synapse, Data Lake Analytics, Stream Analytics, Azure SQL DW, HDInsight/Databricks, NoSQL DB)
• Propose architectures considering cost/spend in Azure and develop recommendations to right-size data infrastructure
• Datacenter Migration, Azure Data Services have strong virtualization experience
• Experience in troubleshooting and resolving architecture problems including database and storage, network, security and applications
• Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL
• Implement ad-hoc analysis solutions using Azure Data Lake Analytics/Store, HDInsight
• Design & implement migration strategies for traditional systems on Azure (Lift and shift/Azure Migrate, other third-party tools) worked on Azure suite: Azure SQL Database, Azure Data Lake(ADLS), Azure Data Factory(ADF) V2, Azure SQL Data Warehouse, Azure Service Bus, Azure key Vault, Azure Analysis Service(AAS), Azure Blob Storage, Azure Search, Azure App Service, Azure data Platform Services.
• Design and implement end-to-end data solutions (storage, integration, processing, visualization) in Azure
• Experience managing Azure Data Lakes (ADLS) and Data Lake Analytics and an understanding of how to integrate with other Azure Services. Knowledge of USQL and how it can be used for data transformation as part of a cloud data integration strategy
• Experience in writing Spark SQL queries to validate data
• Experience in Hive to create HDinsights pipelines.
• Establish database standards for operations, upgrades, migrations and onboarding new applications and/or customers
• Data validation in the ADB by using PYspark, python and sql.
• Develop workload migration plan in conjunction with other technical teams
• Design and implement streaming solutions using Kafka or Azure Stream Analytics
• Code and automation create to New System for scaling deployment mission critical operation of Cloud
• Develop, test, and maintain SQL queries, and stored procedures built and with established standards
• Experience with MS SQL Server Integration Services (SSIS), T-SQL skills, stored procedures, triggers
• Deploying Azure Resource Manager JSON Templates from PowerShell
• Azure Analysis Services (SSAS) and SQL Server Reporting Services (SSRS) and Familiarity with Excel PowerPivot, Power View, and PowerBI
• Experience in Performance Tuning and Optimization (PTO), Confidential Hyper-V virtual infrastructure
• Ensures compliance to server specific architectural standards and implementation practices
• Creates and maintains Disaster Recovery procedures and participates in periodic disaster recovery testing
• Utilize automation tool such as Terraform, Ansible, or similar
• Worked in mixed role Azure requirement gathering analyst, ETL tester and data engineering
• Collaborate with application architects on infrastructure as a service (IaaS) applications to Platform as a Service (PaaS)
• Deploying Azure Resource Manager JSON Templates from PowerShell
• Configuring SQL Azure firewall for security mechanism
• Created Azure SQL database, performed monitoring and restoring of Azure SQL database. Performed migration of Confidential SQL server to Azure SQL database.
• Azure Data Factory (ADF), Integration Run Time (IR), File System Data Ingestion, Relational Data Ingestion
• Migration of on-premise data (Oracle/ SQL Server/ DB2/ MongoDB) to Azure Data Lake Store (ADLS) using Azure Data Factory (ADF V1/V2).

TECHNICAL SKILLS

Azure Cloud: Azure SQL Database, Azure Data Lake, Azure Data Factory(ADF), Azure SQL Data Warehouse, Azure Service Bus, Azure Analysis Service(AAS), Azure Blob Storage, Azure Search, Azure App Service, Redis Cache using Pipeline and SSIS, infrastructure-as-a-Service(IaaS),Database-as-a-Service(DBaaS),Data Migration Service(DMS), Azure SQL Data, Elastic Pools, Geo Replication .Geo-restore, J SON,ARM template, SQL Data Synch, Azure Cli, Azure SQL Analytics, Azure Synapse, Azure Network components (virtual network, network security group, User defined Route, Gateway, Load Balancer etc., Virtual Machines, Express Route, Traffic Manager, VPN, Load Balancing, Auto Scaling

ETL Tools: Azure Data Factory (ADF), Azure Database migration Service (DMS), ETL SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), ETL Extract Transformation and Load., Business Intelligence (BI).

Storage: Azure Storage, Azure Blob Storage, Azure Backup, Azure Storage Disks- Premium, Azure Files, Azure Data Lake Storage Gen 1, AWS S3 Cloud Storage, AWS EBS, AWS Storage gateway, NETApp/EMC Storage Technologies, SAN

Performance Monitoring Tools used: Azure SQL Analytics, SQLSentry One, Spotlight, IDERA, Solar Winds, Red Gate, Lite Speed, SQL Sentry One, IBM Tivoli TSM, Doubletake, SQL Server Profiler, System Monitor, Tivoli Monitoring, BMC Patrol, Lumigent Entegra, Informix, AWS Cloud Watch, Goden Gate etc.

Operating System: Azure Virtual Machine (VM), Windows Server 2016, Windows Server 2012, Windows 2008 R2, /2000 Server(64bit), Windows 2000 Advanced Server server, Windows XP, Unix, LINUX. Shell Script, AWS EC2

Scripting: Windows Power Shell, Shell Script, AZURE CLI, Transact SQL, AWS CLI, UNIX, Phython, Pyspark, SQL, Hive, Spark

Cloud Computing: Confidential Azure Cloud technologies, Azure Backup AWS (Amazon web Services) Data Modeling logical and physical Data Modeling /Database design using Erwin and Visio etc.

AWS: EC2, VPC, EBS, S3, IAM, Auto Scaling Group, opsWorks, AMI (Amazon Machine Image), Cloud formation template, CloudTrail, SNS, Route 53, cloud Formation, CloudTrail, CloudWatch

Databases: Azure SQL Database, AZURE data warehouse, Azure Data azure data factory, Azure Data Synch, Elastic Pools, SQL Server 2017,Oracle EBS R12, Oracle EBS 11i,SQL Server 2016, SQL Server 2014, SQL Server 2012,2008 R2, SQL 2005,2000,Azure SQL Database, RDBMS, Azure Synapse, Confidential Azure VM, Business Intelligence(BI), Amazon Web Service (AWS), AWS Cloud Watch,Oracle11g, MYSQL 5.x, MS Access, OLAP, OLTP, AWS RDS,AWS Cloud, Confidential Azure Cloud

PROFESSIONAL EXPERIENCE

Confidential, Atlanta, GA

Azure Data Engineer/PowerBI

Responsibilities:

• Writing Scope script to read and load the data into Cosmos portal.
• Analyze, design, and build Modern data solutions using Azure PaaS service to support visualization of data. Understand current Production state of application and determine the impact of new implementation on existing business processes.
• Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL and U-SQL Azure Data Lake Analytics. Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure Synapse, Azure SQL, Azure DW) and processing the data in InAzure Databricks.
• Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform, and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.
• Developed Spark applications usingPysparkandSpark-SQLfor data extraction, transformation, and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.
• Responsible for estimating the cluster size, monitoring, and troubleshooting of the Spark databricks cluster.
• Experienced in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning.
• To meet specific business requirements wrote UDF’s inScalaandPyspark.
• Developed JSON Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the data using the Sql Activity.
• Hands-on experience on developing SQL Scripts for automation purpose.
• Created Build and Release for multiple projects (modules) in production environment using Visual Studio Team Services (VSTS).

Confidential

Azure Data Engineer/ PowerBI

Responsibilities:

• Design and implement end-to-end data solutions (storage, integration, processing, visualization) in Azure
• Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL
• Move data from both on-premises and cloud source data stores (Azure data lake storage and Azure blob storage)
• Architect & implement medium to large scale BI solutions on Azure using Azure Data Platform services (Azure Data Lake, Data Factory, Data Lake Analytics, Stream Analytics, Azure SQL DW, HDInsight/Databricks, NoSQL DB)
• Design & implement migration strategies for traditional systems on Azure (Lift and shift/Azure Migrate, other third-party tools
• Develop conceptual solutions & create proof-of-concepts to demonstrate viability of solutions
• Technically guide projects through to completion within target timeframes
• Collaborate with application architects and DevOps
• Identify and implement best practices, tools and standards
• Architect and implement ETL and data movement solutions using Azure Data Factory, SSIS create and run SSIS Package ADF V2 Azure-SSIS IR
• Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL
• Recreating existing application logic and functionality in the Azure Data Lake, Data Factory, SQL Database and SQL Datawarehouse environment. experience in DWH/BI project implementation using Azure DF
• Migrate data from traditional database systems to Azure databases
• Interacts with Business Analysts, Users, and SMEs on requirements
• Installed and configuredHadoopMapreduceHDFS Developed multipleMapReducejobs in java for data cleaning and preprocessing.
• Installed and configuredPigand also writtenPigLatinscripts.
• WroteMapReducejob usingPig Latin.
• Involved in managing and reviewing Hadoop log files.
• Imported data usingSqoopto load data fromMySQLto HDFS on regular basis.
• Developing Scripts and Batch Job to schedule various Hadoop Program.
• WrittenHive queriesfor data analysis to meet the business requirements.
• CreatingHive tablesand working on them usingHive QL.
• Importing and exporting data intoHDFSandHiveusingSqoop.
• Experienced in defining job flows.
• Got good experience withNOSQLdatabaseSOLRHBase.
• Involved in creatingHivetables loading with data and writing hive queries which will run internally in map reduce way.
• Developed a custom FileSystem plug in for Hadoop so it can access files on Data Platform.
• This plugin allowsHadoopMapReduce programs HBase Pigand Hive to work unmodified and access files directly.
• Designed and implementedMapreduce-based large-scale parallel relation-learning system
• Extracted feeds form social media sites such as Facebook Twitter using Python scripts.
• Setup and benchmarkedHadoop/HBaseclusters for internal use
• Identify potential problems and recommend alternative technical solutions
• Participating in Technical Architecture Documents, Project Design and Implementation Discussions
• Azure Automation through Runbooks Creation, Migration of existing .PS1 scripts, Authorizing, Configuring, Scheduling
• Migration of on-premise data (Oracle/ SQL Server/ DB2/ MongoDB) to Azure Data Lake Store (ADLS) using Azure Data Factory (ADF V1/V2).
• Configuring Network Security Groups (NSG).
• Work within and across Agile teams to design, implement, test and support technical solutions across a full stack of technologies
• Work closely across teams (Support, Solution Architecture) and peers to establish and follow best practices while solving customer problems
• Collaborate with application architects on infrastructure as a service (IaaS) applications to Platform as a Service (PaaS)
• Design and implementation of High Availability (HA) systems (24x7x365) an
• Expertise in setup High Availability and Recoverability of databases using with SQL Server technologies includingAlways on Azure VM
• Architect, design and validate Azure infrastructure-as-a-Service (IaaS) environment
• Worked with Azure transformation project and Azure architecture decision
• Cloud Security Architecture, Governance, Best practices and tools
• Azure Cloud Build and Automation using ARM template
• Deploying Azure Resource Manager JSON Templates from PowerShell worked on Azure suite: Azure SQL Database, Azure Data Lake, Azure Data Factory, Azure SQL Data Warehouse, Azure Analysis Service
• Design Setup maintain Administrator the Azure SQL Database, Azure Analysis Service, Azure SQL Data warehouse, Azure Data Factory, Azure SQL Data warehouse
• Worked on SQL Server Integration Services (SSIS), SSAS, SSRS, T-SQL skills, stored procedures, triggers
• SQL Server Analysis Services (SSAS) and SQL Server Reporting Services (SSRS) and Familiarity with Excel PowerPivot, PowerView, and PowerBI
• Build Complex distributed systems involving huge amount data handling, collecting metrics building data pipeline, and Analytics

Confidential

BI/Azure Developer

Responsibilities:

• Design and implement end-to-end data solutions (storage, integration, processing, visualization) in Azure
• Architect and implement ETL and data movement solutions using Azure Data Factory, SSIS
• Develop dashboards and visualizations to help business users analyze data as well as providing data insight to upper management with a focus on Confidential products like SQL Server Reporting Services (SSRS) and Power BI.
• Engage with business users to gather requirements, design visualizations and provide training to use self-service BI tools.
• ConfiguredOracle EBS GL, AP modules in R12Environment
• Developed and maintained multiple Power BI dashboards/reports and content packs
• Created POWER BI Visualizations and Dashboards as per the requirements
• Used various sources to pull data into Power BI such as SQL Server, Excel, Oracle, SQL Azure etc.
• Propose architectures considering cost/spend in Azure and develop recommendations to right-size data infrastructure
• Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL
• Migrate data from traditional database systems to Azure SQL databases
• Implement ad-hoc analysis solutions using Azure Data Lake Analytics/Store, HDInsight
• Design and implement streaming solutions using Kafka or Azure Stream Analytics
• Design and develop data visualizations in Power BI
• Prepare documentation and architectural designs
• Propose architectures that consider cost/spend in Azure and develop recommendations to right-size Azure data infrastructure
• Work with similar Confidential on-prem data platforms, specifically SQL Server and related technologies such as SSIS, SSRS, and SSAS
• Design & implement data security and governance policies and standards
• Migrate data from traditional database systems to Azure databases
• Recreating existing application logic and functionality in the Azure Data Lake, Data Factory, SQL Database and SQL Datawarehouse environment. experience in DWH/BI project implementation using Azure DF
• Interacts with Business Analysts, Users, and SMEs on requirements
• Designs Logical and Physical Data Model for Staging, DWH and Data Mart layer.
• Recommend, Design and construct policies and standards that impact infrastructure operations and services but also improve overall business performance. (Strategic)
• Develop dashboards and visualizations to help business users analyze data as well as providing data insight to upper management with a focus on Confidential products like SQL Server Reporting Services (SSRS) and Power BI.
• Engage with business users to gather requirements, design visualizations and provide training to use self-service BI tools.
• Developed and maintained multiple Power BI dashboards/reports and content packs
• Created POWER BI Visualizations and Dashboards as per the requirements
• Used various sources to pull data into Power BI such as SQL Server, Excel, Oracle, SQL Azure etc.
• Propose architectures considering cost/spend in Azure and develop recommendations to right-size data infrastructure
• Experience managing Azure Data Lakes (ADLS) and Data Lake Analytics and an understanding of how to integrate with other Azure Services. Knowledge of USQL and how it can be used for data transformation as part of a cloud data integration strategy
• Participating in Technical Architecture Documents, Project Design and Implementation Discussions
• Azure Automation through Runbooks Creation, Migration of existing .PS1 scripts, Authorizing, Configuring, Scheduling
• Dev Ops tools, processes and best practices including automation of resource provisioning/maintenance
• Compute and Storage area in multi-platform environment such as Linux and Windows
• Design and implementation of High Availability (HA) systems (24x7x365) and Disaster Recovery models (DR): including Setup, Configuration, and Monitoring of Database Recovery strategies such as AlwaysOn, Failover Clustering, Replication, Log Shipping and Database Mirroring

Confidential

Data Analyst

Responsibilities:

• Created complexSQL stored procedures using Confidential SQL Server 2008 and 2008 R2
• Worked with Technical Architects and Database Analysts for the Design of Summary tables required for efficient Report Design.
• Designed the functional and technical documents, report templates and reporting standards for the developers to work on the report development.
• Experience in developing reports using SSRS 2008 and SSRS 2008 R2
• Created cubes and dimensions and measures and calculated measures according to the business requirements.
• Created SSIS packages to Oracle and other SQL Server instances in SSIS2008.
• Performed the task of data transfer from files in remote server to folders in another server using FTP.
• UsingSSIS, loaded XML data to the Database tables and Extracting Data usingSSISinto Excel Files for Marketing purpose
• Generated reports from the cubes by connecting to Analysis server from SSRS.
• Developed the SQL Server Integration Services (SSIS) packages to transform data from SQL 2000 to MS SQL 2005 as well as Created interface stored procedures used in SSIS to load/transform data to the database.
• Worked on T-SQL programming, stored procedures, user-defined functions, cursors, views setup and management of linked servers to Non-SQL-Server databases.
• Involved in Report Authoring, Report Delivery (using both Pull and Push strategy) and Report Management for various types of reports