Ms Azure Data Engineer Resume
SUMMARY
- 14+ years in IT having extensive and diverse experience in Microsoft Azure Cloud Computing, SQL BI technologies.
- Hands - on experience in Azure Cloud Services (PaaS & IaaS), Azure Synapse Analytics, SQL Azure, Data Factory, Azure Analysis services, Application Insights, Azure Monitoring, Key Vault, Azure Data Lake .
- Good experience in tracking and logging end to end software application build using Azure Devops.
- Have Data warehousing experience in Business Intelligence Technologies and Database with Extensive Knowledge in Data analysis, TSQL queries, ETL & ELT Process, Reporting Services (using SSRS, Power BI) and Analysis Services using SQL Server 2005 / 2008/2012/2014 /2016 SSIS, SSRS and SSAS, SQL Server Agent.
- Designed Enterprise level data warehouse solutions and lead multiple implementations.
- Has good experience working with 11 to 12 TB ‘s SQL databases.
- Used SQL Azure extensively for database needs in various applications.
- Have good experience designing cloud-based solutions in Azure by creating Azure SQL database, setting up Elastic pool jobs and design tabular models in Azure analysis services.
- Have extensive experience in creating pipeline jobs, schedule triggers using Azure data factory.
- Basic hands-on experience working with Kusto
- Experience developing business intelligence solutions using MS SQL server 2008 & 2012 versions.
- Lead projects involving Installing, Upgrading and Configuring SQL Server Databases.
- Worked in OLTP & OLAP environment that includes Production (24x7), QA and development databases in SQL Server.
- Excellent in High Level Design of ETL DTS Packages & SSIS Packages for integrating data using OLE DB connection from heterogeneous sources like (Excel, CSV, Oracle, flat file, Text Format Data) by using multiple transformations provided by SSIS such as Data Conversion, Conditional Split, Bulk Insert, Merge and union all.
- Experience in working with SSAS in creating cubes, data source views, named queries, dimensions and deploying of analysis services projects.
- Delivered BI reporting solutions in Power BI, Reporting Services (SSRS).
- Generated reports and charts by connecting to different data sources like excel, sq. server and implemented drill down functionality using Power BI tool.
- Implemented drill down functionality by building hierarchies in Power BI visualizations.
- Have experience in building dashboards using power bi service.
- Developing reports on SSRS on SQL Server (2000/ 2005/2008/2012 ). Designed and developed various Service management reports, utilizing dynamic and cascading Prompts, sub-reports, charts, Formulas, parameterized reports, Navigation reports and dynamic reports using SSRS.
- Extensive experience in T-SQL to write: stored procedures, triggers, functions, tables, views, indexes and relational database models.
- Proven ability in Performance Tuning, Query Optimization.
- Involved in the full life cycle of software design process of other projects, including prototyping, proof of concepts, design, interface implementation, testing and maintenance.
- Good experience on maintain version control using SVN tool & Azure Devops.
- Worked on Autosys jobs.
- Worked as a project coordinator between IT and business users by converting business requirements to technical specifications and proposed feasible solutions.
- PMP Certified Professional.
- As part of project management have good knowledge on Cost Management techniques involved in projects.
TECHNICAL SKILLS
Cloud Computing: Microsoft Azure - Cloud Services (PaaS & IaaS), Active Directory, Application Insights, Azure Monitoring, Azure Search, Data Factory, Key Vault and SQL Azure, Azure Devops, Azure Analysis services, Azure Synapse Analytics(DW), Azure Data Lake .
Database Development & BI Tools: SQL, T-SQL, SSIS, SSRS, SQL Server Management Studio (SSMS) 2016/2014, SQL Server Job Agent, Import and Export Data, Linked Servers, Oracle Exadata, Amazon Redshift.
IDE Tools: Visual Studio 2015/2013, TFS, IIS, Visio, SVN
Reporting Tools: SSRS, Power BI reports, Excel
PROFESSIONAL EXPERIENCE
Confidential
MS Azure Data Engineer
Responsibilities:
- Designed and Configured Azure Cloud relational servers and databases analyzing current and future business requirements.
- Worked on migration of data from On-prem SQL server to Cloud databases (Azure Synapse Analytics (DW) & Azure SQL DB).
- Have good experience in setting up separate application and reporting data tiers across servers using Geo replication functionality.
- Implemented Disaster Recovery and Failover servers in Cloud by replicating data across regions.
- Have extensive experience in creating pipeline jobs, scheduling triggers, Mapping data flows using Azure Data Factory(V2) and using Key Vaults to store credentials.
- Good experience in creating Elastic pool databases and schedule Elastic jobs for executing TSQL procedures.
- For Log analytics and for better query response used Kusto Explorer and created alerts using Kusto query language.
- Worked on creating tabular models on Azure analysis services for meeting business reporting requirements.
- Have good experience working with Azure BLOB and Data lake storage and loading data into Azure SQL Synapse analytics (DW).
- Designed SSIS Packages using Business Intelligence Development Studio (BIDS) to extract data from various data sources and load into SQL Server 2012 & 2016 database for further Data Analysis and Reporting by using multiple transformations.
- Worked on creating correlated and non-correlated sub-queries to resolve complex business queries involving multiple tables from different databases.
- Developed business intelligence solutions using SQL server data tools 2015 & 2017 versions and load data to SQL & Azure Cloud databases.
- Perform analyses on data quality and apply business rules in all layers of data extraction transformation and loading process.
- Perform validation and verify software at all testing phases which includes Functional Testing, System Integration Testing, End to End Testing, Regression Testing, Sanity Testing, User Acceptance Testing, Smoke Testing, Disaster Recovery Testing, Production Acceptance Testing and Pre-prod Testing phases.
- Have good experience in logging defects in Jira and Azure Devops tools.
- Involved in planning cutover strategy, go-live schedule including the scheduled release dates of Portfolio central Datamart changes.
Skills: Microsoft SQL Server 2012, 2016, SSDT-2012 &2015, Azure Synapse Analytics, Azure Data Lake & BLOB, Azure SQL, Azure data factory, Azure analysis services, BIDS.
Confidential
SQL Server BI Lead developer
Responsibilities:
- Involved in designing, developing and deploying SSIS packages in MS SQL server environment using SSIS -2008 R2.
- Using ETL (SSIS) to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
- Created databases and schema objects including tables, indexes and applied constraints, connected various applications to the database and written functions, stored procedures and triggers.
- Designed SSIS packages to transfer data from flat files, excel files and oracle source to SQL server using BIDS.
- Using at unity drivers and PostgreSQL drivers for connecting to Oracle and Denodo servers.
- Implementation of MS SQL server 2008 R2 management studio to create complex stored procedures, User defined functions (UDF’s), views using T-SQL.
- Creating complex ETL packages using SSIS to extract data from staging tables to partitioned tables with incremental loads.
- Performed operations like data reconciliation, validation and error handling after extracting data into SQL Server.
- Working on creating PL/SQL procedures and packages using Oracle 11 i.
- Working on building visuals and dashboards using Power BI reporting tool.
Skills: Microsoft SQL Server 2008 R2, SSIS, Oracle 11i, Power Bi
Confidential
SQL Server BI Lead developer
Responsibilities:
- Designing ETL architecture and developed capacity-planning and trending-data warehousing solution to load data from multiple sources into Data warehouse.
- Design SQL 2008,2012 SSIS Packages, design SSAS OLAP Cubes, SSRS Reports database schema, tables, views, stored procedures, triggers, functions
- Proposed solutions to improve system efficiencies and reduce processing times.
- Experienced in building conceptual, logical and physical data models using Erwin data model tool.
- Created mapping documents to outline data flow from sources to targets.
- Experienced working with 15 to 20 TB ‘s SQL databases.
- Have good experience in applying Lookups, Merge, Cache, Data conversion, Union etc. transformations for standardizing the data using SSIS.
- Have good experience working with different data flow sources (flat file, excel, OLÉ DB source) and destinations (OLE DB, Oracle destination, SQL server destination, Flat file destination etc.).
- Extensive knowledge of using data profiling tasks for cleansing data, slowly changing dimension and optimizing long running SSIS packages.
- Involved in Analyzing, designing, building &, testing of OLAP cubes with SSAS 2008.
- Designed and implemented data mart, facts, dimensions and OLAP cubes using dimensional modeling standards in SQL Server 2005/2008/2012 that maintained data.
- Involved in the complete data warehouse development life cycle. Actively supported business users for change requests.
- Developed complex SQL queries using stored procedures, common table expressions (CTEs), temporary table to support Power BI and SSRS reports.
- Integrated Custom Visuals based on business requirements using Power BI desktop.
- Provided continued maintenance and development of bug fixes for the existing and new Power BI Reports.
- Generated drilldown, drill through and parameterized reports using SSRS 2008.
- Extensively worked on SSRS and delivered complex reports from different data sources such as SQL Database and Cubes.
- Work with business owners and analysts in planning and estimating throughout the complete life cycle, review the business requirements and as well as identify and evaluate alternatives and present the most efficient and cost-effective solution.
- Worked on data migration from SQL server to Oracle 11i and created PL/SQL procedures.
- Has done performance tuning by creating indexes, temporary tables, Partition functions, table variables.
- Monitored performance alerts in production using IDERA monitoring tool.
- Worked with different Front Office Source systems like EUCLID, TOTORO, VIPER, and VENOM and collected business requirements.
- Involved in MONJU used for calculating VAR (Value at Risk) in Risk Management.
- Participated in QA, UAT and production testing phases by developing integration test scripts and test plans and ensure the testing results correspond to the business expectations.
- Created Autosys jils for development and production environment.
- Organized and participated in AGILE SCRUM meetings.
- Worked on importing data from Microsoft access to SQL server database.
- Application testing and troubleshooting/debugging.
Skills: Microsoft SQL Server 2008/2012/2014 , SSIS, SSRS, SSAS, Oracle 11i, Idera, Power BI
Confidential
SQL Server BI Lead developer
Responsibilities:
- Designing ETL architecture and developed capacity-planning and trending-data warehousing solution to load data from multiple sources into Data warehouse.
- Design SQL 2008,2012 SSIS Packages, design SSAS OLAP Cubes, SSRS Reports database schema, tables, views, stored procedures, triggers, functions
- Proposed solutions to improve system efficiencies and reduce processing times.
- Experienced in building conceptual, logical and physical data models using Erwin data model tool.
- Created mapping documents to outline data flow from sources to targets.
- Experienced working with 15 to 20 TB ‘s SQL databases.
- Have good experience in applying Lookups, Merge, Cache, Data conversion, Union etc. transformations for standardizing the data using SSIS.
- Have good experience working with different data flow sources (flat file, excel, OLÉ DB source) and destinations (OLE DB, Oracle destination, SQL server destination, Flat file destination etc.).
- Extensive knowledge of using data profiling tasks for cleansing data, slowly changing dimension and optimizing long running SSIS packages.
- Involved in Analyzing, designing, building &, testing of OLAP cubes with SSAS 2008.
- Designed and implemented data mart, facts, dimensions and OLAP cubes using dimensional modeling standards in SQL Server 2005/2008/2012 that maintained data.
- Involved in the complete data warehouse development life cycle. Actively supported business users for change requests.
- Developed complex SQL queries using stored procedures, common table expressions (CTEs), temporary table to support Power BI and SSRS reports.
- Integrated Custom Visuals based on business requirements using Power BI desktop.
- Provided continued maintenance and development of bug fixes for the existing and new Power BI Reports.
- Generated drilldown, drill through and parameterized reports using SSRS 2008.
- Extensively worked on SSRS and delivered complex reports from different data sources such as SQL Database and Cubes.
- Work with business owners and analysts in planning and estimating throughout the complete life cycle, review the business requirements and as well as identify and evaluate alternatives and present the most efficient and cost-effective solution.
- Worked on data migration from SQL server to Oracle 11i and created PL/SQL procedures.
- Has done performance tuning by creating indexes, temporary tables, Partition functions, table variables.
- Monitored performance alerts in production using IDERA monitoring tool.
- Worked with different Front Office Source systems like EUCLID, TOTORO, VIPER, and VENOM and collected business requirements.
- Involved in MONJU used for calculating VAR (Value at Risk) in Risk Management.
- Participated in QA, UAT and production testing phases by developing integration test scripts and test plans and ensure the testing results correspond to the business expectations.
- Created Autosys jils for development and production environment.
- Organized and participated in AGILE SCRUM meetings.
- Worked on importing data from Microsoft access to SQL server database.
- Application testing and troubleshooting/debugging.
Skills: Microsoft SQL Server 2008/2012/2014 , SSIS, SSRS, SSAS, Oracle 11i, Idera, Power BI
Confidential, TX
BI Lead, Developer, Administrator
Responsibilities:
- Design technical solution approach for the requirements gathered from the client.
- Designed SQL SSIS 2008 Packages in Business Intelligence Development Studio (BIDS), to extract data from various data sources such as Oracle, SAP and flat files into SQL Server 2008 for further Data Analysis and Reporting by using multiple transformations
- Building Cubes and reports using SSAS and SSRS 2008.
- Creation of master scripts for the procedures, functions, views.
- Have good experience in creating Star schema cubes using SSAS.
- Extensively worked on OLAP cubes using SSAS.
- Created and Managed OLAP Cubes using SSAS.
- Involved in creating calculated members, named set, advanced KPI’S for the SSAS cubes.
- Used Joins, correlated and non-correlated sub-queries for complex business queries involving multiple tables from different databases.
- Implemented Functions, views, triggers and stored procedures and enforced business rules via checks and constraints.
- Created indexes on selective columns to speed up queries and analyses in SQL Server Management Studio.
- Involved in the modeling of the Subject areas
- Coordinating/Assigning the work from onshore to offshore through calls and meetings.
- Monitoring Jobs, Packages, backups, schedule as a DBA.
Skills: Microsoft SQL Server 2008/2012/2014 , SSIS, SSRS, SSAS, SQL server profiler