Database Lead/sr. Etl Developer Resume
SUMMARY
- 11 + years of experience in Design, Development and Management of Business Intelligence (BI) Systems using various Microsoft Technologies having varied Industry experience including Retail and Insurance domain.
- Extensive Experience in IT as a professional specializing in Data Warehouse Developer /Data Architect/ SQL Developer/SSIS/SSRS Reports and Database administration in Windows environment.
- Experience in Application development as well as Product Development
- Having experience in System Architecture, Detail Design, Data Modeling, and Data Integration using SSIS and Data Publishing through BI tools such as SSRS.
- Supported the migration of data from heterogeneous sources and different formats to relational data warehouses, staging databases using complex stored procedures and SSIS.
- Proficient in implementing business logic and batch process in backend using Stored Procedures and Functions.
- Experience with data staging area, delta logic, full load and incremental load with Slowly Changing Dimensions (SCD Type 1, SCD type 2, and SCD Type 3), Cleansing and Data Matching.
- Experience with various data warehouse concepts such as Degenerate Dimensions, Junk Dimensions, Late Arriving, Fixed Hierarchies, Variable Depth Hierarchies, Factless Fact, Grain, Joining Fact Tables, Late Arriving, Star Schema and Snowflake Schema.
- Extensive experience in BI suite using integration services (SSIS) for ETL (Extraction, Transformation & Loading), reporting services (SSRS) for creating different types of reports and analysis services (SSAS) for design and developing complex cubes
- Expert in dimensional data modeling using SSAS and Erwin, cube partitioning, optimization, creating aggregations.
- Experience in Data Extraction, Transforming and loading (ETL) between Homogenous and Heterogeneous System using SQL tools (SSIS, Data Transformation Services (DTS), Bulk Insert, BCP).
- Good Experience in creating Master Child Packages, SSIS Loggings, User Loggings, Breakpoints, Data viewers, Checkpoints and Transactions.
- Experience in Data modeling (Dimensional & Relational) like Star - Schema Modeling, Snowflake Modeling, fact and dimension tables.
- Experience in generating on-demand and scheduled reports for business analysis or management decision using SQL Server Reporting Services (SSRS).
- Actively involved in Processing Data through HIVE and PIG to structural format.
- Expertise in Power BI, Power BI Pro, Power BI Mobile.
- Expert in creating and developing Power BI Dashboards in to rich look
- Developed Power BI model used for financial reporting of P & L and Headcount.
- Designed and documented the entire Architecture of Power bi Poc
- Automated Power Query refresh using power shell script and windows task scheduler.
- Good experience in Designing Aggregations and pre-calculating the Data Warehouse.
- Extensive experience automating administrative tasks using SQL agent, event notifications, and scheduled maintenance plans according to Microsoft best practice.
- Excellent knowledge in migrating data and databases using side by side migrations with methods like attach detach, SSIS packages as well as copy database tasks.
- Experience in Performance Tuning, Query Optimization, Database consistency checks using DBCC utilities.
TECHNICAL SKILLS
RDBMS/DBMS: MS-SQL Server 2012, 2008 R2, 2005.
Database Technologies/Tools: SQL Server Entreprise Manager, Oracle, SQL T-SQL, Data Transformation Services (DTS), OLTP, BCP, SSIS, OLAP
Reporting Tools: Microsoft SQL Server Reporting Services (SSRS).
Data Modelling: SQL Server Analysis Services ( SSAS)
Operating Systems: UNIX,Ubuntu,Windows XP, Windows Server 2003/2008.
Programming Languages: HTML, Visual Studio, VB.NET, T-SQL, Core Java
Design Technologies/Tools: MS Visio, ERWin
Content Manager: Share Point Server,AWS RedShift
Big Data Platform: Apache Hadoop, Hive and PIG
Business Intelligence Tools: Business Intelligence Development Studio
PROFESSIONAL EXPERIENCE
Confidential
Database Lead/Sr. ETL Developer
Responsibilities:
- Develop scalable and reliable data warehousing solutions using Microsoft SQL Technologies. Build and maintain platforms that provide traditional data warehousing, BI and DataMart’s, and email marketing solutions. Deep experience in data warehouse design, ETL programming using SSIS and processing large volumes of data.
- Main responsibility is to develop and maintain a 200 - 400 GB database that is used for driving Marketing Campaigns
- Key responsible for developing unit test and performing developer testing of code changes.
- Responsible for performing peer reviews, and code walk through. Responsible for documenting new development.
- Worked as a self-starter and work independently on technical projects also work collaboratively with project team members through an agile development process that promotes constant team communication.
- Assist in conducting user interview sessions, requirements gathering, and design reviews
Environment: s: Microsoft SQL Server 2014, SSIS Microsoft SQL Server Integration Services, Microsoft SQL Server Reporting Services (SSRS), SQL, T-SQL, DTS, BCP. Current project focuses on migration of data processes from legacy systems to File Recovery Management System (FRMS) that is an Confidential product
Confidential
ETL Lead/Sr. ETL Developer
Responsibilities:
- Created individual SSIS packages to load dimensions, fact tables then created ETL Master package to load data in Data mart
- Created SSIS Packages to load each dimensions, Fact tables, Then Configuring packages using XML, Sql Server, Parent package variable methods
- Deployed SSIS Packages to MSDB under Integration Services Engine, Scheduling those SSIS package for incremental loading of Data mart
- Converted the requirements into an ETL Technical Design document for ETL development using SQL Server.
- Analyzed the source data and worked with the source data team to understand the data.
- Created complex SSIS packages and optimized them to the fullest depth to reflect required business logic to implement designed ETL Strategy.
- Involved in the data warehousing project and provided them with requirements for the reporting database for Business Objects Universe
- Worked on OLAP Data warehouse, Model, Design and Implementation
- Analyzed legacy Data Warehouse data to identify gaps that might hinder the goal of providing reports to the end users
- Designed and Implemented mapping to maintain history in warehouse and to capture the daily changes in the source data. Expertise in using different types of transformations as per requirement
- Converted complex business logic into SQL stored procedures and user-defined functions to achieve functionality required by the UI team.
- Data migration (import & export) from text, CSV and access files to SQL server 2012.
- Prepared and maintained Requirement/gap Analysis Document, Solution Design Document and Solution Architecture Document.
- Worked on agile methodology
Environment: s: Microsoft SQL Server 2012, SSIS Microsoft SQL Server Integration Services, Microsoft SQL Server Reporting Services (SSRS), Microsoft SQL Server Analysis Services (SSAS), Oracle, SQL, T-SQL, DTS, OLTP, BCP, SSIS, OLAP, T-SQL,VB.NET, Flat Files, Excel Sheets, Batch Files, Retail, Performance Analytics.
Confidential, Texas
Sr.BI /ETL/Data warehouse Developer/ SQL Server developer
Responsibilities:
- Converted the requirements into an ETL Technical Design document for ETL development using SQL Server.
- Created Staging Databases as intermediate stages for populating Data Mart to perform various ETL data massaging operations like Data Quality profiling, data Analyst/ data matching.
- Responsible for identifying and defining the Datasets for the report generation, writing the queries for the drill down reports, and identifying and adding the report parameters.
- Created message alerts for execution updates using SMTP connection in SSIS.
- Worked on SQL Server 2012, in implementing the data mart involving new functionality and advancement in T-SQL as well as taking advantage of new features of 2012 BI tool.
- Optimized Stored Procedures by fine tuning joins and using SQL Server Profiler and Database Tuning Advisor for better performance.
- Prepared and maintained Requirement/gap Analysis Document, Solution Design Document and Solution Architecture Document.
- Optimized the performance of various SQL scripts, stored procedures and triggers by using embedded UDFS, CTEs and System stored procedures.
- Reviewed the existing stored procedures and improved efficiency by critically evaluating the code or by replacing them with UDFs to optimize performance of front end applications.
- Performed Index analysis for tables and came up with more efficient solutions to use Clustered and Non-Clustered Indexes for significant performance boost.
- Developed complex reports for various modules using complex stores procedures and UDFs and CTE’s, SSRS.
Environment: Microsoft SQL Server 2012, SSIS Microsoft SQL Server Integration Services, Microsoft SQL Server Reporting Services, Microsoft SQL Server Analysis Services, T-SQL, Visual Studio 2012 C# scripting, Flat Files, Excel Sheets, Batch Files, Retail, Performance Analytics.
Confidential, Schaumburg, Illinois
Data Architect/ SQL Server developer/DW Developer/SSIS Developer
Responsibilities:
- Created complex SSIS packages and optimized them to the fullest depth to reflect required business logic to implement designed ETL Strategy.
- Have managed large terabyte size data warehouse using SQL server.
- Efficiently managed complex SSIS packages by creating logging, checkpoints, transactions, configurations and deployed it on the production server using push and pull deployment methodology.
- Implemented the Master Child Package Model for easier maintenance and better performance.
- Developed several complex stored procedures for better performance and index maintenance.
- Data migration (import & export) from text, CSV files to RedShift.
- Worked on complete SDLC on waterfall methodologies from Extraction, Transformation and Loading (ETL) of data using SSIS.
Environment: SQL RedShift, SSIS Microsoft SQL Server Integration Services, Microsoft SQL Server Reporting Services, T-SQL, Flat Files, XML, Excel Sheets, Batch Files, Retail, Performance Analytics, Data Marts.
Confidential, Colorado
Sr.BI /ETL/Data warehouse Developer/SQL Server developer
Responsibilities:
- Converted the requirements into an ETL Technical Design document for ETL development.
- Analyzed the source data and worked with the source data team to understand the data.
- Created Staging Databases as intermediate stages for populating Data Mart to perform various data massaging operations like Data Quality profiling, data cleansing and data verification /data matching.
- Responsible for identifying and defining the Datasets for the report generation, writing the queries for the drill down reports, and identifying and adding the report parameters.
- Worked on SQL Server 2008 and upgrade to SQL Server 2012, in implementing the data mart involving new functionality and advancement in T-SQL as well as taking advantage of new features of 2008 BI tool.
- Optimized Stored Procedures by fine tuning joins and using SQL Server Profiler and Database Tuning Advisor for better performance.
- Prepared and maintained Requirement/gap Analysis Document, Solution Design Document and Solution Architecture Document.
- Optimized the performance of various SQL scripts, stored procedures and triggers by using embedded UDFS, CTEs and System stored procedures.
- Reviewed the existing stored procedures and improved efficiency by critically evaluating the code or by replacing them with UDFs to optimize performance of front end applications.
- Performed Index analysis for tables and came up with more efficient solutions to use Clustered and Non-Clustered Indexes for significant performance boost.
- Modified SSIS and DTS Packages for transferring data from heterogeneous sources to the staging database.
- Managed Package Configurations using Indirect Configurations to efficiently Promote Unit Tested Packages to Live Environment from Development Environment.
Environment: Microsoft Windows Server 2008 Enterprise Edition, Microsoft SQL Server 2008, SSIS Microsoft SQL Server Integration Services, Microsoft SQL Server Reporting Services, T-SQL,VB.NET, Flat Files, XML, Excel Sheets, Batch Files, Retail, Performance Analytics, Data Marts.