Senior Data Engineer /redshift Consultant Resume
Mclean, VA
SUMMARY:
- Confidential Certified Database Administrator/ETL/DW Developer with 10+ years of IT experience in development, analysis, design, testing, presentation and implementation experience using Confidential Redshift, Confidential RDS, SQL Server 2016/2012/2008 R2, Oracle 10g/9i and SQL Server Data tools.
- Strong Experience in implementing Data warehouse solutions in Confidential Redshift; Worked on various projects to migrate data from on premise databases to Confidential Redshift, RDS and S3.
- Involved in all the stages of Software Development Life Cycle Primarily in Database Architecture, Logical and Physical modeling, Data Warehouse/ETL development using MS SQL Server 2012/2008R2/2008, Oracle 11g/10g, and ETL Solutions/Analytics Applications development.
- Experience with Unix/Linux systems with scripting experience and building data pipelines
- Extensive experience in designing, developing, and delivering business intelligence solutions using SQL SEERVER Data tools /SQL Server Integration Services (SSIS) and Reporting Services (SSRS)
- Strong SQL development skills including writing Stored Procedures, Triggers, Views, and User Defined functions.
- Expert in Query Tuning and Performance optimization and Implementing Work Load management.
- Hands on experience in installing, configuring, managing, monitoring SQL Server 2016/2012/2008 R2.
- Strong experience in troubleshooting, debugging and supporting business intelligence applications in Confidential Business Intelligence Stack configuration.
- Expert in developing SSIS/DTS Packages to extract, transform and load (ETL) data into data warehouse/data marts from heterogeneous sources.
- Experience on Cloud Databases and Data warehouses ( SQL Azure and Confidential Redshift/RDS).
- Experience in migration of Data from Excel, Flat file, Oracle to MS SQL Server by using BCP and DTS utility and SSIS.
- Good understanding of software development methodologies, including Agile (Scrum).
- Experience and knowledge in various data interchange and representation formats such as JSON, XML
- Expert in developing Complex SSRS Reports involving Sub Reports, Matrix/Tabular Reports, Drill Through, Drill Down
- Experienced in developing complex Web applications using .NET, ASP.NET, VB/C# with Visual Studio 2010/2008, version control using Team Foundation Server.
- Expertise in development of various reports, dashboards using various Tableau Visualizations
TECHNICAL SKILLS:
Databases: Confidential Redshift, SQL Azure, Confidential RDS, Confidential SQL Server 2016/2012/2008 R2, MySQL 4.0/5.0, Oracle 11g/10g/9i and Teradata
ETL Tools: SQL Server Integration Services, AWS Data pipeline, Informatica Power center 9.x
Reporting Tools: Tableau, SAS Visual Analytics, Power BI, SQL Server Reporting Services, Dundas Dashboard and Data Visualization components, DOMO, Pyramid Analytics and Crystal Reports
Languages & Tools: T - SQL, PL/SQL, VB.Net, Python, C#, MDX and DAX
Tools: /Methodologies: SQL Server Data Tools, SAS BI Suite, SAS Enterprise Guide, Confidential Visual Studio 2012/2010, Shell Scripting, UNIX Scripting, TFS 2012/2010, TOAD, Dream Weaver MX, Management Studio/Enterprise Manager, SQL Profiler, Tuning Adviser, DTS
Web Technologies: ASP.NET 4.0/3.5/2.0/1.0, VB.NET, WSS 3.0, MOSS 2007, C#.NET, Asp.net Ajax, Web services, Silver light JavaScript, ADO.Net and Classic Asp
Operating System: Windows Server 2012R2/2008 R2 and RHEL 7
Others: Confidential Share Point, SAS, IBM Lotus Domino/Notes 7.5, PayPal payment gateway integration, Authorize.net payment gateway integration.
PROFESSIONAL EXPERIENCE:
Confidential, Mclean, VA
Senior Data Engineer / Redshift Consultant
Responsibilities:
- Designing and building multi-terabyte, full end-to-end Data Warehouse infrastructure from the ground up on Confidential Redshift for large scale data handling Millions of records every day.
- Implementing and Managing ETL solutions and automating operational processes.
- Optimizing and tuning the Redshift environment, enabling queries to perform up to 100x faster for Tableau and SAS Visual Analytics
- Wrote various data normalization jobs for new data ingested into Redshift
- Advanced knowledge on Confidential Redshift and MPP database concepts.
- Migrated on premise database structure to Confidential Redshift data warehouse
- Was responsible for ETL and data validation using SQL Server Integration Services.
- Defined and deployed monitoring, metrics, and logging systems on AWS.
- Implemented Work Load Management (WML) in Redshift to prioritize basic dashboard queries over more complex longer-running adhoc queries. This allowed for a more reliable and faster reporting interface, giving sub-second query response for basic queries.
- Worked publishing interactive data visualizations dashboards, reports /workbooks on Tableau and SAS Visual Analytics.
- Responsible for Designing Logical and Physical data modelling for various data sources on Confidential Redshift
- Designed and Developed ETL jobs to extract data from Salesforce replica and load it in data mart in Redshift.
Platform/Tools: Confidential Redshift, AWS Data Pipeline, S3, SQL Server Integration Services, SQL Server 2014, AWS Data Migration Services, DQS, SAS Visual Analytics, SAS Forecast server and Tableau.
Confidential, Bowie, MDSenior Database Administrator / Developer
Responsibilities:
- Primarily worked on a project to develop internal ETL product to handle complex and large volume healthcare claims data. Designed ETL framework and developed number of packages to Extract, Transform and Load data using SQL Server Integration Services (SSIS) into local MS SQL 2012 databases to facilitate reporting operations.
- Performing Data source investigation, developed source to destination mappings and data cleansing while loading the data into staging/ODS regions
- Involved in various Transformation and data cleansing activities using various Control flow and data flow tasks in SSIS packages during data migration
- Applied various data transformations like Lookup, Aggregate, Sort, Multicasting, Conditional Split, Derived column etc.
- Developed Mappings, Sessions, and Workflows to extract, validate, and transform data according to the business rules using Informatica.
- Querying, creating stored procedures and writing complex queries and T-SQL join to address various reporting operations and also random data requests.
- Performance monitoring and Optimizing Indexes tasks by using Performance Monitor, SQL Profiler, Database Tuning Advisor and Index tuning wizard.
- Acted as point of contact to resolve locking/blocking and performance issues.
- Wrote scripts and indexing strategy for a migration to Confidential Redshift from SQL Server and MySQL databases
- Worked on AWS Data Pipeline to configure data loads from S3 to into Redshift
- Used JSON schema to define table and column mapping from S3 data to Redshift
- Wrote indexing and data distribution strategies optimized for sub-second query response
Environment: MS SQL Server 2008R2/2008/2012, Oracle 10g/9i, Confidential Redshift, AWS Data Pipeline, S3, SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), Share Point, TFS, MS Project, MS Access, VBA.
Confidential, Columbia, MDSenior SQL BI Developer/Data Analyst
Responsibilities:
- Designing and developing SQL Server 2008 Databases, Tables, Indexes, Stored procedures, Views, Triggers. worked complex SQL statements using joins, sub queries and correlated sub queries.
- Created many SSIS packages using Import/Export Wizard. Designed many Packages using SSIS Designer by using Control Flow and Data Flow Tasks with ETL Tool.
- Design/Build Extract Transform Load procedures in SQL Server Integration Services using packages to import/export data feeds to/from data warehouse and client systems.
- Migrating the data from an Access database to SQL Server 2008R2.
- Fetch the data from Oracle 10g by creating a linked server and use SQL Server to query Oracle database.
- Developed mappings in Informatica to load the data from source files using different transformations like Source Qualifier, lookup (connected and unconnected), Expression, Aggregate, Update Strategy, Joiner, Filter, Stored Procedure, normalizer, Router and Mapplets.
- Involved in review of the mappings and enhancements for better optimization of the Informatica mappings, sessions and workflows. Also Worked on creating test cases by using Informatica DVO as Testing tool
- Performed daily tasks including backup and restore by using SQL Server 2005 tools like SQL Server Management Studio, SQL Server Profiler, SQL Server Agent, and Database Engine Tuning Advisor
- Involved in re-design, re-code, and deploy new data extractions using SSIS, and designed and produced documentation of data transformations for all extractions.
- Create database maintenance plans for the performance of SQL Server including database integrity checks, update database statistics, re-indexing and data backups.
- Worked on Exception Handling with Try/catch and data access layer development using ADO.NET components.
Senior SQL Server SSIS/SSRS Developer
Responsibilities:
- Involved in various stages like development, system Analysis, design, and creating stored Procedures.
- Involved with SSIS for sending and reviewing data from heterogeneous sources like (Excel, CSV, Oracle, flat file, Text Format Data).
- Created database objects like tables, views, indexes, stored-procedures, triggers and cursors.
- Migration of DTS to SQL Server Integration Service (SSIS) and Designing/ Implementing Backup policies for databases.
- Created various DDL/DML triggers in SQL Server 2005/2000
- Creating, maintaining the users, roles and granting privileges and Rebuilding indexes on various tables.
- Developing complex SQL to implement business logic and Optimized the performance of queries with modifications in T-SQL queries.
- Configured Mail Profile for sending automatic mails to the respective people when a job is failed or succeed. Maintaining SQL Script for creation of Database Objects.
Software Engineer
Responsibilities:
- Involved in designing and coding for web forms of the application with ASP.NET.
- Involved in developing UI, Business Layer and Data Access Layer.
- Used Grid Views, Repeaters and Data Lists to retrieve and display the data in the required format.
- Worked on User Controls, Master Pages for Data Caching and Used ADO.NET to implement the data layer to help communicate with data base
- Maintained tables, Primary Key Foreign Key Relationship, check Constraints, Schema Changes.
- Used “SQL Server Import and Export Wizard” to import data from SQL Server 2000 to SQL Server 2005 which use Data Transformation Services (DTS).
- Performance tuning of SQL queries and stored procedures using SQL Profiler and Index Tuning Wizard.