Snowflake Dba/developer Resume
Madison-wI
SUMMARY
- Around 8 years of IT experience with excellent understanding of full Software Development Life Cycle (SDLC) involving Systems Analysis, Design, Development and Implementation.
- Experience in using Business Intelligence tools (SSIS, SSRS) in MS SQL Server
- Experience with 3 years of Snowflake as a DBA and as a Developer, also with Matillion ELT tool.
- Experience in working with Snowflake data warehouse and ETL development including Snowflake Bulk Loading, SnowPipe, Unloading, working with semi - structured data
- Extensively worked on onboarding the users onto Snowflake, Creating, and managing Storage Integrations, DB objects, Stages (Internal & External), File Formats (JSON, CSV, TSV).
- Experience in management of Roles, Data Masking Policies, Global User(service) & Role Privileges Management.
- Expertise in Snowflake advanced concepts like setting up Resource Monitors, RBAC controls, Virtual Warehouse sizing, query performance tuning, Zero copy clone, time travel and understand how to use these features.
- Extensively worked on creating Snowpipes to load streaming data from S3 buckets.
- Worked on creating SQS, SNS, S3 Lifecycle policies and implemented IAM policies.
- Created Canonical model in Snowflake by building data pipelines connecting and migrating data from different sources like Google Analytics, Salesforce and Oracle.
- Experience in using Snowflake Partner Connect.
- Used Matillion tool for setting up ELT process in Snowflake.
- Created numerous Orchestration and Transformation job as part of building data pipelines using Matillion.
- Experience in using READ, JOIN, TRANSFORM, WRITE of Matillion ELT tool.
- Worked on cost Optimizations on Snowflake DB by analyzing the queries and re-engineering the data pipelines used by various services (Warehouse, Snowpipe, Clustering).
- Expert in tuning the SQL queries to improve performance of the system.
- Experience in database programming in writing T - SQL Stored Procedures, Triggers, Constraints (Primary Key, Foreign Key, and Unique) Indexes and Batch Scripts using various DDL and DML commands.
- Very strong in writing SQL Joins, Nested Queries, Unions, Multi-table joins and experience in creating scheduling Jobs, sending Alerts.
- Experienced in creating SSIS packages involving ETL process, extracting data from various sources (Flat files, Excel files, SAP, and SQL Server) and loading for data warehousing using SQL Server Integration Services (SSIS).
- Experience in writing parameterized queries for generating tabular reports Drill down, Drill Trough, Cascading, matrix chart, snap shot reports Formatting report layout, sub reports, using Global Variables, Expressions, sorting the data, defining data source and subtotals for the reports using SSRS.
- Expertise in defects logging, tracking, and managing defect life cycle using JIRA and ServiceNow.
- Good understanding of software development methodologies, including Agile (Scrum).
- Excellent problem solving, interpersonal, and communication skills.
TECHNICAL SKILLS
Programming Languages: Python, Bash
Query Languages: SQL, PL/SQL, T-SQL, SnowSQL
ETL Tools: SSIS, Informatica, Matillion
Databases: Oracle, SQL Server, MySQL
Reporting Tools: SSRS, PowerBI
Version control: Git, SVN
Cloud Platform: AWS, Azure
Cloud Technologies: EC2, S3, EMR, Redshift Spectrum, RDS SQL Server, Lambda, Step-functions, DynamoDB, SQS, SNS
Scheduling Tools: Autosys, Matillion, SQL Server Agent
PROFESSIONAL EXPERIENCE
Confidential, Madison-WI
Snowflake DBA/Developer
Responsibilities:
- Designed and Developed Data pipelines. Integrated large amounts of data from Google Analytics, Salesforce, Oracle and generated business reports using PowerBI.
- Designed and developed migration steps for Migrating Objects from Oracle into Canonical layer in Snowflake.
- Created Snowpipes for continuous data load.
- Monitored the sizes of the tables in Snowflake and applied clustering keys and deactivated automatic clustering.
- Experience in resizing the cluster based upon the use for performance.
- Created and modified the file formats, Stages (Internal & external), S3 integration objects to accommodate new needs.
- Created AWS S3 lifecycle policies to archive or purge the files based on the business unit policies.
- Worked on creating SNS (Simple Notification Services) and SQS (Simple queuing Services) for Snowpipes.
- Onboarded users to Snowflake and created the roles and assigned the users to the roles.
- Experience in creating objects like Materialized Views, Views (Secured & Normal), Schemas and Databases, Task, Streams, SP’s, UDF’s, Functions and managed users based on RBAC.
- Closely monitored and optimized the usage of Warehouses, Automatic Clustering, Snowpipes based on the business needs.
- Redesigned the Views in snowflake to increase the performance.
- Worked extensively on Matillion and created complex orchestration jobs that run daily and hourly.
- Worked extensively on Matillion, implemented all the complex business logics inside Matillion using components like S3 load, unload, table output input, load generator, grid variables, iterator.
- Used READ (Table Input, Multi Table Input, Fixed Flow), JOIN (Join, Unite, Except, Intersect), TRANSFORM (Aggregate, Calculator, Distinct, Filter, Rank, SQL, Replicate), WRITE (Create View, Rewrite Table, Table Output, Table Update) of Matillion ELT tool.
- Used Matillion Inbuilt Scheduler for scheduling simple intervals for Matillion ETL jobs.
- Used the Zero-Copy Cloning feature to clone the non-prod on scheduled basis.
- During contingencies used the cloning and Time Travel to restore the critical data for analysis.
- Implemented data sharing capabilities with vendors and this reduced the data sharing time by multifold which improved the weekly forecasting.
- Used Snowpipes to consume transactional data from oracle to generate real time reporting.
- Implemented business logics by transforming the data in Canonical layer and storing in normalized format in data marts.
- Expertise in loading (Copy INTO) and creating the pipelines for bulk loading of data for batches.
- Monitored closely the needs of the data retention based on the analysis altered time travel of the objects.
- Used the Zero-Copy Cloning feature to clone the preprod on scheduled basis.
- During contingencies used the cloning and Time Travel to restore the critical data for analysis.
- Used streams on the tables to Capture changed records in conjunction with Tasks.
- Coordinated with Account Admin to in corporate the inbound and outbound data shares.
- Created user stories for bigger project implementations on JIRA.
- Developed a dashboard on JIRA to help the management on the progress of the project.
Environment: Oracle, PowerBI, Snowflake, S3, IAM, SQS, Matillion, SNS, JIRA, Salesforce, Google Analytics
Confidential, Tampa-FL
SQL Developer
Responsibilities:
- Involved in requirements gathering, analysis, design, development and implementation of various applications on MS SQL Server.
- Good Knowledge of ETL Processes such source, mapping, transformation, staging areas and created various ETL documents such as ETL Mapping documents.
- Worked extensively through agile development methodology by dividing the application into iterations.
- Strong understanding of source to target mappings, used to build SQL tables and stored procedures.
- Created complex functions and stored procedures using the multi part identifiers, multi joins and T-SQL that support both OLAP and OLTP applications.
- Implemented Event Handlers, Package Configurations, Logging, System and User-defined Variables, Check Points and Expressions for SSIS/ETL Packages.
- Executed SQL conversion pre-validation and post-validation scripts to avoid data loss and to make sure that the Count, redemption amount for each source matches the data loaded in EDW.
- Developed stored procedures that generates header and detail files for different business processes.
- Developed ETL package with different data sources (SQL Server, Flat Files, Excel Source files, etc.) and loaded the data into target tables by performing different kinds of transformations using SQL Server Integration Services.
- Performed SSIS tasks such as Slowly Changing Dimension, Conditional Split, Derived Column etc., which did Data Scrubbing, including data validation checks before loading data.
- Experience in Designing and Implementing Data Warehouse applications, mainly Transformation processes using ETL tool also actively involved in Database Querying, Data Analysis, Production support.
- Good understanding of SQL Server Reporting Services (SSRS) with Report authoring, Report management, Report delivery and Report security.
- Upgraded Excel reports to SSRS reports. Configured and deployed SSRS reports onto Report Server.
- Experience in writing parameterized queries for generating tabular reports Drill down, Drill Trough, Cascading, matrix chart, snap shot reports Formatting report layout, sub reports, using Global Variables, Expressions, sorting the data, defining data source and subtotals for the reports using SSRS.
Environment: Microsoft SQL Server 2017 Enterprise Edition, MS Access, ETL Packages (SSIS), VB.Net, Visual Studio, Team Foundation Server (TFS), T-SQL, MS Visual Studio 2017.
Confidential, Tampa-FL
SQL Server Developer
Responsibilities:
- Participated in data modeling meetings to help determine data modeling architecture and helped data modeling team to achieve best practices and performance.
- Involved in requirement gathering meetings to understand requirements and future usage for the reports and documented them.
- Worked on SQL Server development including writing T-SQL Queries and creating SQL Server objects like Stored Procedures, User-defined Functions, Views, Triggers, implementing T-SQL relational database models and data integrity.
- Wrote Parameterized Queries for generating Tabular reports, Formatting report layout, creating reports using Global Variables, Expressions, Functions, Sorting the data, Defining Data Source and Datasets, calculating subtotals and grand totals for the reports using SSRS 2014.
- Created user defined function and views in t-SQL (using PG Admin and SQL manager for t-SQL). Implemented best practices and performance tuning for t-SQL.
- Created Drill through, Drill down, Matrix and Sub reports, added report mapping functionality to the reports using MS SQL Reporting Services
- Created and Scheduled Date-Driven and Standard Subscriptions with different rendering options like PDF, CSV, EXCEL etc. using data sources from SQL Server and Oracle.
- Monitored and enhanced performance by using execution plans and SQL Server Profiler, implementing query optimization.
- Worked with testing team to understand test cases and created processes (using stored procedures and SSIS packages) to automate ETL and SSRS testing.
- Supported Extract, Transfer, Load (ETL) efforts using Integration Services tools. Created, configured, modified and tuned SSIS packages.
- Created custom packages to load slowly changing dimension tables (for Type 2 and Type3 loads).
- Used configuration manager in SSIS to dynamically move packages between environments, performed error handling for SSIS packages.
- Used Tidal scheduling tool to schedule SSIS packages and SSRS reports.
Environment: MS SQL Server 2014, T-SQL, SQL Server Reporting Services, SQL server Integration service, Erwin7.3, SQL Profiler, Visual Basic, C#, Performance Monitor.
Confidential
SQL Server Developer
Responsibilities:
- Involved in creating multiple parameterized stored procedures which were used by the reports to get the data.
- Worked on formatting SSRS reports using the Global variables and expressions.
- Created parameterized reports and Drill down reports using SSRS.
- Responsible for scheduling the reports to run automatically.
- Involved in raising ETP turn for deployment of reports to QA and production Report Server and troubleshooting for any error occurring during execution.
- Used ETL (SSIS) to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
- Involved in the Migration of Databases from SQL Server 2005 to SQL Server 2008.
- Prepared the complete data mapping for all the migrated jobs using SSIS.
- Created databases and schema objects including tables, indexes and applied constraints, connected various applications to the database and written functions, stored procedures and triggers.
- Designed SSIS Packages to transfer data from flat files to SQL Server using Business Intelligence Development Studio.
- Extensively used SSIS transformations such as Lookup, Derived column, Data conversion, Aggregate, Conditional split, SQL task, Script task and Send Mail task etc.
- Used Execution Plan, SQL Profiler and Database Engine Tuning Advisor to optimize queries and enhance the performance of databases.
- Actively involved in meeting with business users and business analyst for gathering and understanding of requirements.
- Responsible for creating SSIS Packages to migrate data from LSP and HBMS to FIMMAS.
- Performing incremental data load packages in SSIS.
- Created SSIS package to generate fixed-length file for end user.
- Responsible for deploying SSIS package to QA and production environment.
- Created and maintained Technical documents like Design document, Interface contract, Flow chart and relationship diagram.
Environment: MS SQL Server, T- SQL, SSIS, SSRS, Windows XP, Query analyzer, SQL Profiler, MS Excel.