Aws Solution Architect Resume
OBJECTIVE:
- I am looking for an opportunity to work in a lead role designing and driving the development of data platforms using Linux technologies and big data technologies. I have significant experience working with AWS, ETL, SSRS, Python, Bash, performance optimization best practices, and leading teams. I have designed ETL frameworks for massive big data processing to platforms like Hadoop and Redshift. I have lead development teams for major clients such as Confidential and Xerox.
TECHNICAL SKILLS:
Technology and Tools: Bash Netezza Postgres AWS (EC2, S3, Cloudwatch, Redshift, Lambda, Cloudformation) Hadoop Python ETL ESB Design Data Warehousing Informatica Microsoft SQL Server 05, 08, 12 SSIS SSRS Data Modeling Performance Optimization including statistics, execution plans, and query tuning Partitioning and Partition Aligned Indexing SQL CLR VBA T - SQL
PROFESSIONAL EXPERIENCE:
Confidential
AWS Solution Architect
Responsibilities:
- Designed complete AWS environment, including subnets, routing tables, nacl’s, security group design, at rest encryption, CICD and Cloudformation
- Create architectural diagrams to communicate design and seek security approvals
- Coordinated vendors during bake off, including on site visits, strategy for sales presentations and use case materials
- Implemented AWS security components (IAM/S3 policies, users, groups, roles)
- Configured VPN/VPG connectivity with Palo Alto Networks
- Created highly customizable Cloudformation templates that can be reused for various environments, applications, AMI’s, etc
- Design environment promotion model
- Setup and configuration of AWS based RD Gateway with Duo MFA
- Implemented infrastructure change request process
- Implemented automated CICD promotion process using AWS CodeStar project (CodePipeline, CodeBuild, CodeCommit, etc)
Confidential
Platform Architect
Responsibilities:
- Created custom data ecosystem job execution framework using Python, bash, SQL, messaging (RabbitMQ), Node, Jade templates, Node API’s and Multi Threading
- Managed and developed on AWS resources to expand the footprint of the client’s AWS infrastructure to include additional IAM security roles, EC2 security groups, EC2 instances, Lambda functions for EC2 automated start and stop and Cloudwatch events to trigger Lambda functions
- Provided and warm handoff of framework to client to faciliate rollout to development teams and handoff of framework management to client IT team members
- Implemented abstract base class templating logic to enfore framework design standards and provide a template API to the framework for ongoing common utility development
- Lead development of front end GUI for managing framework
- Team building and management
- Facilitating Discovery/JAD Sessions
- Product/solution design and development based on target market needs
Confidential
Netezza Data Architect
Responsibilities:
- Developed processes for coordinating normal project data loading to Netezza in various environments to an Ops team using wikis and status pages for multiple teams to use for coordination and communication
- Lead a team of engineers responsible for managing a home grown ETL framework in Netezza
- Wrote and maintained a significant amount of code written in bash, used for moving data and files around on Redhat and loading said files to Netezza
- Lead the design of a very robust home grown ETL framework/ecosystem surrounding Netezza written primarily in bash, SQL and python for loading data from a variety of formats, including flat files, other RDBMS systems, JSON and excel
- At times managed QA defect resolution by the development team with an offshore QA team raising tickets through JIRA
- Wrote a significant number of SQL transformations to load data to target models for projects
- Implemented dynamic, generic CDC ETL tools in bash and python that dynamically create CDC code in SQL using RDBMS system views
- Implemented multi-threaded python design for processing interdependent data warehouse tasks using an object oriented approach for job execution with classes and properties
- Implemented python messaging handlers to connect a varying number of front end GUI’s with our home grown ETL framework via named pipes and message polling for the purpose of allowing an operations/sysadmin team to monitor and control jobs running across several servers
Confidential
DW Architect
Responsibilities:
- Contributed to how the data models would be designed and participated in identifying the implications of different granularities in the model
- Designed the ETL, logging, error handling, notifications, staging of data, transformation and delta detection, and final processing to a target EDW Kimball project model, most often with Microsoft technologies such as SSIS and SSRS, but sometimes with technologies with Microstrategy and Informatica
- Recruited and managed development teams that included a diversity of resources from software architects to BI developers and infrastructure/systems resources, both off shore and on shore
- Wrote highly complex SQL to populate dimensions and fact tables in data warehouses and in ODS systems
- Designed a significant number of SSIS packages to load data warehouses, including logging, SCD transformations, script tasks using C#, and looping in the control flow to process complex datasets
- Drafted detailed milestone documentation to communicate to the client
- Communicated with the management on the client side when there were issues
- Performance tuned the SQL code, partitioning, indexes, and the model to meet the needs of the client
Confidential
SQL Developer
Responsibilities:
- Reduced several month end T-SQL stored procedure processes by several hours, through code optimization, transaction control, execution plan and dmv analysis
- Introduced new processes to manage and monitor server and job performance
- Lead team collaboration and problem resolution with over 20 people during triage situations
- Successfully implemented partitioning for data management, using a sliding window
- Lead the development and management of an Informatica ETL process with over 80 workflows
- Managed the scheduling of the ETL jobs using Autosys
- Introduced efficiencies and resolved design flaws that reduced monthly job execution from 1 week to 4 hours
- Designed and implemented a partitioning strategy that saved several hours in daily and monthly job processing time, and increased the efficiency of the reporting from taking over 90 minutes to process one report down to less than 5 minutes
- Designed a reconciliation process to reconcile several billion row fact tables with a source AS400 SOR
- Managed estimating timelines, milestones, and completion dates for projects
- Interacted directly with the line of Confidential to maintain communication regarding project deadlines, Confidential needs, issues and data reconciliation for a system ranging in size from 5-10 terabytes.
Confidential
Database Administrator
Responsibilities:
- Developed new ETL processes, implementing SSIS as the administration piece.
- DBA duties included security, encryption and backups
- Began development of performance monitoring dashboards for various sql server instances
- Redesigned and started implementation of a relational hierarchical model for the Confidential HIS data dictionary
- Optimized performance on existing and new servers for existing and new product lines.
- Maintained overall health of servers and made suggestions for ways to improve server architecture.
- Optimized multiple SQL Server instances using SQL Profiler, Database Engine Tuning Advisor, DMV s and PerfMon
Confidential
SQL Developer
Responsibilities:
- Maintained ETL processes and debugged any known issues
- Examined ETL processes for possibly performance improvements as well as possible mistakes in logic
- Provided suggestions for ways to improve the overall data warehouse infrastructure through improved data models, improved ETL’s, or newer technologies
- Researched and resolved data anomalies previously unresolvable
Confidential
ETL/SQL Developer
Responsibilities:
- Implemented maintained SSRS Reporting infrastructure to work seamlessly with pre-existing ETLs and systems
- Created SQL CLR/SSIS process to handle all logging, precedence validation, automatic restarting, email notifications, and several other administrative tasks associated with jobs, packages, and reports that need to run on the server
- Lead the Confidential Intelligence initiative from a architecture, design, development, and implementation perspective within the Healthcare Economics division
- Implemented processes to automate many previously manual reports, ETLs, and data warehouse functions
- Developed custom CLR stored procedures for automation and error management of SSIS package logs, SQL Server jobs, report schedules, and other miscellaneous data warehouse functions
- Rebuilt several very complex ETLs to provide for automation and various performance improvements
- Managed maintenance of index creation and other basic performance features to improve data warehouse performance
- Created process to automatically loop through all databases on production servers, back them up to a network path, and then immediately restore said backups to a dev box for dev purposes
- Converted DTS packages to SSIS and optimized their performance
Confidential
Intelligence/Operations
Responsibilities:
- Implemented SSRS organizational policies to meet the needs of all departments in the company.
- Communicated on multiple projects between approximately 30 people simultaneously
- Developed custom dashboards streaming real time analytical data for performance monitoring
- Developed database structures and systems to allow for SSAS implementation and data warehousing
- Developed ETL farm for harvesting 2005 production environment and XML data types via XPath and reconciling with 2008 warehouse ready environment
- Experience manipulating data inside packages and then loading into SQL Server
- Frequently developed indexes to improve server performance
- Wrote service to iterate through registered servers using SMOApplication object and back up servers every 48 hours
- Implemented complex packages via SSIS to harvest data from a variety of structures into SQL Server 2008 environment
- Contributed in the initial and ongoing development of MOLAP Data Warehouse environment through the design of dimensions, data source views, and cubes
- Coordinated and successfully managed and completed multiple projects simultaneously
- Collected diverse statistical data elements for the purpose of workflow analysis and process improvement for customer service and implemented changes.
- Distributed reports to all levels of management for collaborative analytical purposes
- Identified key technology needs within the company and worked closely with the B.I. team to satisfy those needs through ASP.NET development, database development, Web Services development, data warehouse development and Confidential process changes.
- Developed custom C# ASP.NET applications for process monitoring and internal operations
- Designed systems for moving data from a variety of formats via ETL’s to SQL Server 2005 for the purposes of SSAS implementation
- Developed custom reports in SSRS for different Confidential units within the organization
- Implemented reporting solutions via VBA in Excel, Outlook, and Access 2007
Confidential
Data Architect
Responsibilities:
- Drafted Implementation Plan for upgrading from SQL Server 2005 to SQL Server 2008
- Implemented SSRS configuration for out - of-domain access
- Redesigned pre-existing data model to support multi-client subscription model architecture
- Implemented replication for distributed workload management and reporting
Confidential
SSRS Developer
Responsibilities:
- Converted Oracle reports to SSRS
- Implemented a custom dynamic web page for displaying SSRS reports on multiple SSRS servers in a pre-existing web application
- Designed a Multi-lingual reporting architecture for any number of languages