Senior Data Engineer / Bsa - Data Migration Resume
SUMMARY
- Result oriented professional equipped with 23 years of Information Technology related success. Demonstrates a unique combination of Technical, Business and Leadership acumen.
- Background includes extensive experience in Architecture and Development of Business Intelligence / Data Analytics Solutions, Databases and Data Warehouse Development, ETL Design & Development, Migration & Re - engineering driven projects, and Cloud Data Analytics.
- Expert in Business & System Analyses, Data Quality and Governance, Data Test Matrix and Developing Test Cases and Team Management.
- Furthermore, have proven ability to manage large-scale projects, consistently delivering these engagements within time lines and budget constraints.
- Possess a solid record of accomplishments on leading and managing projects and teams, team player and exhibits strong innovative and interpersonal skills
TECHNICAL SKILLS
- Project Management, Strategic Planning, Team Management, Business Analysis, Data Architecture, Data Modeling, Business Intelligence
- ETL, ELT, Data Warehouse Development, Data Governance, Data Mapping, Master Data Management, Data Standardization
- Data Profiling, Data Migration, Process Designing and Re-engineering, DevOps -CI/CD, Technical & User Documentation
- System Flow Charts, Test Matrix, Agile Methodologies, BIG Data Analyses, Cloud Computing
- SQL Server, Oracle, DB2, Teradata, Netezza, Analytics Platform System / Parallel Data Warehouse (PDW)
- Hadoop, MapReduce, HDFS, HIVE, MongoDB, Data Lake, HiveQL, Hue, Impala, Python, Pandas, Scala
- Spark, Sqoop, AZURE, Cloudera, SSIS, Talend, SSAS, SSRS, OLAP, Cubes, MDX, XML, SAS, VB.Net
- Java Scripts, SharePoint, Crystal Reports, Tableau, Power BI, QlikView, VBA, Visio, Erwin, JIRA, Confluence
- EBX -TIBCO, NAS Server, Git Repository Release / Version control (Bitbucket), CI/CD, TFS
- Azure Data Factory, Data Bricks, Jupyter Notebook, Azure HDInsight, Microsoft DevOps
PROFESSIONAL EXPERIENCE
Confidential
Senior Data Engineer / BSA - D at a Migration
Responsibilities:
- Design and Developed data transformations Pipelines in AZURE Data Factory reverse engineer through existing Talend ETLs
- Data migrated from Oracle and Netezza to Hive and Azure Data Lake. Develop several complex SQL Scripts
- Perform Data Development on all Data Stages - Ingestion, Exploration, Prepare and Train and Consume
- Worked with teams in Data Modelling of new data warehouse Azure Data Lake
- Gathering new requirements and legacy data warehouse information through reverse engineering
- Document all requirement and systems information into meaningful perspectives - technical and business
Confidential
Senior Data Engineer / BSA Team Lead Big Data Migration
Responsibilities:
- Gathering and updating requirements and changes from legacy data warehouse through reverse engineering and feedback from user testing. Document all requirement and systems information into meaningful perspectives - technical and business
- Take part with teams in finalizing Architecture of the new System
- Data migrated from Oracle and SAS to Hive and Azure Data Lake. Develop several complex SQL Scripts
- Perform Data Development on all Data Stages - Ingestion, Exploration, Prepare and Train and Consume
- Design and Develop AZURE Data Factory / Pipelines, uploading in AZURE Data Lake, Data analyses in DataBricks
- Perform Continuous release management in Microsoft DevOps
- Creating all other Documentations, Requirement packages, Impact & System Analysis, Data flow, Data Model
- Define Test cases, Test matrix, and coordinate with QA, Data governance and security teams
- Lead team of four Data Engineers and two BSA
Confidential
Senior Architect / Developer / BSA Business Intelligence & D at a Warehouse
Responsibilities:
- Architect and redesigning overall Data Warehouse and Business Intelligence solution
- Development / Support on Data warehouse, Cubes, Dimension, Dashboards
- Requirement gathering from business and document into meaningful perspectives both technically and business
- Coordinating with all stakeholders technical and business. Design / Develop Dash board in Qlikview and PowerBI
- Creating all Documentations, Business Requirement, Impact Analysis, System Analysis, Data flow, Data Model
- Define Test cases, Test matrix, and coordinate with QA and security teams
- Uploading data in Cloud for further analyses at AZURE Data Lake
- Design and Develop Azure Data Factory, Pipelines, Data Bricks
- Lead team of three Data Engineers
Confidential
Senior Architect / Developer
Responsibilities:
- Gather & Analyze business requirements, document requirements and develop process/ System flow charts
- Architect and develop the completely new system of Big Data Analyses. Tableau as Dashboard
- Re-Develop Centralize enterprise data warehouse, through reverse engineering of existing Reports
- Architect and Developed operational database, complex queries for data manipulations, and data reconciliation
- Develop multiple complex ETLs, CUBES, extracting data from multiple sources, using SSIS, SSAS, .Net
- All projects were maintained in TFS, define Test cases, Test matrix, and coordinate with QA and security teams
- Provide production support to databases, Reports, ETLs and applications, Performance Tuning databases, queries, reports, and ETLs. Developed several complex reports in SSRS. MDM management,, Java Scripts
- Developed System designs, Data Model, Support guides, infrastructure/security and integration documentation
- Leading team of four Data Engineers and Developers
Confidential
Senior Architect / Developer BI & D at a Warehouse
Responsibilities:
- Developed System design documents, Data Model, System build guides, Support guides, and User support documents, infrastructure documentation and security processes, integration documentations
- Migration of databases, developed multiple complex ETLs, queries from old to new databases, including development of Data Mapping Documentation, extracting data from multiple sources
- Through reverse engineering, migrated and redeveloped several complex reports, static and dynamic, parameterized in SSRS and Cubes in SSAS, Star Schema, Java Scripts
- Client / Market Risk Analysis, Data Governance & Management
- Architect, Design & Developed Data Mart for Anti Money Laundering Department Risk Reporting
- Architect and Developed complex queries for data manipulations, Performance Tuning
- All projects were maintained in TFS, Define Test cases, Test matrix, and coordinate with QA team
- Leading team of developers
Confidential
Senior Data Engineer Data Warehouse and BI Solution
Responsibilities:
- Analyze business requirements, document requirements, and develop Process / System flow charts,
- Developed System design documents, Data Model, System build guides, Support guides, and User support documents, infrastructure documentation and security processes, integration documentations
- Coordinate with all the stakeholders and get sign offs, development of data Mapping Documentation
- Architect, Design & Developed Data Mart, for Retail banking for Private Client Group
- Architect and Developed complex queries for data manipulations, Performance Tuning
- Develop several complex reports in SSRS, Cubes in SSAS
- Developed multiple complex ETLs, extracting data from multiple sources to bring in the Data Mart
- Developed QA Server, Define Test cases, Test matrix, and coordinate with QA teams, MDM, Data Quality
- All projects were maintained in TFS, Perform data management and performance monitoring tasks
Confidential
Senior Developer / Team Lead D at a Warehouse and BI Solution
Responsibilities:
- Analyzed and document business requirements, and develop process/ System flow charts,
- Developed System design documents, Data Model, System build guides, Support guides, and user support documents, infrastructure documentation and security processes, integration documentations
- Initiate Business Analysis and design an appropriate data model for the data warehouse. Co-ordinate daily with internal stakeholders and those from various countries. Development of data Mapping Documentation
- Coordinate with all the stakeholders i.e. internal clients and clients from five different countries
- Architect, Design, and develop, from scratch, a centralized MIS & OPS reporting solution for the international banking division - made up of various Banks, Capital Market & Wealth Management Depts., and Contact Centers with stakeholders from 23 countries.
- Migrate Data from different legacy systems consisting of DB2, SQL Server 2000, Oracle, Excel and XML to centralized SQL Server 2005 / 2008 databases / data marts. FTP files, Java Scripts
- Integrated the databases and systems of various Banks/Contact Centers belonging to the Scotia Group from different countries. Data Governance, MDM, Data Quality Maintenance
- Through reverse engineering, migrated and redeveloped SQL 2000 DTS to SSIS; several IBM showcase reports to SSRS; SSAS OLAP Cubes from SQL 2000; Hyperion Essbase to SQL Server 2005/2008 R2.
- Performed consolidation/standardizing of countries' data in data-marts, by developing several complex ETLs based of different business rules for each stakeholder. MDM from all sources of Data
- Performed data analytics on different products in different regions (such as promotions, referrals etc).
- Reverse engineering of legacy undocumented systems, data consolidation / standardization, data analyses, data migration & cleaning, reports / dashboard development. Develop several complex ETLs, design and develop data warehouse. Worked on SQL Server 2000, 05/08 R2, SSIS, SSAS, SSRS, DB2, XML, Informatics, SAS, ProClarity, Showcase reporting. Build several adhoc queries for reporting and data manipulation.
- All projects were maintained in TFS, Define Test cases, Test matrix, QA, Performance Tuning of existing reports
Confidential
Manager Data Analytics
Responsibilities:
- Meet clients and stakeholders, gathered requirements and transformed business requirements into meaningful technical documentation. Designed Project Plans, System Flow Charts and set priorities and timelines
- Architected and developed Business Intelligence solutions for major clients from Insurance, Government, Entertainment, Auto and other industries (Using Oracle, SQL Server 2005/08, SSIS, SSAS, OLAP, SSRS), Java Scripts Clients included Allstate, Travel Guard, Sunlife, Honda, OLG, Rogers, Universal Music, and many others
- Designed, developed and maintained three data warehouses containing multiple data marts in Oracle, SQL Server 2005/08. Build several adhoc queries for reporting and data manipulation. Developed VBA Scripts
- Migrated data from legacy systems to new databases, data marts and performed reverse engineering of old DTS/ Reports
- Data Modeling. Development of Data Mapping Documents, Erwin, Visio. Logical and Physical data modeling
- Disaster Recovery Management (Systems/ Data Backups) in SQL Server 2005/08, Data Governance & Management
- Designed SQL profiler to monitor different transaction loads on database
- Developed many reports through SSRS, Performance Tuning of existing queries / reports
- Developed Cubes and MDX queries through SSAS and also designed many ETL packages through SSIS, FTP
- Completed Database Administration, maintained 28 Transactional databases in SQL Server 2005/ 2008 & DB2
- Data List cleaning through iAddress software, all projects were maintained in TFS,
- Developed QA Server, Define Test cases, Test matrix, and coordinate with team in the system QA process
Confidential
IT Manager
Responsibilities:
- Performed (Healthcare) Business Intelligence Development in DTS, SSIS, SSAS, and SSRS with SQL Server 2005
- Handled a Systems/ Data migration from DB2 to Oracle, FTP, Data Governance & Management
- Database Management / Development in Oracle & SQL Server 2005, Java Scripts
- Development of Database Tables, Schemas, Users, SSIS, DTS, T-SQL, SP, Triggers, Views, Functions, Queries
- Data Modeling, Development of Data Mapping Documents, Erwin. Logical and Physical data modeling
- Development and Designing of Data Warehouse, Data Marts, Data Mining Tools
- Disaster Recovery Management (Systems/ Data Backups) in SQL Server 2005
- Project Management on Setup of IT Infrastructure (i.e. Hardware, Network, Systems) of two Warehouse facilities
- Developed enhancements and provided support in VB.Net, ASP.Net, VB 6.0 and SQL server 2005
- Gained experienced on a pharmaceutical drugs Logistics Processing System
- EDI Specialist (Gentran for Windows)
- Map Creation and Maintenance, Partner Creation, Mailbox Monitoring, Sessions Creation
- Developed QA Server, Define Test cases, Test matrix, and coordinate with team in the system QA process
Confidential
Assistant Vice President - Manager
Responsibilities:
- Managed the SWIFT Department
- Oversaw the Implementation and administration of the SWIFT Server and ATM Servers
- Maintaining, Performance Tuning, and Centralization of Databases in SQL 2000
- Developed Applications in VB.Net, ASP.Net and SQL server 2000 including:
Confidential
Senior Data Analyst
Responsibilities:
- Development and administration of data reports using SQL 2000 with OLAP
- Worked as part of the Project Management Team on the implementation and migration of our Cobol based Banking System to Visual Basic
- Maintaining, Performance Tuning, SQL optimization, and Centralization of Databases in SQL 2000
- Installed, implemented, configured and connected Confidential Commercial Bank with the SWIFT (Society World Wide Interbank Financial Telecommunication) Network