Sr. Database |hadoop Engineer Resume
St Louis, MO
SUMMARY
- Accomplished, business oriented professional with progressive IT experience in Infrastructure and Dev/Ops engineering with emphasis on Hadoop Ecosystem and Oracle Database Systems Administration.
- Extensive experience setting up Complex Database Infrastructure Architectures using various products, protocols and methodologies from Oracle including MAA, Real Application Clusters (RAC), Data Guard, Golden Gate, Enterprise Manager(OEM), Automatic Storage Management (ASM), RMAN, Streams, Replication with excellent leadership skills, communication skills and the ability to influence cross - functional teams.
- Around 8 years of experience maintaining database systems on Linux.
- Over 2 years of experience maintaining Hadoop Ecosystem using HDP and CDH
- Led many critical projects such as Datacenter Migration, Multi-terabyte SAP OS/DB Migration, SAP DB Refresh, SAN Migration (DMX to VMAX), HadoopEcosystem Dev/Ops.
- Expertise in Analysis, Design, Development, Support and Implementation of Database Systemswith keen interest in designing database solutions on large scale and distributed systems.
- Excellent knowledge of Hadoop architecture and administration and support.
- Play major role in planning, installing, configuring, maintaining, and monitoring Hadoop Ecosystem.
- Operational knowledge of Hadoop Ecosystem using CDH and HDP on physical and virtual infrastructure.
- Hands on experience of integrating Hadoop ecosystem with MIT KerberosorMS windows AD KDC.
- Knowledge of Hadoop security tools like Ranger and Sentry.
- Experience with operation of hypervisors like VmwareESXi and KVM
- Designed and implemented Oracle 10gR2, 11gR2, 12c RAC with ASM and ACFS.
- Designed and implemented Data Guard and EMC SAN technologies - SRDF, BCV for high availability and disaster recovery (DR).
- Designed and implemented 10.x, 11.xGoldenGate for replication and database upgrade.
- Designed and implemented 11g, 12c Oracle Enterprise Manager for database systems monitoring.
- Designed and implemented RMAN backup and recovery strategies.
- Experience in upgrades, clones & migrations from 8i to 9i to 10g to 11g (RAC and SI, SI-to-RAC, Cross-Platform).
- Knowledge of MS SQL Server. Designed and implemented backup & restore strategies, mirroring and log shipping features.
- Knowledge of MySQL and NoSQL (MongoDB) databases.
- Knowledge of enterprise storage solutions including SAN/NAS
TECHNICAL SKILLS
Database Management: Oracle 12c/11g/10g/9i/8i, MySQL, MongoDB, MS SQL Server 2008/2010/2012
Database Technologies: RAC, ASM/ACFS, Data Guard, GoldenGate, RMAN, Advanced Compression
Operating Systems: RHEL 5.3/5.5/6.1, AIX 5.3/6.1, Sun Solaris 8/9/10, Ubuntu, Windows Server 2008/2012
Database Utilities: Datapump, Exp/Imp, SQL Loader, OS Watcher, OEM
Backup Technologies: RMAN, EMC SRDF/BCV, Legato Networker
Virtualization: Vmware, VirtualBox | Hypervisors - KVM, ESXi | Linux Containers - Intel Clear Linux, Docker
Hadoop: CDH 5.x, HDP 2.x, Scoop, Flume, Kerberos, Knox, Navigator, Sentry
Cloud: Rackspace, AWS - EC2, VPC, S3
Networking: DNS, TCP/IP, SSH
Languages: SQL, Python, JavaScript, Shell Scripting
Hardware: Dell R710, CISCO UCS, Sun Fire T2000, IBM P7, Oracle M10, Dell PowerEdge 2650
PROFESSIONAL EXPERIENCE
Confidential, St. Louis, MO
Sr. Database |Hadoop Engineer
Responsibilities:
- Architected and implemented 20 node hadoopcluster CDH with Kerberos authenticationusing windows Active Directory.
- Initiated a pilot program to evaluate HDFS, MapReduce/YARN, Scoop, Flume, HBase and Hive.
- Work across department boundaries to obtain needed resources for data center, virtualization, storage, and networking capabilities.
- Monitor and manage the Hadoop infrastructure using tools like clouderamanager and ambari.
- Install tools like navigator and sentry for auditing and access control.
- Formulated procedures for planning and execution of system upgrades for all existing Hadoop clusters.
- Support technical team members in automation, installation and configuration of tasks.
- Ingest data into HDFS using scoop and flume
- Design and implement migration move group strategies for database footprint as part of datacenter migration to move the DB infrastructure from2 datacenter to 2 colocation sites.
- Lowered management overhead costs by reducing the hardware footprint in the datacenter.
- Lead planning and implementation of Oracle 10g and 11g RAC database migration to new datacenters.
- Installed and configured22new Oracle 11gR2 RAC nodes on UCS hardware.Decommed 42 RAC nodes.
- Planed and migrated from 8i/9i/10g databases running on AIX and Solaris to 11g RAC on RHEL.
- Configuration and implementation of Golden Gate based replications through GGSCI.
- Upgrade and migrate database from 10.2.0.4 to 11.2.0.3 using Golden Gate.
- Assist in rehosting legacy oracle databases on older hardware to Oracle M10 with Solaris zones.
- Configured and automated OEM to generate capacity utilization reports for all the database systems
- Assist in the migration of database backups from Networker to NetBackup environment.
Environment: Cloudera, Hortonworks, AWS,RHEL 5.3/5.5/6.5,AIX, Solaris, Oracle 8i, 9i, 10g, 11g, RAC, ASM/ACFS, OEM, RMAN, Data Pump, Import/Export, SAP Netweaver, EMC SAN, SRDF
Confidential, St. Louis, MO
Sr. Database|Hadoop Engineer
Responsibilities:
- Architected and implemented 12 node hadoop cluster HDP with Kerberos authenticationusing windows Active Directory on vmware ESX cluster.
- Evaluate hadoop security features in CDH and HDP environments.
- Implemented scoop to bring data in and out of hadoop.
- Single handedly built the hadoopsystems from scratch - Storage, OS, Hadoop on physical & virtual env.
- Design and implement migration strategies for database footprint as part of datacenter migration to move the DB infrastructure to newly built datacenter.
- Lead planning and implementation of Oracle 11g RAC server physical move to new datacenter with zero/minimal downtime. RAC infrastructure involves 15 RHEL servers with 47TB of SAN on DMX.
- Coordinate with application owners to determine possible database replatforming to the strategic platform and decommission/retire based on the business data retention requirements.
- Design and develop standards and methodologies to migrate legacy 8i, 9i, 10g databases to 11gR2 RAC.
- Upgrade Oracle RAC Grid Infrastructure from 11.2.0.2 to 11.2.0.3 to 11.2.0.4 with zero downtime
- DMX to VMAX storage migration - Migrate ~40TB of Database storage on DMX storage array to VMAX spanning 3 RAC’s using Oracle ASM with minimal end user impact.
- Lead Design and Execution of SAP OS/DB Migration involving multiple SAP modules ECC, BW, BI from 10g DB server on AIX with DMX storage to 11gR2 on RHEL 4-node RAC with VMAX storage
- Deploy Private cloud computing database infrastructure leveraging Oracle RAC 11gR2 technology adoption for SAP Oracle database environment.
- Design, Implement and support the lifecycle of Oracle database infrastructure for SAP applications such as ECC, CRM, BI, SCM, SRM & Enterprise PORTAL business solutions.
- Work closely with SAP Basis to install SAP databases using SAP Netweaver 7.02 - convert standalone DB to RAC with ASM and Netweaver 7.31- to install cluster DB on RAC.
- Downsize and defragment Large SAP Databases by export/import, cloning those using RMAN duplicate features and then upgrading them to Oracle 11g.
- Implement 10g physical standby for SAP CRM database on 4-node 10g RAC using Data Guard for Disaster Recovery as an alternative to EMC SRDF setup on DMX.
- Perform database refresh from production to non-production environment using RMAN and Data pump.
- Apply patches for bug fixes, patch sets, and patch set updates (PSU) and critical patch updates (CPU) to keep the database environment up to date.
- Plan and migrate 8i/9i/10g databases on AIX, SUN to 11g RAC on RHEL.
- Design and coordinate with SAN engineer to implement DR solutions for Database recovery across the Datacenters using EMC SRDF technology. Support in setup ofBCV splitsfor mirroring and replication.
- ConfigureSQL Mirroring and Log Shippingfor high availability and disaster recovery purposesfor MS SQL Server 2012databases.
- Ensure appropriate database data storage/backup/recovery, fault tolerance and disaster recovery technologies are implemented as part of system solutions.Participate in regular DR exercises.
- Configure Uni-directional and Bi-directional replication usingGoldenGatefor clinical trial databases.
- Design, implement, configure Oracle Enterprise manager11g Grid Controlto monitor database systems and generate tickets based on the criticality of the alert by integrating with BMC Remedy.
Environment: RHEL 5.3/5.5,AIX, Solaris, Oracle 8i, 9i, 10g, 11g, RAC, OEM, RMAN, Oracle streams, Data Guard, Data Pump, Import/Export, SAP Netweaver, EMC SAN, SRDF, Diagnostic and Tuning Advisors
Confidential, Columbus, OH
Sr. Database Administrator
Responsibilities:
- Design, Build and support 10g & 11gR2 RAC, standalone databases on multiple OS platforms (AIX / Sun Solaris servers) and file systems (raw, ASM, ocfs2).
- Upgrading and Migrating oracle databases from 10.2.0.4/10.2.0.5 on Sun Solaris to 11gR2 on AIX.
- Design and implement multiple2-node 11gR2 RAC with ASM on AIX.
- Configure and manage physical standby database using active data guard for disaster recovery on various production databases.
- Installand configure Golden Gate 11.x, 10.x and implement GG initial-loads, Uni directional replication. Involve in troubleshooting extract & replicate process on source as well as target systems.
- Perform database tuning using AWR, ADDM, ASH, TKPROF, Oracle Enterprise Manager, Toad and use OS utilities (NMON, VMSTAT) to analyze the CPU, RAM, DISK performance.
- Involve in reorganizing/rebuilding tables, partitions, indexes, materialized views and LOB segments.
- MonitorOEM alerts, space alerts, alert log errors and performance issues on the production databases. Assist application teams in finding the hot blocks and tune code so as to not hit the hot blocks, monitor blocking users and dead locks.
- Performday-to-day database administration activities including user management (creating users, synonyms, privileges, roles, quotas, tables, indexes, sequences etc.), space management (tablespace, rollback segment), and monitoring (alert log, memory, disk I/O, CPU, database network connectivity).
- Involve in 24x7 production database maintenance and on-call support
Environment: AIX 5.3/6.1, Solaris, Oracle 9i 10g, 11g, RAC, ASM, OEM, RMAN, Oracle streams, GoldenGate, Data Guard, Data Pump, Import/Export, Shell Scripting,Toad, Diagnostic and Tuning Advisors
Confidential, Piscataway, NJ
Database Administrator
Responsibilities:
- Install and configure Oracle 11g database servers on RHEL and Solaris Environments.
- Design, install and configure2-node 11gR2 Real Application Clusters (RAC).
- Configure physical standby and logical standby databases of 11gR2 primary database using Data Guardfor fail-over.
- Installation of 11g OEM Grid Control and configure agents.
- Installation and configuration of Golden Gate for replication.
- Scheduling and monitoring RMAN and export (hot/cold)database backups.
- Migrating and upgradingOracle 10g database to Oracle 11gR2 using Export/Import, Data Pump and transportable tablespace techniques.
- Create PL/SQL Stored Procedures, Triggers and Packages, Functions, Views and Materialized views.
- Deploy several shell scripts to monitor and maintain Partitions, Tablespaces, Data Guard status, Users creation, Synonyms the Database.
- PerformSQL*Loader jobs for loading data from external files.
- Involve in Database Performance tuning and Query tuning using different methodologies.
Environment: RHEL, Oracle10g, 11g, RAC, OEM, RMAN, Oracle streams, Data Pump,Import/Export, Diagnostic and Tuning Advisors
Confidential, IL
Application Programmer II
Responsibilities:
- Involve in Database design for new applications.
- Design and create database objects such as Tables, Views and Indexes.
- Design and developStored Procedures, Functions and Triggers.
- Create and link SQL views, queries to Crystal Reports
- Code, test, debug, and maintain programs
- Develop, enhance, and maintain numerous SQL Reports.
- Create documentation and user manuals for database configuration and application development.
- Plan and migrate applications from VB 6.0 to VB.NET
- Support the application development team in building applications using SQL, VB.NET and Java.
- Work extensively with Data Adapter, Dataset, and Data reader to access and update database.
- Work with crystal reports and .Net report viewers.
Environment: MS SQL Server 2008/2010, MSVisual Studio 2008/2010, Visual Basic 6, VB .Net, Crystal Reports
Confidential
Technical Coordinator
Responsibilities:
- Deliver guest lectures on GNU/Linux administration and philosophy of Free Software to promote the use of Free and Open Source Software’s FOSS .
- Conduct and coordinate workshops and other training sessions on Free and Open Source Software’s.
- Resource person to deploy and demonstrate free software technologies.
- MySQL, Oracle 10g Database Installation and development.
- Porting conventional Websites to Content Management System like Drupal.
- Install and maintain GNU/LinuxInfrastructure software servers on hundreds of Lab Servers in various colleges and schools as part of the localization and Open Source acquaintance project.
- Research and install various open source software alternatives for the proprietary software’s.
- Coordinate and lead a team of 20 members for a project that was aimed at developing a free Operating System for engineering students giving them the flexibility & freedom to use the system without having to purchase & install proprietary software’s.
- Involve in development of free Operating System that provides free software alternatives for all the proprietary software’s used in engineering colleges on GNU/Linux platform using Live Helper.
Environment: GNU/Linux, MySQL, Drupal, LAMP, Virtual Box