We provide IT Staff Augmentation Services!

Senior Hadoop Administrator Resume

5.00/5 (Submit Your Rating)

Los Angeles, CA

SUMMARY

  • 9+ years of total IT experience as Oracle database Administration and Hadoop Administration.
  • Experience in installation, configuration, supporting and managing Hadoop clusters of Apache hadoop, CDH3 and CDH4, Pivotal HD high availability environment.
  • Implemented in setting up standards and processes for Hadoop based application design and implementation.
  • Documented and explain implemented processes and configurations in upgrades.
  • Supported hadoop development, testing and operations teams during new system deployments.
  • Evaluate and propose new tools and technologies to meet the needs of the organization.
  • Experience in using Pig, Hive, Scoop, HBase and Cloudera Manager.
  • Good hands on experience on Hadoop Cluster architecture and monitoring the cluster.
  • An excellent team player and self - starter with good communication skills and proven abilities to finish tasks before target deadlines.

TECHNICAL SKILLS

Hadoop eco system: Hadoop, Hive, sqoop, Hdfs, Map-reduce, Yarn, hcatalog, Pig-latin, Impala, hue, oozie flume 1.4

Hadoop Distributions: Apache hadoop, cloud era 3, cloudera 4.6.0, cloudera manager 4.8.2 Pivotal hd 1.1.1(hadoop 2.0.5 Version), Horton works hadoop.

Analytics tools: Datameer, tableau, GPtext

Monitoring tools: Nagios, Ganglia, Cloudera manager, Pivotal command center

RDBMS versions: Oracle 9i, 10g, 11g MySQL, Greenplum, Postgresql

RDBMS Tools: Toad, Tkprof, SQLTRACE

Operating Systems: REDHAT Enterprise Linux 4.0, 5.0, OEL 4.x. 5.x, 6.x Windows 2KServer,Windows XP

Scripting: UNIX Shell Scripting, Hadoop fs, shell, sed, Perl

Languages: C, C++, Java, SQL, PLSQL

PROFESSIONAL EXPERIENCE

Confidential, Los angeles, CA

Senior Hadoop Administrator

Responsibilities:

  • Installed 3 production cluster with CDH version of 4.6 and cloudera manager version 4.8.2 on total of 14,9,9 node respectively.
  • Configured high availability of name node and gateway node.
  • Setup hive metastore and cloudera manager metadata store on oracle database.
  • Experience in recovery of name node from backup metadata and trouble shooting of name node high availability. Ensured data integrity using hdfs fsck for block corruption.
  • Good work experience on setup of hue, beeswax, impala and oozie. experience in creating workflow through oozie to create table in hive and analyze the data.
  • Good experience in setup of flume agents and configured with different channels and sinks.
  • Monitored shipping of log file and user activities on hadoop cluster, checking of hadoop and system log files to resolve if there are any issues.
  • Hands-on experience with "Productionalizing" Hadoop applications such as administration, configuration management, debugging, and performance tuning.
  • Worked with development team to identify the issue of production custom application and troubleshooting the same.
  • Worked with development and offshore admin team to identify the possible issues of custom applications before it comes to production.
  • Provided information about how we can achieve performance by monitoring production applications closely.
  • Good experience on basic Linux system administration tasks and having good experience on Linux system

Confidential, Dublin, CA

Hadoop Administrator:

Responsibilities:

  • Good experience in setup of Pivotal HD cluster through pivotal command center as well as manual installation.
  • Experience in recovery of name node from backup metadata and trouble shooting of name node high availability. Ensured data integrity using hdfs fsck for block corruption.
  • Experience on setting up hive metastore using postgresql database and experience in backup of hive metadata using pg dump utility and restore.
  • Experience in monitoring health of hadoop cluster using pivotal command center, nagios. And trouble shooting of map reduces jobs, yarn jobs.
  • Hands on experience in installation and trouble shooting of hadoop tools such as sqoop, pig, hive, oozie, hcatalog and have good working experience like importing table from rdbms to hadoop and vice versa through sqoop. Analysed logs through pig and hive. Created index and analysis of data through gptext.
  • Hands on experience in administration of hbase and zookeeper.
  • Installed and configured nagios and nrpe tools to monitor system load, resource utilization, user activities and implemented tools to monitor hadoop and hbase health.
  • Good working experience in data Meer and tableau visualization tool.
  • Monitored shipping of log file and user activities on hadoop cluster, checking of hadoop and system log files to resolve if there are any issues.
  • Hands-on experience with "Productionalizing" Hadoop applications such as administration, configuration management, debugging, and performance tuning.
  • Good experience on basic Linux system administration tasks and having good experience on Linux system environment.
  • Wrote shell scripts to automate shipping of heterogeneous data to hadoop environment.
  • Worked with Linux server admin team in administering the server hardware and operating system.

Confidential

Hadoop Admin / Oracle DBA Consultant:

Responsibilities:

  • Experience in setup of clusters utilizing cloud era manager and manual and automated installation of Cloudera’s Distribution including Apache Hadoop CDH3, CDH4 environment.
  • Installation of Linux OS and setup of SSH in cluster for remote communication between nodes.
  • Experience in RPM and Tar ball installation. Created Linux users and groups.
  • Experience in basic Linux system administration like user management,
  • Created hdfs users and assigned quotas on HDFS file system.
  • Backup of name node metadata and hive metadata.
  • Monitored logs and system health check and Ensured data integrity using fsck for block corruption.
  • Good knowledge of Hadoop cluster connectivity and security and knowledge in performance troubleshooting, tuning Hadoop Clusters
  • Installed and Monitored clusters through GUI Dashboard and nagios
  • Created shell scripts to delete log files of hadoop periodically.
  • Experience in Recovery of Name node using nfs mounted file system backup of name node.
  • Good understanding of java concepts and Implemented pig script for map reduce job.
  • Loading of data from heterogeneous data source to hdfs
  • Installed and configured hive, sqoop for data analysis
  • Used sqoop to import data from oracle into hive environment after analyzing that data exported back to oracle database.
  • Loaded web server logs into hive tables and analyzed for customer interest on products and product support.
  • Designed and implemented a prototype for web log analysis using Hadoop technology stack. Designed processes for near real-time analysis of transactional data and weblogs.
  • Created external table and partitioned tables in hive for querying purpose
  • Good Knowledge on Data warehouse concepts and Working knowledge on OBIEE RPD and report creation, tableau visualization tool
  • Worked with Linux server admin team in administering the server hardware and operating system
  • Working knowledge on Amazon EC2
  • Installation and configuration of Oracle 9i/10g server and creation of databases.
  • Manage Oracle Application Suite 11.5.10.2 with DB Version 11gR2 under asm with 2 nodes RAC.
  • Familiar with hot backup using RMAN and shell scripts.
  • Troubleshooting target monitoring status and patching through OEM
  • Refresh the database using rman recovery and using hot backup files with archive log files on point-in-time recovery methods.
  • Up gradation of database version like 9i to 9i.x and 9i to 10g. Also, 10g.x to 10gR2 etc.
  • Database internal security Administration.
  • Working knowledge on Form and Reports 6i. Also assists core developers to develop fine-tuned reports.
  • Installation and Maintenance of 11.5.10 Application version
  • Patch application involving mini patches and maintenance patches using ad patch tool
  • Maintaining application files using adadmin tool involves all compile and organize application related files.
  • Perform certified 11i Clone methodology.
  • Involved the E-Business suite patch process includes Analyze with pre, post installation steps using ad patch, adctrl.
  • Hands on in APPS admin tools like adadmin, adctrl, ad patch, admerge etc.

Confidential

Oracle database Administrator:

Responsibilities:

  • Installation and configuration of Oracle 9i/10g server and creation of databases.
  • Performed logical backup through export utility and hot backup using RMAN and shell scripts.
  • Troubleshooting target monitoring status and patching through OEM
  • Refresh the database using rman recovery and using hot backup files with archive log files on point-in-time recovery methods.
  • Up gradation of database version like 9i to 9i.x and 9i to 10g. Also, 10g.x to 10gR2 etc.
  • Working knowledge on Form and Reports 6i. Also assisted core developers to develop fine-tuned reports.
  • Installation and Maintain 11.5.10 Application version
  • Patch application involving mini patches and maintenance patches using ad patch tool
  • Maintaining application files using adadmin tool involves all compile and organize application related files.
  • Performed certified 11i Clone methodology.

Environment: Oracle ERP 11i, Oracle database Enterprise edition 9i, 10g.

Confidential

Responsibilities:

  • Installation and configuration of Oracle 9i/10g server and creation of databases.
  • Configured and maintained various databases of 9i and 10gR2.
  • Space optimization and Management like adding data files etc.
  • Created User and profile for database space usage and Management, Security
  • Analyzed the SQL statements and helped developers to write fine-tuned SQL statements
  • Worked with Development team to implement all changes and new project plans and physical/logical designs.
  • Implemented Hot backup and cold backup, logical backups. Used scripts to automate backups.

Environment: Oracle ERP 11i, Oracle Database Enterprise Edition 9i/10gR2.

Confidential

Responsibilities:

  • Performed upgrade from oracle 9i to 10gR2 Enterprise Edition.
  • Cloning of production Instance for development and patch testing.
  • Applied oracle applications Maintenance patches, Minipack updates.
  • Tuning database on Initialization parameters, I/O bottleneck, Memory usage
  • Planning for storage spaces requirements and placing them for optimum I/O performance
  • Develop Test and Implementing Sound backup and Recovery Strategy using RMAN.
  • Monitor ERP Suite using Oracle Applications Manager
  • Implemented Oracle Alert Management (ALR) which will alert customers for all ERP module alerts
  • Design/Develop shell scripts to make automation on backup/recovery and other DB management tasks such as Space/Memory/IO thresholds.
  • Oracle 10g Database administration with ERP support
  • Performed Oracle Database tier patch with Critical patch updates and rollups.
  • Analyzed the Database performance using oracle utilities such as Oracle Enterprise Manager and automated scripts.
  • Involved in planning of Storage management and database sizing procedures
  • Troubleshoot all areas of the Oracle database environment
  • Implemented Hot, cold and logical backup scripts to automate the backup procedures
  • Perform frequent cloning and refreshes based on the oracle suggested method like Rapid Clone using auto config and its tools.

Environment: Oracle ERP (11.5.8), 10g

We'd love your feedback!