SUMMARY

• Over 10 + years of overall experience in IT as a Systems Administrator on multiple Operating systems like Linux/AIX with cross platform integration experience using Hadoop
• Around 3 years of experience in Hadoop Administration using Hortonworks (HDP) & Cloudera (CDH) Distributions
• Hands on experience in installing, configuring, and using Hadoop ecosystem components like HDFS, MapReduce, Hive, Hbase, Sqoop, Pig, Oozie, Zookeeper, Solr, Hue, Flume, Spark & Yarn distributions.
• Experience in performing backup and disaster recovery of Name Node metadata and important sensitive data residing on cluster.
• Experience in Hadoop Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
• Experience in minor and major upgrades of hadoop and hadoop eco system
• Experience in Hadoop administration activities such as installation, configuration and management of clusters using Cloudera Manager & Ambari.
• Good Understanding of the Hadoop Distributed File System and Eco System (MapReduce, Pig, Hive, Sqoop and HBase)
• Good knowledge on Hadoop HDFS architecture and MapReduce framework.
• Experience in monitoring the health of hadoop cluster and also performing multiple
• Administrative cluster maintenance such as commissioning /decommissioning data nodes
• Experience in importing and exporting data between HDFS and Relational Database Management systems using Sqoop and troubleshooting for any issues.
• Experience in monitoring and reviewing Log4j logs
• Experience in ingestion, storage, querying, processing and analysis of Big Data using.
• Different tools including MapReduce, YARN, HDFS, Hive, Pig, Hbase, Sqoop, Flume, Oozie.
• Providing Change, Problem & Incident Management using Tools like Remedy, Maximo, Chipre, SharePoint and Manage Now.
• Maintain and use Red Hat Kickstart servers, Jumpstart, Ignite Installation Methods and NIM Master for installs and upgrades.
• Expertise in Installation, administration, upgradation, configuration, patching, performance tuning and troubleshooting of Red Hat Linux 4/5/6, Sun Solaris 8/9/10 & AIX 5.3/6.1/7.1
• Have flair to adapt to new software applications and products, self - starter, have excellent communication skills and good understanding of business work flow.

TECHNICAL SKILLS

Big Data Technologies: Hadoop, HDFS, Map Reduce, YARN, PIG, Hive, Hbase, Smartsense, Zookeeper, Oozie, Ambari, Kerberos, Knox, Ranger, Sentry, Spark, Tez, Accumulo, Impala, Hue, Storm, Kafka, Flume, Sqoop, Solr,Nifi,Airflow

Hardware: IBM pSeries,pureflex,RS/6000,IBM Blade servers, HP Proliant DL 360,380, HP Blade servers C6000,C7000

SAN: EMC Clarion, EMC DMX, IBM XIV, Dell

Operating Systems: Linux, AIX, CentOS, Solaris & Windows

Networking: DNS, DHCP, NFS, FTP, NIS, Samba, LDAP, Open LDAP, SSH, Apache, NFS, NIM

Tools: & Utilities: Managenow,Remedy,Maximo,Nagios,Chipre & SharePoint

Databases: Oracle 10/11g, 12c, DB2 & MySQL

Backups: Veritas Netbackup & TSM Backup

Virtualization: VMware vSphere, VIO

Cluster Technologies: HACMP 5.3, 5.4, Power HA 7.1, VERITAS Cluster Servers 4.1

Web/Application Servers: Tomcat, WebSphere Application Server 5.0/6.0/7.0, Message BrokerMQ Series, Web Logic Server, IBM HTTP Server.

Cloud Knowledge: Openstack, AWS

Scripting & Programming Languages: Shell, Perl, Python

PROFESSIONAL EXPERIENCE

Confidential, Richardson, TX

Hadoop Administrator

Responsibilities:

• Worked on multitenant clusters environment where in the biggest one has 400+ nodes hosted.
• Commissioning & decommissioning of datanodes when required.
• Supporting the existing and new data load jobs.
• Upgraded Ambari from 2.2.1 to 2.4.0.
• Upgraded HDP from 2.3 to 2.4 for production cluster and upgraded to 2.5.3.0 for POC Lab
• Setting up Cross Realm for Distcp for the inter cluster data transfer.
• As a part of DTV migration used Falcon for migrating data from CDH to HDP.
• Taking care of Day-to-Day running of clusters.
• Installed and configured HDP cluster and other Hadoop ecosystem components.
• Configured smart sense for bundle creations to upload HWX portal for cluster tuning and performance.
• Scheduling TWS jobs & troubleshooting the issues for any failures.
• Provided support for all the maintenance activities like OS patching, hadoop upgrades, configuration changes.
• Installed & Configured Nifi, Falcon, Smartsense & Airflow on few clusters.
• Developed automated scripts using Unix Shell for running Balancer, file system health check and User/Group creation on HDFS

Environment: Hortonworks (HDP 2.4), Ambari, Map Reduce 2.0(Yarn), HDFS, Hive, Hbase, Pig, Oozie, Sqoop, Spark, Flume, Kerberos, Zookeeper, Smartsense,Airflow,Falcon,DB2, SQL Server 2014, RHEL 6.x, Python, Kerberos, SAS, Storm, Kafka.

Confidential, St. Louis, MO

Hadoop Administrator

Responsibilities:

• Responsible for implementation and administration of Hadoop infrastructure.
• Continuous monitoring and managing the Hadoop cluster using Cloudera Manager
• Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required
• Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, HDFS, Hive, and MapReduce access for the new users.
• Inputs to development regarding the efficient utilization of resources like memory and CPU utilization based on the running statistics of Map and Reduce tasks
• Importing and exporting data into HDFS and Hive using Sqoop.
• Commission or decommission the data nodes from cluster as needed.
• Cluster coordination services through Zoo Keeper.
• Configure Cloudera manager High availability.
• Configure YARN and tune YARN settings to improve performance
• Upgraded Cloudera manager from CM4 to CM5
• Upgraded Cloudera hadoop cluster from CDH4 to CDH5
• Taking HDFS backup to storage (Isilon)
• Written automated script to monitor HDFS and HBase through Cron jobs.
• Working on issues related Java & debugging them for the root cause.
• Day to day support for the cluster issues and job failures.
• Working with Dev Team to tune Job Knowledge of Writing Hive Jobs.

Environment: Cloudera Manager, HDFS, YARN (MR2), Cloudera CDH4/5, Hive, Impala, Zookeeper, Sqoop, Hbase, Solr, Sentry, CentOS 6.x & RHEL 6.x, Python

Confidential, Minnetonka, MN

Unix/Hadoop Administrator

Responsibilities:

• Installed and configured HDP cluster and other Hadoop ecosystem components.
• Proactively monitored systems and services, architecture design and implementation of Hadoop deployment, configuration management, backup and disaster recovery systems and procedures
• Proactively monitored Map Reduce Programs for those are running on the cluster
• Involved in loading data from UNIX file system to HDFS
• Monitoring Hadoop cluster using Ambari
• Supported Map Reduce Programs those are running on the cluster
• Configured Namenode high availability
• Experience in cluster tuning by changing the configuration parameters.
• Defined file system layout and data set permissions.
• Importing and exporting data into across RDBMS and Hive using Sqoop
• Commissioning and Decommissioning Nodes as per requirement.
• Worked with Hadoop developers, designers in troubleshooting map reduce job failures and issues and helping to developers.
• Worked with network and Linux system engineers to define optimum network configurations, server hardware and operating system.
• Evaluate and propose new tools and technologies to meet the needs of the organization.

Environment: Hortonworks (HDP 2.2), Ambari, Map Reduce 2.0(Yarn), HDFS, Hive, Hbase, Pig, Oozie, Sqoop, Spark, Flume, Kerberos, Zookeeper, DB2, SQL Server 2014, CentOS, RHEL 6.x

Confidential, Oakland, CA

Unix Administrator

Responsibilities:

• Experience in building, testing & troubleshooting on AIX & RHEL platforms
• Administer Linux servers, other UNIX variants, and managed hadoop clusters.
• Worked on professional services engagements to help customers design, build clusters, applications, troubleshoot network, disk and operating system related issues.
• Patching OS with latest packages on AIX and Redhat Linux machines
• Installing upgrading and managing packages via RPM and YUM package management.
• Firmware Upgrades, kernel patches, systems configuration, performance tuning on Unix/Linux systems
• Analyzing the issues and providing the fixes.
• Responsible for supporting the existing infrastructure and support for Production and Non-production servers. Worked on high and critical priority tickets, coordinating with different teams, and customer and provided with appropriate RCA’s.
• Point of Contact for Vendor escalation

Environment: AIX 6.1/7.1, RHEL 6.x, Shell scripting, pSeries & HP h/w, Remedy, Oracle 11g/12c, Agile

Confidential, Sunnyvale, CA

Unix/Linux Administrator

Responsibilities:

• Providing Change Management and Problem Management using the Tools SharePoint & Chipre.
• Installed, Configured and Maintained Red Hat /Solaris Linux (Solaris 8, 9 & 10, RedHat Enterprise Linux 4.x, 5.x & 6.0) on SPARC, x86 and HP, IBM Blade Centers.
• Kernel upgradation, Compilation, Tuning and configuring kernel parameters to optimize and enhance the Performance.
• Package management, Install, remove and update and querying packages using YUM in Red Hat Linux & supported Redhat servers in Production and Development environments
• Built AIX VIO servers & Clients through NIM installation.
• Migrating OS from AIX 5.3 to AIX 6.1 & SAN Data from Hitachi to IBM XIV.
• Migrations of Lpars from Old Hardware to New Hardware. (p570/p 5 & p6)
• Upgraded ML/TL & service packs to latest levels on AIX machines as and when required.
• Updated FC adapters for both directly SAN attached and virtual clients.
• Configuring SNMP to register the lpar as client to Nagios server.
• Experience in implementation of sendmail, Fetchmail, pop3 and imap and SMTP.
• Installed, configured and implemented Oracle RAC (Real Application Cluster) environment as per standards with help of Oracle DBAs
• Administration of monitoring infrastructure consisting of Nagios server with Centreon as web interface for configuration and display of performance data.
• Migrating logical volumes, mirroring VGs and LVs, copying logical volumes, export and importing volume groups. Working experience on LVM to create & extend logical volumes
• Experience in File system maintenance and file integrity check tools like tripwire.
• HACMP Cluster configuration, plan, design HACMP cluster nodes, Network configuration, configuring disk heart beats, non ip heart beats, performing failover testing, verification, synchronization & administration
• Installing & configuring TSM Backup client & Message Broker software on the Lpars.
• Performance tuning, capacity planning and recommendations.
• Implementation and troubleshooting of network services like IP Bonding, NFS, FTP, SAMBA, NTP, IPTABLES, Telnet, SSH.

Environment: Red Hat Linux 5, 6 AIX 5.3, 6.1, 7.1 pSeries Server, Solaris 8, 9, CentOS, Sun Enterprise Server, TSM, EMC Clariion, HP Proliant, Oracle 10g/11g,Sharepoint, Chipre, Perl & Shell scripting.

Confidential, Minneapolis, MN

UNIX Administrator

Responsibilities:

• Worked on Change Management & Problem Management using Tools like Remedy, Maximo & Manage Now.
• Built VIO servers & Clients through NIM installation
• Handled Patch Management to control vulnerability.
• Upgraded servers to latest ML/TL & microcode on the frame through HMC.
• Upgraded the SDD & SDDPCM drivers & HMC to latest levels
• Upgraded HBA and other system firmware to latest levels.
• Installed and upgraded of OpenSSH 4.3p1 on AIX 5.2 and 5.3, OpenSSH 4.1p1 on AIX 5.1 servers.
• Migrated AIX oslevel from AIX 5.3 to AIX 6.1 & performed TL/ML updates.
• Managing File systems, paging spaces issues & Managing Disk space using LVM.
• Monitoring performance of AIX servers, Memory, CPU, Network and Disk activities and analyzing these reports and finding any issues that occur.
• Disk replacement techniques, replacing fault disks, working on issues on related to volume management, file system management.
• Configuring TCP/IP AND NFS services and troubleshooting.
• Migrating and managing LV, mirroring VGs and LVs, copying logical volumes, export and importing volume groups.
• Installing new packages and file sets when required by the developers.
• Configuring cron jobs, and working on cron logs to checking for job status.
• Configuring the private repository for accessing the packages with yum.
• Package and Patch administration on the Solaris & Red Hat Linux.
• Monitoring and troubleshooting Backup failures using VERITAS Backup Exec.
• As a member of Security Compliance Team, involved in audits & User revalidations.
• Patch administration & User administration on the Linux & AIX boxes.

Environment: Red Hat Linux 5, 6 AIX 5.3, 6.1, 7.1, pSeries Server, Veritas Net Backup, Solaris 8,9, HP 9000 K, L, N Class Server, Solaris Volume Manager, Maximo, Managenow.

Confidential, Irving, TX

Systems Administrator

Responsibilities:

• Configure and working on Solaris & AIX using SPARC & pSeries hardware in 24X7 Build & Break fix production Engineering UNIX Support
• Handling Incident and Change Management tickets using Service Now & remedy ticketing system
• Working Knowledge with System Performance related Issues and network availability
• Handling AIX & Solaris servers commissioning & Decommissioning requests
• Migrations of Lpars from Old Hardware to New Hardware. (p570/p 5 & p6)
• Patch administration & User administration on the AIX & Solaris boxes
• Migrating logical volumes, mirroring VGs and LVs, copying logical volumes, export and importing volume groups.
• Configuring cron jobs, and working on cron logs to checking for job status.
• Configuring new devices, working with configuration manager (cfgmgr).
• Configuring TCP/IP AND NFS services and troubleshooting.
• Monitoring performance of AIX servers, Memory, CPU, Network and Disk activities and analyzing these reports and finding any issues that occur.
• Working experience on EMC SRDF and Hitachi data storage technologies
• Managing AIX on production environment hosting various applications like WebSphere, Siebel, Inforte, Message Broker etc along with databases DB2 & Oracle.

Environment: Red Hat Linux 5, 6 AIX 5.3, 6.1, 7.1, pSeries Server, HP DLseries G8, Dell Hardware, Solaris 8/9,Service Now, Remedy.

Confidential, Minnetonka, MN

Systems Administrator

Responsibilities:

• Installation & Maintenance of Solaris, & AIX
• Handle Incident, Problem, Change and Service tickets by using Remedy.
• User and package management.
• Management of system security, user and group privileges, local disk devices& file system.
• Systems Troubleshooting H/W ranging from PC to Enterprise Servers. configuring Jumpstart servers for complete hands-free installation of workstations, with custom profiles, begin/finish scripts, custom package suites/clusters
• Managing NFS environment with Auto mount, NIS Master / Slave servers and Clients
• Taking backups, performing recoveries using standalone tape drives.
• Level1 monitoring and escalating issues to level2/3 teams.
• Root Disk mirroring using Solstice Disk Suite.

Environment: IBM AIX 4.3.3, 5.1, 5.2, Solaris 8/9/10, Red Hat Linux 4/5, Sun Enterprise Servers, SUN FIRE 6800/E6500/E4500, Sun Sparc1000, IBM RS/6000, Disk Suite, Remedy