SUMMARY

• Over 8 years of Professional experience in IT background which includes 3+ years in Hadoop Technologies and extensive experience in Linux
• Good working knowledge in Big data ecosystem related technologies
• Experience in implementing Data Warehousing/ETL solutions for different domains like financial, telecom, loyalty, Retail and insurance verticals
• Hands on experience in installing, configuring Hadoop ecosystem components like Hadoop MapReduce, HDFS, HBase, Oozie, Hive, Sqoop and Pig
• Assisted in designing, development and architecture of Hadoop eco system.
• Knowledge in programming Pig and Hive languages.
• Expert in dealing with structured, semi - structured and unstructured data in Hadoop eco system.
• Handled importing of data from various data sources, performed transformations using Hive, Pig, loaded data into HDFS and HBase.
• Experience in providing security for Hadoop Cluster with Kerberos
• Installation and configuration, Hadoop Cluster and Maintenance, Cluster Monitoring and Troubleshooting and Transform data from RDBMS to HDFS
• Assisted in tuning the performance of Hadoop eco system as well as monitoring.
• Assisted in Loaded data from various data sources into Hadoop HDFS/Hive Tables
• Good working knowledge of business intelligence tools like Business Objects
• Experience in Data Warehousing and ETL processes
• Supported technical team members for automation, installation and configuration tasks.
• Installing and Administration Namenode and Jobtracker High Availability
• Benchmarking and Stress Testing an Hadoop Cluster
• Implemented Big Data analytics platform using Horton works Hadoop multiple clusters across two datacentres. Provided administrator support to the new platform
• Cassandra Performance Tuning on Hadoop Manage and operate 10+ cassandra clusters
• Experienced in job workflow scheduling and monitoring tools like Oozie and Zookeeper.
• Good Experienced managing Linux platform servers
• Working with data delivery teams to setup new Hadoop users.
• This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users
• Shell scripting experience with Linux flavored O/S
• Installation, cluster upgrades, patching and routine maintenance for Hadoop cluster and eco systems
• Monitor Hadoop cluster job performance and capacity planning.

PROFESSIONAL EXPERIENCE

Confidential - Boston, MA

Sr Hadoop Admin

Responsibilities:

• Installing, Configuring, benchmarking and managing Apache Hadoop, Cloudera Hadoop and Hortonworks on Linux servers.
• Assisted in designing, development and architecture of Hadoop and HBase systems.
• Coordinated with technical teams for installation of Hadoop and third related applications on systems.
• Experience on administration of HDFS, HIVE and HA MR2 / YARN.
• Provided technical assistance for configuration, administration and monitoring of Hadoop clusters.
• Installing and Configuring Cloudera Manager and install CDH, managed service, and Cloudera Manager Agent software on the hosts.
• Experience in improving the Hadoop cluster performance by considering the OS kernel, Storage, Networking, Hadoop HDFS and Map-Reduce by setting appropriate configuration parameters.
• Formulated procedures for planning and execution of system upgrades for all existing Hadoop clusters.
• Installing and monitoring the Hadoop cluster resources using Ganglia and Nagios.
• Experience in designing and implementation of secure Hadoop cluster using Kerberos.
• Experience in managing Hadoop infrastructure like commissioning, decommissioning, log rotation, rack topology implementation.
• Experience in using Zookeeper for coordinating the distributed applications.
• Configuring, installing, managing and administrating HBase clusters and scheduling jobs using Oozie workflow.
• Managing the cluster resources by implementing fair scheduler and capacity scheduler.
• Upgrading Hadoop cluster from current version to minor version upgrade as well as to major versions.
• Implemented IMPALA for data processing on top of HIVE.
• Created Oozie workflows to automate data ingestion using Sqoop and process incremental log data ingested by Flume using Pig.
• Supported technical team members for automation, installation and configuration tasks.

Confidential, Atlanta, GA

Hadoop Admin

Responsibilities:

• Worked with technology and business groups for Hadoop migration strategy.
• Research and recommend suitable technology stack for Hadoop migration considering current enterprise architecture.
• Installed and configured various components of Hadoop ecosystem and maintained their integrity.
• Validated and Recommended on Hadoop Infrastructure and data center planning considering data growth.
• Worked with Linux server admin team in administering the server hardware and operating system.
• Monitored Hadoop cluster, workload, job performance environments using Data dog and Cloudera Manager.
• Developed MapReduce programs and Hive queries to analyze sales pattern and customer satisfaction index over the data present in various relational database tables.
• Worked extensively in performance optimization by adopting/deriving at appropriate design patterns of the MapReduce jobs by analyzing the I/O latency, map time, combiner time, reduce time etc.
• Developed Pig scripts in the areas where extensive coding needs to be reduced.
• Performed data analytics in Hive and then exported this metrics back to Oracle Database using Sqoop.
• Perform maintenance, monitoring, deployments, and upgrades across infrastructure that supports all our Hadoop clusters.
• Implemented Partitioning, Dynamic Partitions, Buckets in Hive
• Debugging and troubleshooting the issues in development and Test environments.
• Conducting root cause analysis and resolve production problems and data issues.
• Proactively involved in ongoing maintenance, support and improvements in Hadoop cluster.
• Document and manage failure/recovery (loss of name node, loss of data node, replacement of HW or node)
• Followed agile methodology for the entire project.

Confidential, Chicago, IL

Linux System Administrator

Responsibilities:

• Responsible system administration tasks, like Installing Operating System, Operating System patching, software Installation
• Operating System upgrades, Hardware upgrades, troubleshooting and problem resolution.
• Racking and Cabling Servers in the Data Center.
• Supporting Red Hat/Centos Linux Development, Quality Assurance and Production Environments.
• Administrating system/network services such as puppet, DNS, SAMBA, YUM repos, sendmail, and NFS.
• Administrating user accounts using NIS.
• Maintaining Domain Names System (DNS) servers.
• Monitoring Systems using Nagios.
• Managing System configurations using Puppet.
• Administrating Disks using Logical Volume Manager (LVM) and Veritas Volume Manager (VxVM).
• Building Linux virtual machines using KVM.
• Performed day to day Linux administration such as user accounts, directory services, file system shares, and permissions etc.
• Setup NFS and Samba File sharing setup on Linux and Windows servers.
• Created status reports, project plans and attend team meetings to coordinate activities.
• Installing and Configuring Veritas Cluster Services in Linux servers for Highly redundant applications.
• Supporting following change management process for production system.
• Patching red hat Linux servers.
• Resolving SELINUX related issues.

Confidential, Irving, TX

Linux/Solaris Administrator

Responsibilities:

• Responsible for Installation and supporting of UNIX operating systems which includes SUN Solaris and Linux servers.
• Building Sun Solaris Servers from scratch from Jumpstart and kickstart servers.
• Used Solaris live upgrade for upgrading Solaris OS.
• Upgrade firmware on LDOM servers like T Series Sun Solaris Servers and install VTM patches on Solaris and AIX servers.
• Installation and configure requirement of BMC Patrol Oracle KM Pkg and Patrol Agent pkg on AIX servers.
• Upgraded vxvm and VCS from 4.1 to 5.0 on Solaris servers and also Upgraded SAN stack on Solaris and AIX servers
• Networking communication skills and protocols such as TCP/IP, Telnet, ftp, SSH, rlogin.
• Installation and configuration Etrust pkg on Solaris and Aix servers.
• Troubleshooting and resolve complex Hardware, OS, Backup, database and networking problem.
• Installed VERITAS Volume Manager and powerpath on Red hat Linux servers.
• Troubleshooting and analysis of hardware and software failures for various UNIX servers
• Worked with application team to load their app to servers, created test environment for Oracle DBA team
• Attended team meetings, change control meetings to update installation progress, and for upcoming changes in environment
• Migration all USM Security Model servers to Global Security Framework i.e GSF.
• Planning, Designing and Implementation of new Infrastructure for upcoming projects and ensure smooth running of Confidential business services.
• Installation and configuration of SQL Guard STAP 7.0 on Solaris and AIX servers.
• Experience in configuring EMC and Hitachi storage on the server side as per requirement.
• Installation of OAS (Oracle Application Server) on Solaris 10 and its configuration with oracle database
• Remedy Problem & Change management application for management of problem tickets and production change requests.