PROFESSIONAL SUMMARY:

• Over 7 Years of experience in Analysis, Design, Development and Maintenance of various software applications and database.
• Experience on Hadoop Administration, responsibilities include software installation, configuration, software upgrades, backup and recovery, commissioning and decommissioning data nodes, fair scheduling, cluster setup, cluster performance and monitoring on daily basis, maintaining cluster up and run on healthy.
• Experienced in installing, configuring, and administrating Hadoop cluster of major Hadoop distributions.
• Strong Experience in Installation and configuration of cloud era distribution Hadoop 3, 4 & Hortonworks Data Platform 1.3,2.0,2.1.
• Strong Experience in Installation and configuration of Hadoop ecosystem likeHBase, Hive, Navigator, Oozie, Zookeeper, Hue, flume, Pig, Sqoop, SOLR.
• Worked on Multi Clustered environment and setting up Cloudera Hadoop eco - System.
• Extensive experience in designing analytical/OLAP and transactional/OLTP databases.
• Supporting Hadoop developers and assisting in optimization of map reduce jobs, pig Latin scripts, Hive Scripts and Hbase ingest required.
• Setup, configuration and management of security for Hadoop clusters.
• Support in monitoring Hadoop Cluster using tools like Ganglia and Nagios.
• Perform Linux (RedHat, Ubuntu/CentOS) operating system installation, upgrades, patching, tuning, capacity management, and troubleshooting.
• Experience withHigh availability, disasterrecovery andbusinesspractices inHadoop stack.
• Experience in writing automation Shell scripts to maintain cluster healthy, disk space, local log files, user logs and scheduling in cron job.
• Experience with large scale Hadoop and NoSQL environments build and support including design, capacity planning, cluster set up, performance tuning and monitoring.
• Provide technical support to production environments and Monitoring Cluster & Jobs, troubleshooting, user onboarding, reporting application status.
• Work closely with the business team and other project team members to quickly diagnose issues and implement solutions in a timely manner.
• Ability to quickly master new concepts and applications. Excellent team worker with good interpersonal skills and leadership qualities.
• Have excellent analytical, verbal and written communication skills and ability to take the responsibility of any technical challenge to meet the business needs.

TECHNICAL SKILLS:

Hadoop Ecosystems: HDFS, Mapreduce-YARN/MR1, Hbase, Hive, Pig, Sqoop, Oozie, Flume

DataBases: Oracle, Tera Data, DB2, MySQL sever 2005 and Postgres

Platforms: Windows, Ubuntu, Centos, RHEL, Solaris

Languages: Bash shell scripting, SQL

PROFESSIONAL EXPERIENCE:

Confidential, Charlotte, NC

Hadoop Admin

Responsibilities:

• Installed and configured Hadoop MapReduce, HDFS, Supported multiple MapReduce-YARN jobs in Java for data cleaning and preprocessing.
• Importing and exporting data into HDFS and Hive using Sqoop.
• Experienced in defining job flows.
• Experienced in managing and reviewing Hadoop log files.
• Experienced in running Hadoop streaming jobs to process terabytes of XML format data.
• Load and transform large sets of structured, semi structured and unstructured data.
• Expertise in Hadoop cluster task like commissioning nodes, decommissioning nodes without any effect to running jobs and data.
• Responsible to manage data coming from different sources.
• Supported Map Reduce Programs those are running on the cluster.
• Implemented Fair schedulers on the Job tracker to share the resources of the cluster for the map reduce jobs given by the users.
• Cluster coordination services through Zoo Keeper.
• Involved in loading data from UNIX file system to HDFS.
• Involved in creating Hive tables, loading with data and writing Hive queries that will run internally in MapReduce way.
• Automated all the jobs, for pulling data from FTP server to load data into Hive tables, using Oozie workflows.
• Production support responsibilities include cluster maintenance, Backup and recovery.
• Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.

Environment: RHEL, Ubuntu, Cloudera Manager, Cloudera Search, CDH4, HDFS-2.0.1.0, Hbase-0.94.2, Hive-0.12.1, Pig-0.10.1, zookeeper-3.4.5, Monitoring Cluster with automated scripts, Map Reduce2 (YARN), PostgreSql, MySQL, QAS, Ganglia

Confidential, Buffalo, NY

Hadoop Admin

Responsibilities:

• Design and Developed analytics component for Data analytics platform.
• Consulting on Hadoop ecosystem: Hadoop, MapReduce, Hive, and HBase.
• Setup and Benchmarked Hadoop/HBase clusters for internal use.
• Design, deploy, Manage Hadoop machines for our data platform operations.
• Involving Hadoop Capacity planning and deployment.
• Install and configure the Hadoop, HBase, zookeeper, Hive. Setting up cloudera manger for centralized configuration management.
• Setting up monitoring tools Ganglis, Nagios for Hadoop monitoring and alerting. Monitoring Hadoop cluster Hadoop/HBase/zookeeper using these tools Ganglia and Nagios.
• Expertise in Hadoop cluster task like Adding Nodes, Removing Nodes without any effect to running jobs and data.
• Monitored system activities and fine tuned system parameters and configurations to optimize performance and ensure security of systems
• Write scripts to automate application deployments and configurations. Hadoop cluster performance tuning and monitoring. Troubleshoot and resolve Hadoop cluster related system problems.
• Extensive use of VERITAS Volume Manager for Disk management, file system management on Sun Solaris environment.
• Planned, scheduled and Implemented OS patches on both Solaris & Linux boxes as a part of proactive maintenance.

Environment: Hadoop, MapReduce MR1, HDFS, Hive, HBase, Java (jdk1.6), Hortonworks, Cloudera, Flat files, Oracle 11g/10g, PL/SQL, SQL*PLUS, Toad 9.6, Windows NT, UNIX Shell Scripting, Autosys 11.0.

Confidential, California

Hadoop Admin

Responsibilities:

• Hands on experience with Apache Hadoop Ecosystem components such as Scoop, Hbase and Mapreduce.
• Installation, monitoring, managing, troubleshooting, applying patches in different environments such as Development Cluster, Test Cluster and Production environments.
• Demonstrate and understanding of concepts, best practices and functions to implement a Big Data solution in a corporate environment.
• Help design of scalable Big Data clusters and solutions.
• Implemented Fair schedulers to share the resources of the cluster for the map reduce jobs given by the users.
• Experience on writing automation scripts and setting up cron jobs to maintain cluster stability and healthy.
• Monitoring and controlling local file system disk space usage, local log files, cleaning log files with automated scripts.
• As a Hadoop admin, monitoring cluster health status on daily basis, tuning system performance related configuration parameters, backing up configuration XML files.
• Work with Hadoop developers, designers in troubleshooting map reduce job failures and issues and helping to developers.
• Work with network and Linux system engineers/admin to define optimum network configurations, server hardware and operating system.
• Evaluate and propose new tools and technologies to meet the needs of the organization.
• Production support responsibilities include cluster maintenance and on call support on weekly rotation 24/7

Environment: RHEL, CentOS, Ubuntu, CDH3, Cloudera Manager, HDFS, Map Reduce, Hbase, MySQL, Shell scripts, Ganglia, Nagios

Confidential, Manhattan, New York City

Linux Administrator

Responsibilities:

• Responsible for handling the tickets raised by the end users which includes installation of packages, login issues, access issues
• User management like adding, modifying, deleting, grouping
• Responsible for preventive maintenance of the servers on monthly basis.
• Configuration of the RAID for the servers
• Resource management using the Disk quotas
• Documenting the issues on daily basis to the resolution portal.
• Responsible for change management release scheduled by service providers.
• Generating the weekly and monthly reports for the tickets that worked on and sending report to the management
• Managing Systems operations with final accountability for smooth installation, networking, and operation, troubleshooting of hardware and software in LINUX environment.
• Identifying operational needs of various departments and developing customized software to enhance System's productivity.
• Running LINUX SQUID Proxy server with access restrictions with ACLs and password.
• Established/implemented firewall rules, Validated rules with vulnerability scanning tools.
• Proactively detecting Computer Security violations, collecting evidence and presenting results to the management.
• Accomplished System/e-mail authentication using LDAP enterprise Database.
• Implemented a Database enabled Intranet web site using LINUX, Apache, MySQL Database backend.
• Installed Cent OS using Pre-Execution environment boot and Kick-start method on multiple servers.
• Monitoring System Metrics and logs for any problems.
• Running Cron-tab to back up Data.
• Applied Operating System updates, patches and configuration changes.
• Maintaining the MySQL server and Authentication to required users for Databases.
• Appropriately documented various Administrative & technical issues

Confidential, Hicksville, NY

Linux Systems Administrator

Responsibilities:

• Building/upgrading servers (DNS, DHCP, NIS, HTTPD, Cups) and general-purpose servers using PXE-boot with kick-start.
• Installing and upgrading software on Linux (rpm/yum) and Windows Systems using puppet
• Responsible for complete user management which includes creating, modifying, closing user accounts on Linux/Unix and Windows Systems (Active Directory)
• Setting up NIS domains on Redhat, CentOs and Solaris systems, which involves configuring servers and client roles.
• Propagating maps to slave servers and clients via cron jobs and manually.
• Setting up auto mounts for home directories in different domains.
• Monitoring health of infrastructure servers and mission critical servers using Nagios XI.
• Taking actions based on the alerts to resolve the issue in timely manner.
• Monitoring Symantec NetBackup 7.5 Activity monitor to ensure backup of all the hosts.
• Restoring data upon user request.
• Providing direct user support for level 1 and level 2 issues via email and ticket system.
• Solving complex network connectivity issues using tools such as Tcpdump, Wireshark.
• Scanning vulnerable hosts on the subnets and fixing vulnerabilities resulting in improved and secure networks using McAfee Found Stone.
• Creating/updating iptables rules on Linux systems using host-based firewall.
• Solving issues related to user logon, NFS and server connectivity.
• Creating and modifying bash scripts to automate my daily tasks.
• Providing support for samba file shares and updating configuration file when necessary.
• Security: Implementing iptables on Linux systems. Modifying firewall rules, scanning the entire network using proprietary software to find vulnerable hosts and fixing the vulnerabilities

Confidential

Linux Administrator

Responsibilities:

• Installed Windows (Windows XP and 2003 Servers, Dell Blade Servers.) and Linux Operating systems (Redhat and CentOS) Resolved login issues; resetting passwords
• User and group management on AD and Linux
• Creating project directories and setting up proper permissions
• Installed M.S office and configure outlook
• Installed software on Linux Systems
• Worked with different vendors to order system parts such as memory, motherboard, hard disks
• LAN port enabling and disabling
• Reconfiguring/setting up machines for new hires
• Resolving DNS related issues (Proxy setting)
• New hardware & software installation and configuration.
• Troubleshooting PC hardware and software.
• Troubleshoot email-enabled devices.
• Liaison with third party suppliers for hardware repairs & software support.
• Office installation and troubleshooting including network cabling.
• Troubleshoot Telco equipment
• Enabled remote access by constructing and managing Cisco VPN Client
• Solving network connectivity issues with network applications.

Confidential

Linux Administrator

Responsibilities:

• Installation and Configuring hardware level consoles like ILOM, ALOM, ELOM, CMC of Sun-Solaris Entry level, Midrange Servers, Dell & HP Servers.
• Up gradation of Firmware and BIOS.
• Installing, Configuring and Up gradation of the Red hat & Solaris Operating systems as per the Clients requirement
• Hardware resource management, using the concepts of RAID, LVM, SVM and Virtualization.
• User Management: Adding, Modifying, grouping of the users as per the Clients requirement and providing permission to the users as per the Customer policies
• Package Management: Installation, upgrading, UN installation of the packages along with their dependencies.
• Installation, Configuration and managing the network services like Printers, DNS, NFS, Samba, NTP, VNCP
• Installation, Configuration and Managing the Internet services like SSH, SCP, FTP, Mail Server, Web server (APACHE)
• Trouble shooting & diagnosing the hardware and raising the parts with helpdesk along with diagnosing report and logs
• Trouble shooting the operating system issues with log analysis.
• Documenting the issues with solutions that we face at customers place and updating in the solution portal and Performance Monitoring.