SUMMARY

• 7 + years of overall experience in Systems Administration and Enterprise Application Development in diverse industries which includes hands on experience in Bigdata ecosystem related technologies.
• 5 years of comprehensive experience as a Big Data & Analytics Administrator.
• Experience in working with MapReduce programs using Apache Hadoop for working with Big Data.
• Experience in installation, configuration, supporting and monitoring Hadoop clusters using HDFS.
• Experience in using Pig, Hive and HBase.
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice - versa.
• Familiar with Java virtual machine (JVM) and multi-threaded processing.
• Knowledge of NoSQL databases including HBase, MySQL.
• Knowledge in job workflow scheduling and monitoring tools like oozie and Zookeeper
• Experience in designing, developing and implementing connectivity products that allow efficient exchange of data between our core database engine and the Hadoop ecosystem.
• Excellent interpersonal and communication skills, creative, research-minded, technically competent and result-oriented with problem solving and leadership skills.

TECHNICAL SKILLS

Hadoop/Big Data: HDFS, Map reduce, HBase, Pig, Hive, Sqoop

Java & J2EE Technologies: Core Java, Servlets, JSP, JDBC, JNDI, Java Beans

Programming languages: Java, Linux shell scripts

Databases: Oracle 11g/10g/9i, MS-SQL Server, HBase

Web Servers: Web Logic, Web Sphere, Apache Tomcat

Web Technologies: HTML, XML, JavaScript

PROFESSIONAL EXPERIENCE

Confidential, Dallas, TX

Hadoop Administrator

Responsibilities:

• Experienced of Hadoop 1.x and Hadoop 2.X Installation, configuration and Hadoop Clients.
• Experienced of Deploying Hadoop single node cluster in pseudo Distributed mode and Full Distributed mode.
• Involved in installing Hadoop Ecosystem components (Hadoop, MapReduce, Yarn, Pig, Hive, Sqoop, Flume, Zookeeper and HBase).
• Involved in HDFS maintenance and administering it through Hadoop-Java API.
• Expert in importing and exporting data into HDFS using Sqoop and Flume.
• Configured FIFO and Fair Scheduler to provide service-level agreements for multiple users of a cluster.
• Managing nodes on Hadoop cluster connectivity and security.
• Experienced of manage user and group access to various Big Data Environments.
• Experienced of Service Monitoring, Service and Log Management, Auditing and Alerts, Hadoop Platform Security and Configuring Kerberos.
• Hadoop components and patch installation.
• Experience in using Sqoop to migrate data to and fro from HDFS and MySQL or Oracle and deployed Hive and HBase integration to perform OLAP operations on HBase data.
• Responsible to Configure on the Hadoop cluster and troubleshoot the common Cluster Problem
• Have handled issues related to cluster start, node failures and several java specific errors on the system.
• Cluster configuration and data transfer (distcp and hftp), inter and intra cluster data transfer.
• Understanding of Hadoop 2.X architecture, Yarn Framework, Map Reduces and HDFS Federation
• Hadoop server roles and their usage, Rack Awareness, Anatomy of Write and Ready, Replication Pipeline, and Data Processing
• Manage production cluster though Cloudera Manager.

Environment: Hadoop, Linux, Map Reduce, Pig, Sqoop, Java, Hive, Hbase, UNIX Shell Scripting.

Confidential, Phoenix, AZ

Hadoop Administrator

Responsibilities:

• Installed Name node, Secondary name node, Yarn (Resource Manager, Node manager, Application master), Data node.
• Installed and Configured HDP2.2
• Responsible for implementation and ongoing administration of Hadoop infrastructure.
• Monitored already configured cluster of 40 nodes.
• Installed and configured Hadoop components Hdfs, Hive, HBase.
• Communicating with the development teams and attending daily meetings.
• Addressing and Troubleshooting issues on a daily basis.
• Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive.
• Cluster maintenance as well as creation and removal of nodes.
• Monitor Hadoop cluster connectivity and security.
• Manage and review Hadoop log files.
• File system management and monitoring.
• HDFS support and maintenance.
• Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.

Environment: Hadoop, HDFS, Pig, Hive, MapReduce, Linux, Sqoop, Sql.

Confidential, San Francisco, CA

Hadoop Support Analyst

Responsibilities:

• Participated in Hadoop Deployment and infrastructure scaling.
• Day to Day Hadoop / HDFS maintenance and operations
• Data cluster monitoring and troubleshooting
• Participated Hadoop capacity planning.
• Manage and review data backups / restores.
• Big Data Environment tuning.
• Working with data delivery teams to setup new Hadoop users.
• Designed and allocated HDFS quotas for multiple groups.
• Participated in OS integration and application installation.
• Cluster and application problem resolution for restoring service
• Create run books for L1 Operations.
• Importing and exporting data into HDFS and Hive using Sqoop.
• Involved in defining job flows, managing and reviewinglog files.
• Worked on developing Linux scripts for Job Automation.

Environment: Hadoop, MapReduce, HDFS, Hive, Oracle 11g, Java, Struts, Servlets, HTML, XML, SQL, J2EE, Tomcat 6.

Confidential

Jr System Administrator

Responsibilities:

• Worked on configuring and tuning system and network parameters for optimum performance.
• Wrote shell scripts to automate the tasks.
• Developed tools to automate the deployment, administration, and monitoring of a large-scale Linux environment.
• Performed server tuning, operating system upgrades.
• Generated daily compliance reports for Service Releases, Emergency Releases and Quarterly Releases using Transactional SQL Queries.
• Configured various security roles for providing access as per requirement.
• Installed and configured Ldap Authentication.
• Installed and Configured Tomcat.
• Participated in Installation and Configuration of BI Applications i.e. MicroStrategy & Informatica on Linux Servers.
• Debug and correct installed system software as required.

Environment: Red hat Linux 6.x, 7.x, Windows XP, Shell Scripting, Tomcat.

Confidential

Jr Software Developer

Responsibilities:

• Responsible and active in the analysis, design, implementation and deployment of full Software Development Lifecycle (SDLC) of the project.
• Designed and developed user interface using JSP, HTML and JavaScript.
• Developed Struts action classes, action forms and performed action mapping using Struts framework and performed data validation in form beans and action classes.
• Defined the search criteria and pulled out the record of the customer from the database. Make the required changes and save the updated record back to the database.
• Validated the fields of user registration screen and login screen by writing JavaScript validations.
• Used DAO and JDBC for database access.
• Developed stored procedures and triggers using PL/SQL in order to calculate and update the tables to implement business logic.
• Design and develop XML processing components for dynamic menus on the application.
• Involved in post production support and maintenance of the application.

Environment: Oracle 11g, Java 1.5, Struts, Servlets, HTML, XML, SQL, J2EE, JUnit, Tomcat 6.