SUMMARY

• Seasoned IT professional with 8+ years (4+ Years USA / Onsite Experience) of progressive experience.
• 3+ years of experience in administering Cloudera Bigdata Hadoop clusters.
• Extensive experience with large scale Hadoop clusters deployment and support, which includes cluster design, capacity planning, installation and configuration, performance tuning, monitoring and troubleshooting.
• Strong understanding of Hadoop eco system components such as HDFS, MapReduce, Sqoop, Flume, Oozie, Pig, Hive, HBase, and Zookeeper.
• Proven experience in setting up various development, test and production clusters in Cloudera CDH 4 and 5.
• Proven experience in installation, software upgrade and monitoring of Hadoop clusters using Cloudera Manager 4 and 5.
• A deep understanding of Hadoop design principles, cluster connectivity, security and the factors that affect distributed systems performance.
• Experience in working with both MapReduce 1 and MapReduce2 (YARN).
• Experience in setup, configuration and management of security for Hadoop clusters using Kerberos and integration with LDAP.
• Extensively worked on cluster wide resource management of both HDFS and MapReduce resources.
• Solid experience in maintaining Cluster nodes, processes, files system integrity and load balancing.
• Extensively worked on setting up cluster, node, and service, activity monitoring, events, triggers, alerts configuration, health tests and Cloudera Navigator.
• Sensitive implementer of data back and restore strategies, parallel data ingestion techniques and snapshots.

PROFESSIONAL EXPERIENCE

Hadoop Administrator

Confidential, Webster, NY

Responsibilities:

• Experience in Capacity planning, OS kernel tuning, Master and worker nodes hardware selection, estimating resource requirements in line with storage and computation requirement.
• Expertise in Installation and configuration of CDH and Eco system components using packages, tarball, and local YUM repositories.
• Extensively worked on commissioning and decommissioning of cluster nodes, replacing failed disks, file system integrity checks and maintaining cluster data replication.
• Installation, configuration and administration of databases for various eco system components and Cloudera manager services Meta data storage.
• Solid expertise in HDFS maintenance activities which includes, defining rack topology, Quotas, block size, maintaining block replication and cluster balancing, trash server configuration etc..
• Solid expertise in MapReduce maintenance activities which includes, pool configuration, map and reduce slots adjustment, scheduler configuration, dealing with failed tasks, jobs and blacklisted task trackers.
• Experience in creation and management of MapReduce user accounts, managing Queue ACLs, HDFS extended ACLs and Kerberos authentication.
• Experience configuration of high availability solutions for Name node, and HBase master through Zookeeper ensemble.
• Extensively worked on cluster configuration files like hadoop - env.sh, core-site.xml, hdf-site.xml, mapred-site.xml etc.
• Experience in installation and configuration of Sqoop Server2, clients and JDBC divers.
• Experience in Setting up Flume agents for data aggregation and storage onto HDFS.
• Experience in setting up HBase cluster which includes master and region server configuration, High availability configuration, performance tuning and administration.
• Proven expertise in setup and configuration of Hive server2, Metastore database and creation of Hive tables that include DDL, Role creation, assigning privileges and creating secured HDFS directories to store the Hive files.
• Experience in Oozie server configuration and administration of Oozie actions and workflows.
• Strong knowledge of open source system monitoring and event handling tools like Nagios and Ganglia.
• Experience in trouble shooting cluster problems by analyzing logs and setting log levels, fixing miss configuration, and resource exhaustion problems.

Platform: Cloudera CDH4, 5, Cloudera manager4,5, Apache Hadoop 1,2, HDFS, MapReduce, YARN, Hive, Pig, Sqoop, Flume, Zookeeper, Oozie, HBase, Linux Shell scripting, Python, XML, JAVA, Nagios, Ganglia., RHEL, CentOS.

Database Administrator

Confidential, Beverly, MA

Responsibilities:

• Installed SQL Server Cluster 2008 on both Active-Passive and Active-Active nodes.
• Installed service packs, hot fixes and security patches.
• Maintained High Availability such as Replication (Transactional replication) Log Shipping and Mirroring as per database disaster technique.
• Imported and Exported data from different sources other than SQL server (such as MS Excel, Flat files) using Import/Export wizard.
• Implementation of SQL Logins, users, user roles and Authentication Modes as part of Security Policies.
• Expertise in SQL Server Reporting Services (SSRS), SQL Server Integration services (SSIS).
• Monitoring SQL server performance using profiler to find performance metrics.
• Audited current databases by Best Practices Analyzer (BPA) and sent alerts using SCOM.
• Extensively worked on Dynamic Management Views (DMV’s).
• Monitored Disk IO, SAN space, CPU utilization etc.
• Created both Tabular, Matrix, drill down reports, bar chart, pie chart using SSRS 2008.
• Worked with Logical and physical models in Erwin (ERStudio).
• Managed the production and development databases including performance tuning, capacity planning, SQL Server clustering, database and security configuration.
• Created database maintenance plan to execute maintenance tasks including reorganize data and index pages, update database statistics, check database integrity, scheduling backups (Full, Differential and Log backup) and generate reports etc.

Platform: T-SQL, SQL Server 2005, 2008 OLTP,TCP/IP,SAN, SSIS, SSRS, ETL, Microsoft report analyzer, Best Practices Analyzer (BPA), System Center Operations Manager 2007 (SCOM), VB script, DNS, network, IP, Windows 2003, 2008, MS Office

Software Quality Analyst

Confidential, Rockford, IL

Responsibilities:

• Analyzed high level system requirements, prepared, executed system testing cases and procedures.
• Analyzed system integration specifications, created, executed modules integration cases and procedures.
• Prepared unit testing cases from Low-level design, wrote automation test cases in IBM Rational test real-time RTRT.
• Static analysis of both C, ADA code to verify its compliance with Avionics DO-178B standard.
• Modified test cases to achieve MC/DC coverage as per Avionics Level A software requirements and conducted regression testing.
• Created bug reports and code coverage reports.
• Conducted Peer, Lead reviews for other team member deliverables.

Platform: C, ADA 83/95, RTRT, TCL/TK, Matlab, Solaris, Windows, Visual probe, Unit, integration and System testing, Do-178B, Serena Dimensions, Bugzilla, PM Smart