Hadoop Admin Resume
CA
SUMMARY
- Over 10+years of experience in the IT industry encompassing the Analysis, Design, Development, implementation, up gradation, admin and support
- About 1 year of Experience as Hadoop Admin and 9+ years of experience as Techno Functional consultant and as well as Business Functional consultant in oracle applications.
- Hands on experience in installation, configuration, supporting and managing Clusters with Horton works, MapR distributions and Cloudera.
- Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
- Design Big Data solutions for traditional enterprise businesses.
- Used Network Monitoring Daemons like Ambari alerts and Nagios.
- Adding/removing new nodes to an existing cluster.
- Backup configuration and Recovery from a Name Node failure.
- Decommissioning and commissioning the Node on running cluster.
- Installation of various Ecosystems and Daemons.
- Experience on securing the cluster by using Linux, ldap and Ambari ranger.
- Experienced on authorization, authentication, auditing, data encryption and security administrationusing Apache Ranger, Apache Knox on Kerberos Cluster
- Excellent command in creating Backups & Recovery and Disaster recovery procedures and Implementing BACKUP and RECOVERY strategies for off - line and on-line Backups.
- Involved in bench marking /HBase cluster file systems various batch jobs and workloads
- Making cluster ready for development team working on POCs.
- Experience in minor and major upgrades of and eco system.
- Experienced in archiving, restoring and recovering data across multiple servers on master and segments using Greenplum utilities.
- Experienced in scheduling backups and recovery of the entire EDW databases across various geographical locations for the business continuity and response time.
- Efficient in vacuuming and analyzing database through regular cleanup of old logs, deleting old data, collecting statistics and tuning queries for efficient database running.
- Extensive experience in creating Roles, Users and providing privileges to roles and user management.
- Experienced in up gradation and Greenplum version migrations and patching.
- Experienced in maintaining and monitoring the database backup, disc space.
- Experienced in troubleshooting and analyzing problems like slowdowns, revalidating distribution keysfor structured data distribution and update dev team accordingly.
- Hands on experience in analyzing Log files on server for Master, segments and mirrors and finding root cause.
- Extensive experience in creating and modifying Resource queues.
- Experienced in modifying connection limits in master and segment.
- Extensive knowledge of creating schemas, databases, table creations with distribution keys, partitions with orientation and append only conditions
- Extensive knowledge of creating external tables and data load using gpfdist and analyzing of error logs.
- Experienced in maintaining and deleting the partitions, and terminating freeze transactions and connections.
- Experience in UNIX Shell Scripting& scheduling jobs using CRONTAB.
- Good coordination with greenplum developers in handling database migration.
- Good hands on experience in coding, developing and explain analyzing.
- Experienced in monitoring health and wealth of Greenplum system.
- Very good Knowledge of Architecture and components.
- Good understanding of Greenplum power writer and as well as other connectors
- Expert in Order management end to end processes.
- Over 7 Years of Cisco Experience.
- Proficient in data analysis and documenting the findings.
- Possess good working knowledge in Oracle reports 6i, Forms customization, Forms personalization and Developer 2000/6i.
- Expertise in Development of interfaces and conversion programs to integrate Oracle Applications modules to import data from various sources into Oracle Applications using Data Load, PL/SQL, SQL*Loader.
- Strong programming experience in creating application specific Procedures, API, Packages, Functions, Triggers and other database objects using SQL and PL/SQL.
- Possess good interpersonal, presentation and developmental skills with Strong analytical and problem solving approach and an excellent team player.
- Very good knowledge about the ERP systems and has proven experience in developing and implementing ERP solutions for various clients.
- Self confident and positive approach on challenging assignments.
- Received numerous kudos for excellent team collaboration.
TECHNICAL SKILLS
Data Bases: Greenplum, Oracle, MySql, Postgres
ERP: Oracle ERP R 12, 11i/ 11.5.9/10.7 Order Management (OM), TCA (Trading community Architecture), General Ledger (GL), Accounts Receivable (AR), Accounts Payable (AP), Purchase Order (PO), Inventory (INV), Application Object Library (AOL), SysAdmin.
GUI Tools: Oracle Developer 6i/2000 (Forms 6i/4.5, Reports 6i/3.0), Oracle database 10g, SQL*Loader, Oracle 8, 8i, 9i/10g
Languages: SQL, PL/SQL, Postgres
Web Related: HTML, XML,JSON
Tools: & Utilities: PGADMIN III, Aginity Workbench, TOAD, Benthic, Putty, Winscp, Golden Gate, Microsoft Office Tools, Quality Center, Remedy
Operating Systems: Windows Server/Vista/XP/ 2000/2007/2008, Ubuntu, Unix/Linux, Cent OS
Security: LDAP, AD, Kerberos, Apache ranger
Big Data: Hortonworks hdp 2.2.4.2 and 2.3, Cloudera,apache, pig, hive, hbase, sqoop, zookeeper,ambari, storm, spark, Cloudera Manger 5x
PROFESSIONAL EXPERIENCE
Confidential, Schaumburg, IL
Hadoop Admin
Responsibilities:
- Currently working as admin in Horton works (HDP 2.2.4.2) distribution for 3 clusters ranges from Dev, Research and PROD contains 96 nodes.
- Responsible for Cluster maintenance, Cluster Monitoring, commissioning and decommissioning Data nodes, Troubleshooting, Manage and review data backups, Manage & review log files.
- Day to day responsibilities includes solving developer issues and providing instant solution to reduce the impact and documenting the same and preventing future issues.
- Experience on new component installations and upgrading the cluster with proper strategies.
- Experience on new Discovery Tools installation and integration with Hadoop Components.
- Monitoring systems and services, architecture design and implementation of deployment, configuration management, backup, and disaster recovery systems and procedures.
- Hand on experience on cluster up gradation and patch upgrade without any data loss and with proper backup plans.
- Changing the configurations based on the requirements of the users for the better performance of the jobs.
- Worked on configuration management tools like stack Iq to maintain central and pushing the configurations to the overall cluster for all configuration files like mapred-site.xml, pools.xml, hdfs-site.xml.
- Experienced in Setting up the project and volume setups for the new projects.
- Involved in snapshots and mirroring to maintain the backup of cluster data and even remotely.
- Implementing the SFTP for the projects to transfer data from External servers to servers.
- Installation of various Eco system sand Daemons.
- Experienced in managing and reviewing log files.
- Working experience on maintaining MySQL databases creation and setting up the users and maintain the backup of cluster metadata databases.
- Setting up MySQL master and slave replications and helping business applications to maintain their data in MysqlServers.
- Helping the users in production deployments throughout the process.
- Experienced in production support which involves solving the user incidents varies from sev1 to sev5.
- Managed and reviewed Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
- As an admin followed standard Back up policies to make sure the high availability of cluster.
- Involved in Analyzing system failures, identifying root causes, and recommended course of actions. Documented the systems processes and procedures for future references.
- Worked with systems engineering team to plan and deploy new environments and expand existing clusters.
- Monitored multiple clusters environments using AMBRI Alerts, Metrics and Nagios.
Environment: HDP 2.2.4.2,HUE,Hive, pig, Sqoop, Flume, Zookeeper and HBase, MYSQL, Shell Scripting, Redhat Linux, Apache Ranger, Apache Knox, Kerberos
Confidential, CA
Hadoop Admin
Responsibilities:
- Currently working as admin in Horton works (HDP 2.2.4.2) distribution for 4 clusters ranges from POC to PROD contains nearly 100 nodes.
- Responsible for Cluster maintenance, Cluster Monitoring, commissioning and decommissioning Data nodes, Troubleshooting, Manage and review data backups, Manage & review log files.
- Day to day responsibilities includes solving developer issues and providing instant solution to reduce the impact and documenting the same and preventing future issues.
- Experience on new component installations and upgrading the cluster with proper strategies.
- Experience on new Discovery Tools installation and integration with Hadoop Components.
- Monitoring systems and services, architecture design and implementation of deployment, configuration management, backup, and disaster recovery systems and procedures.
- Hand on experience on cluster up gradation and patch upgrade without any data loss and with proper backup plans.
- Changing the configurations based on the requirements of the users for the better performance of the jobs.
- Worked on configuration management tools like stack Iq to maintain central and pushing the configurations to the overall cluster for all configuration files like mapred-site.xml, pools.xml, hdfs-site.xml.
- Experienced in Setting up the project and volume setups for the new projects.
- Involved in snapshots and mirroring to maintain the backup of cluster data and even remotely.
- Implementing the SFTP for the projects to transfer data from External servers to servers.
- Installation of various Eco system sand Daemons.
- Experienced in managing and reviewing log files.
- Working experience on maintaining MySQL databases creation and setting up the users and maintain the backup of cluster metadata databases.
- Setting up MySQL master and slave replications and helping business applications to maintain their data in MysqlServers.
- Helping the users in production deployments throughout the process.
- Experienced in production support which involves solving the user incidents varies from sev1 to sev5.
- Managed and reviewed Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
- As an admin followed standard Back up policies to make sure the high availability of cluster.
- Involved in Analyzing system failures, identifying root causes, and recommended course of actions. Documented the systems processes and procedures for future references.
- Worked with systems engineering team to plan and deploy new environments and expand existing clusters.
- Monitored multiple clusters environments using AMBRI Alerts, Metrics and Nagios.
Environment: HDP 2.2.4.2,HUE,Hive, pig, Sqoop, Flume, Zookeeper and HBase, MYSQLShell Scripting, Red hatLinux
Confidential, San Jose, CA
Business Functional Consultant, Techno-Functional Consultant
Responsibilities:
- As a Business Functional consultant delivered multiple BFD’s, by gathering business requirements and provided functional requirements for same in single document.
- As a Techno Functional consultant reviewed the Business requirements and performed the impact analysis
- Involved in CCW Project as a Functional analyst which is ongoing project from several releases.
- Involved in implementing of a new order cycle in R12 in project CI and enabling new Operating Unit and Customer migration to new operating Unit which is done in multiple releases.
- Involved in Scientific Atlanta(SAJO). As part of this Project Cisco acquired the company Scientific Atlanta and enabled the Joint Orderabilty.
- Worked with various cross functional and business teams depending upon the project requirements
- Attended the meetings with Oracle Team on standard functionality /Custom functionality
- Prepared GAP analysis on 11i and R12 in OM and Service Contracts
- Worked with Business and provided the inputs to Business Requirements and documentation
- Understanding the business requirements and prepared a detailed Use Cases in Functional Requirement Documents
- Prepared Low Level and High Level design documents based on the Business Requirement provided.
- Involved in different phases of the project includingrequirements gathering, analysis,application design, technical design, development, testing and documentation.
- Responsible for conducting meeting with team members and assigning work on each of them. Reporting to Manager on weekly basis about the work progress.
- Responsible for the functional testing.
- Reviewed requirement tractability matrix.
- Supported post go live activities.
- Involved in Design/Code Review with Team and task assignments.
- Coordinate with developers in completing the tasks as scheduled.
- Coordinated with the QA team to help develop their test-cases.
- Responsible for providing Knowledge transfer sessions for support team.
- Go Live and Post Go Live support
- Work with offshore team, and manage/delegate work to offshore resources
Environment: OracleEBusiness Suite R 12/11i - 11.5.10.2(OM, AR, INV, GL, WSH, XML, WIP), Oracle 10g, TOAD.
Confidential
Oracle Applications Technical Consultant
Responsibilities:
- Involved in System Analysis, Design, Coding, Data Conversion, Development and Implementation.
- Installed Oracle 8i, Developer 2000 on Windows NT/2000/95.
- Wrote PL/SQL and Pro*C Programs, unix shell scripts required for data transformation/Loading.
- Extensively involved in writing SQL queries (Sub queries and Join conditions), PL/SQL programming.
- Involved in creation of Sequences for automatic generation of voucher numbers and views for hiding.
- Completed performance tuning in the existing SQL, PL/SQL and initiated changes in the Views, improved performance.
- Completed performance tuning in the existing SQL and PL/SQL to obtain the better performance and made changes in the Views.
- Written many stored procedures, stored functions, packages and used in many forms and reports.
- Used TOAD, PL/SQL developer toolsfor faster application design and developments
- Have written many database triggers for automatically updating the tables and views.
- Involved in generated work plans, and developed complex matrix reports.
- Establishing the database connection using JDBC with appropriate drivers
- Write Shell scripts for batch jobs in Unix.
Environment: SQL, PL/SQL, Oracle 8.06, 8i, 9i,TOAD, PL/SQL,Developer 6i, SQL*Loader, UNIX and Windows 2000.