Hadoop Admin Resume
Schaumburg, IL
SUMMARY
- Over 10+years of experience in the IT industry encompassing the Analysis, Design, Development, implementation, up gradation, admin and support
- About 1 year of Experience as Hadoop Admin and 9+ years of experience as Techno Functional consultant and as well as Business Functional consultant in oracle applications.
- Hands on experience in installation, configuration, supporting and managing Clusters with Horton works, MapR distributions and Cloudera.
- Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
- Design Big Data solutions for traditional enterprise businesses.
- Used Network Monitoring Daemons like Ambari alerts and Nagios.
- Adding/removing new nodes to an existing cluster.
- Backup configuration and Recovery from a Name Node failure.
- Decommissioning and commissioning the Node on running cluster.
- Installation of various Ecosystems and Daemons.
- Experience on securing the cluster by using Linux, ldap and Ambari ranger.
- Experienced on authorization, authentication, auditing, data encryption and security administrationusing Apache Ranger, Apache Knox on Kerberos Cluster
- Excellent command in creating Backups & Recovery and Disaster recovery procedures and Implementing BACKUP and RECOVERY strategies for off - line and on-line Backups.
- Involved in bench marking /HBase cluster file systems various batch jobs and workloads
- Making cluster ready for development team working on POCs.
- Experience in minor and major upgrades of and eco system.
- Experienced in archiving, restoring and recovering data across multiple servers on master and segments using Greenplum utilities.
- Experienced in scheduling backups and recovery of the entire EDW databases across various geographical locations for the business continuity and response time.
- Efficient in vacuuming and analyzing database through regular cleanup of old logs, deleting old data, collecting statistics and tuning queries for efficient database running.
- Extensive experience in creating Roles, Users and providing privileges to roles and user management.
- Experienced in up gradation and Greenplum version migrations and patching.
- Experienced in maintaining and monitoring the database backup, disc space.
- Experienced in troubleshooting and analyzing problems like slowdowns, revalidating distribution keysfor structured data distribution and update dev team accordingly.
- Hands on experience in analyzing Log files on server for Master, segments and mirrors and finding root cause.
- Extensive experience in creating and modifying Resource queues.
- Experienced in modifying connection limits in master and segment.
- Extensive knowledge of creating schemas, databases, table creations with distribution keys, partitions with orientation and append only conditions
- Extensive knowledge of creating external tables and data load using gpfdist and analyzing of error logs.
- Experienced in maintaining and deleting the partitions, and terminating freeze transactions and connections.
- Experience in UNIX Shell Scripting& scheduling jobs using CRONTAB.
- Good coordination with greenplum developers in handling database migration.
- Good hands on experience in coding, developing and explain analyzing.
- Experienced in monitoring health and wealth of Greenplum system.
- Very good Knowledge of Architecture and components.
- Good understanding of Greenplum power writer and as well as other connectors
- Extensive experience in the area of Oracle and in Oracle e-business suite Applications Order Management (OM), Install Base (IB), Service Contracts (SCs), Oracle Pricing, Purchasing (PO), Inventory (INV). Database technologies like Oracle 10g, SQL, PL/SQL, SQL*PLUS, SQL*Loader.
- Expert in Order management end to end processes.
- Over 7 Years of Cisco Experience.
- Proficient in data analysis and documenting the findings.
- Possess good working knowledge in Oracle reports 6i, Forms customization, Forms personalization and Developer 2000/6i.
- Expertise in Development of interfaces and conversion programs to integrate Oracle Applications modules to import data from various sources into Oracle Applications using Data Load, PL/SQL, SQL*Loader.
- Strong programming experience in creating application specific Procedures, API, Packages, Functions, Triggers and other database objects using SQL and PL/SQL.
- Possess good interpersonal, presentation and developmental skills with Strong analytical and problem solving approach and an excellent team player.
- Very good knowledge about the ERP systems and has proven experience in developing and implementing ERP solutions for various clients.
- Self confident and positive approach on challenging assignments.
- Received numerous kudos for excellent team collaboration.
TECHNICAL SKILLS
Data Bases: Greenplum, Oracle, MySql, Postgres
ERP: Oracle ERP R 12, 11i/ 11.5.9/10.7 Order Management (OM), TCA (Trading community Architecture), General Ledger (GL), Accounts Receivable (AR), Accounts Payable (AP), Purchase Order (PO), Inventory (INV), Application Object Library (AOL), SysAdmin.
GUI Tools: Oracle Developer 6i/2000 (Forms 6i/4.5, Reports 6i/3.0), Oracle database 10g, SQL*Loader, Oracle 8, 8i, 9i/10g
Languages: SQL, PL/SQL, Postgres
Web Related: HTML, XML,JSON
Tools: & Utilities: PGADMIN III, Aginity Workbench, TOAD, Benthic, Putty, Winscp, Golden Gate, Microsoft Office Tools, Quality Center, Remedy
Operating Systems: Windows Server/Vista/XP/ 2000/2007/2008 , Ubuntu, Unix/Linux, Cent OS
Security: LDAP, AD, Kerberos, Apache ranger
Big Data: Hortonworks hdp 2.2.4.2 and 2.3, Cloudera,apache, pig, hive, hbase, sqoop, zookeeper,ambari, storm, spark, Cloudera Manger 5x
PROFESSIONAL EXPERIENCE
Confidential, Schaumburg, IL
Hadoop Admin
Responsibilities:
- Currently working as admin in Horton works (HDP 2.2.4.2) distribution for 3 clusters ranges from Dev, Research and PROD contains 96 nodes.
- Responsible for Cluster maintenance, Cluster Monitoring, commissioning and decommissioning Data nodes, Troubleshooting, Manage and review data backups, Manage & review log files.
- Day to day responsibilities includes solving developer issues and providing instant solution to reduce the impact and documenting the same and preventing future issues.
- Experience on new component installations and upgrading the cluster with proper strategies.
- Experience on new Discovery Tools installation and integration with Hadoop Components.
- Monitoring systems and services, architecture design and implementation of deployment, configuration management, backup, and disaster recovery systems and procedures.
- Hand on experience on cluster up gradation and patch upgrade without any data loss and with proper backup plans.
- Changing the configurations based on the requirements of the users for the better performance of the jobs.
- Worked on configuration management tools like stack Iq to maintain central and pushing the configurations to the overall cluster for all configuration files like mapred-site.xml, pools.xml, hdfs-site.xml.
- Experienced in Setting up the project and volume setups for the new projects.
- Involved in snapshots and mirroring to maintain the backup of cluster data and even remotely.
- Implementing the SFTP for the projects to transfer data from External servers to servers.
- Installation of various Eco system sand Daemons.
- Experienced in managing and reviewing log files.
- Working experience on maintaining MySQL databases creation and setting up the users and maintain the backup of cluster metadata databases.
- Setting up MySQL master and slave replications and helping business applications to maintain their data in MysqlServers.
- Helping the users in production deployments throughout the process.
- Experienced in production support which involves solving the user incidents varies from sev1 to sev5.
- Managed and reviewed Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
- As an admin followed standard Back up policies to make sure the high availability of cluster.
- Involved in Analyzing system failures, identifying root causes, and recommended course of actions. Documented the systems processes and procedures for future references.
- Worked with systems engineering team to plan and deploy new environments and expand existing clusters.
- Monitored multiple clusters environments using AMBRI Alerts, Metrics and Nagios.
Environment: HDP 2.2.4.2,HUE,Hive, pig, Sqoop, Flume, Zookeeper and HBase, MYSQL, Shell Scripting, Redhat Linux, Apache Ranger, Apache Knox, Kerberos
Confidential, CA
Hadoop Admin
Responsibilities:
- Currently working as admin in Horton works (HDP 2.2.4.2) distribution for 4 clusters ranges from POC to PROD contains nearly 100 nodes.
- Responsible for Cluster maintenance, Cluster Monitoring, commissioning and decommissioning Data nodes, Troubleshooting, Manage and review data backups, Manage & review log files.
- Day to day responsibilities includes solving developer issues and providing instant solution to reduce the impact and documenting the same and preventing future issues.
- Experience on new component installations and upgrading the cluster with proper strategies.
- Experience on new Discovery Tools installation and integration with Hadoop Components.
- Monitoring systems and services, architecture design and implementation of deployment, configuration management, backup, and disaster recovery systems and procedures.
- Hand on experience on cluster up gradation and patch upgrade without any data loss and with proper backup plans.
- Changing the configurations based on the requirements of the users for the better performance of the jobs.
- Worked on configuration management tools like stack Iq to maintain central and pushing the configurations to the overall cluster for all configuration files like mapred-site.xml, pools.xml, hdfs-site.xml.
- Experienced in Setting up the project and volume setups for the new projects.
- Involved in snapshots and mirroring to maintain the backup of cluster data and even remotely.
- Implementing the SFTP for the projects to transfer data from External servers to servers.
- Installation of various Eco system sand Daemons.
- Experienced in managing and reviewing log files.
- Working experience on maintaining MySQL databases creation and setting up the users and maintain the backup of cluster metadata databases.
- Setting up MySQL master and slave replications and helping business applications to maintain their data in MysqlServers.
- Helping the users in production deployments throughout the process.
- Experienced in production support which involves solving the user incidents varies from sev1 to sev5.
- Managed and reviewed Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
- As an admin followed standard Back up policies to make sure the high availability of cluster.
- Involved in Analyzing system failures, identifying root causes, and recommended course of actions. Documented the systems processes and procedures for future references.
- Worked with systems engineering team to plan and deploy new environments and expand existing clusters.
- Monitored multiple clusters environments using AMBRI Alerts, Metrics and Nagios.
Environment: HDP 2.2.4.2,HUE,Hive, pig, Sqoop, Flume, Zookeeper and HBase, MYSQLShell Scripting, Red hatLinux
Confidential, San Jose, CA
Business Functional Consultant, Techno-Functional Consultant
Responsibilities:
- As a Business Functional consultant delivered multiple BFD’s, by gathering business requirements and provided functional requirements for same in single document.
- As a Techno Functional consultant reviewed the Business requirements and performed the impact analysis
- Involved in CCW Project as a Functional analyst which is ongoing project from several releases.
- Involved in implementing of a new order cycle in R12 in project CI and enabling new Operating Unit and Customer migration to new operating Unit which is done in multiple releases.
- Involved in Scientific Atlanta(SAJO). As part of this Project Cisco acquired the company Scientific Atlanta and enabled the Joint Orderabilty.
- Worked with various cross functional and business teams depending upon the project requirements
- Attended the meetings with Oracle Team on standard functionality /Custom functionality
- Prepared GAP analysis on 11i and R12 in OM and Service Contracts
- Worked with Business and provided the inputs to Business Requirements and documentation
- Understanding the business requirements and prepared a detailed Use Cases in Functional Requirement Documents
- Prepared Low Level and High Level design documents based on the Business Requirement provided.
- Involved in different phases of the project includingrequirements gathering, analysis,application design, technical design, development, testing and documentation.
- Responsible for conducting meeting with team members and assigning work on each of them. Reporting to Manager on weekly basis about the work progress.
- Responsible for the functional testing.
- Reviewed requirement tractability matrix.
- Supported post go live activities.
- Involved in Design/Code Review with Team and task assignments.
- Coordinate with developers in completing the tasks as scheduled.
- Coordinated with the QA team to help develop their test-cases.
- Responsible for providing Knowledge transfer sessions for support team.
- Go Live and Post Go Live support
- Work with offshore team, and manage/delegate work to offshore resources
Environment: OracleEBusiness Suite R 12/11i - 11.5.10.2(OM, AR, INV, GL, WSH, XML, WIP), Oracle 10g, TOAD.
Confidential
Oracle Applications Technical Consultant
Responsibilities:
- Involved in System Analysis, Design, Coding, Data Conversion, Development and Implementation.
- Installed Oracle 8i, Developer 2000 on Windows NT/2000/95.
- Coded SQL Scripts to create the Development Database, Testing Database, Production Database, including Table spaces, added data files to table spaces, managed redo log files and control files, Rollback segments creation, Users, Synonyms, Roles, profiles, Privileges and changed init.ora file parameters.
- Wrote PL/SQL and Pro*C Programs, unix shell scripts required for data transformation/Loading.
- Extensively involved in writing SQL queries (Sub queries and Join conditions), PL/SQL programming.
- Involved in creation of Sequences for automatic generation of voucher numbers and views for hiding.
- Completed performance tuning in the existing SQL, PL/SQL and initiated changes in the Views, improved performance.
- Completed performance tuning in the existing SQL and PL/SQL to obtain the better performance and made changes in the Views. Written many stored procedures, stored functions, packages and used in many forms and reports.
- Used TOAD, PL/SQL developer toolsfor faster application design and developments
- Have written many database triggers for automatically updating the tables and views.
- Involved in generated work plans, and developed complex matrix reports.
- Establishing the database connection using JDBC with appropriate drivers
- Created Multi Org responsibilities, Users, custom menus/submenus, request groups in System Administration as per business requirements and setup the profile option values at the responsibility level for the above multi Org responsibilities
- Write Shell scripts for batch jobs in Unix.
Environment: SQL, PL/SQL, Oracle 8.06, 8i, 9i,TOAD, PL/SQL,Developer 6i, SQL*Loader, UNIX and Windows 2000.