Sr. Hadoop Administrator Resume
San, JosE
PROFESSIONAL SUMMARY:
- Over 16 years of total experience in IT. Highly skilled Oracle Exadata & Hadoop Administrator with extensive knowledge of multiple scripting and programming languages.Possesses strong abilities in administration of large data clusters in big data environments and is extremely analytical with excellent problem - solving.
- Has over 12 years of experience in Oracle & Exadata administration in implementing, maintaining & managing the Oracle, SQL Server, DB2 & MySQL databases.
- Has over 6+ years of experience as Hadoop Administration with very good exposure on Hadoop Technologies like HDFS, Map Reduce, Hive, Hbase, Sqoop, HCatalog, Pig, Zookeeper, & SPARK and involves full life cycle of infrastructure set up and administration of big cluster in high availability environments.
- Working on AWS S3 infrastructure to configure Cloudera 5.10 version.
- Excellent working experience for large clients such as Calidus Software, consumer goods company Unileaver.
- Having knowledge on IT service Management, also Implemented various processes as per the ITIL V3 framework.
- Experience in migration of objects across different environments using own developed modules.
- Working on development projects, which include design, development and unit testing of applications.
- Working on production and support projects, which include reporting and prioritizing the issues and defects and resolve them.
- Understand and implement the Software development life cycle SDLC process.
- Team Player with good communication and interpersonal skills and goal oriented approach to problem solving issues.
- Flexible on working on various technologies and skill sets.
- Successfully led executed several Simplification Process Optimization initiatives to bring efficiency into business processes.
- Expert in tuning and tuned several complex INFA BDE & Qlik Sense Reporting applications with a goal of providing faster and more efficient BI platform for business users.
- Have a strong understanding of RDBMS concepts such as Oracle Exadata, DB2, MySQL, SQl Server.
- Have experience in NOSQL databases like HBASE, MangoDB, Cassandra for fast search, Machine Learning API.
- Experienced in providing solutions aligned with standards, security, validation, capacity, HA and identifying associated risks
- Have good experience of Linux Administration and maintenance.
- Individual Contributor and has ability to resolve any type of BI tool & Infrastructure issues. Writing code on the ad-hoc basis for the team to make their tasks simple.
TECHNICAL SKILLS:
Big Data: Hadoop, MRv1, MRv2(YARN), Sqoop, Flume, Spark, Cassandra, Kafka
O. S.: Red Hat Linux 9AS, SUN, ESX Servers, and WINDOWS
Languages: PL/SQL, Java, Perl, Shell, Python, Scala
Databases: Oracle 12C, Oracle Exadata, DB2, SQL Server, MYSQL
Tools: Toad, Erwin, Developer 2000, Visio, Informatica, Informatica BDE
NoSQL Database: MangoDB
Web/Application servers: Tomcat 6.0/5.0/4.0, JBoss 5.1.0
AI Tools: Machine learning algorithms
PROFESSIONAL EXPERIENCE:
Confidential
Sr. Hadoop Administrator
Responsibilities:
- Configuration of the YARN resources to utilize the cluster properly for ETL & Spark data loads.
- Wrote Tool in shell script to Copy Hive table from/within Cluster using DistCP command.
- Configuration of Kerberos access control setup to provide the secure access to the end user.
- Creating Sentry groups to provide the secure access to the Hive database.
- Creating Hive databases and provides HDFS access to the group.
- Writing automation scripts to monitor system and space cleanup on scheduled basis.
- Work with IT delivery Infrastructure teams & business functions for implementing solutions that meet business requirements.
- Hadoop DR server setup creation using BDR/Snapshots refresh methods.
- Create governance policies for the business users to provide the better data protection plan.
- Resolve performance issues in the loads.
- Review and deploy the Spark code written by developer and make necessary YARN queue setup for resource management.
- Attend meeting with business to understand the requirements and provide knowledge on the new technologies.
- Working in Spark SMV and code deployment.
- Manage and allocate work to the team with proper handshake.
- Work directly with project development teams to enable successful project implementation.
- Perform performance Tuning and Increase Operational efficiency of cluster.
- Working with development, engineering and operation teams, to develop KPI’s to ensuring production stability, scalability.
Environment: Hadoop CDH-5.5.4-1, Spark, Hive, HBase
Confidential
Exadata DBA Consultant
Responsibilities:
- Manage RAC databases on Oracle Exadata Appliance.
- Manage Database backup and restore
- Performance tuning of SQL, db instances
- Manage cell storage servers of Exadata storage server
- Monitoring server performance, memory, CPU, application and network and resource management.
- On call support to India project development team.
Environment: Oracle 11gR2, Exadata x4-2 appliance.
Confidential
Sr. Consultant
Responsibilities:
- Project management and planning.
- Configuration of Application performance monitoring tools (ProactiveNet, Transaction monitor application response time) and Service support products (Client Manager, Asset Manager, Software delivery, and Remote control)
- Configuration of Vmware Esx, Solaris, and Linux servers for data center Automation setup using virtualization.
- Installation of data center products for functional test and products are BMC Blade logic operation manager, BMC performance manager for servers (PATROL), BMC Configuration Automation for Networks and Clients, Blade Logic virtualization manager, BMC Application Performance and Analytics.
- Monitoring server performance, memory, CPU, application and network and resource management.
- Installation of the oracle database, create/manage users and table spaces.
- Server setup for better performance of the database server like kernel parameter settings, security limits, file limits.
- Backup of schema, table space, database using data pump utility, and backward compatible exp/imp utility.
- Writing shell and Perl scripts to schedule the db jobs.
- Working on resolving the performance related issues.
- Resolve network related database connection issues.
- Working on Cell Storage Upgrade and database upgrade.
Environment: Oracle 11g, Vmware ESX server, Infrastructure Client, VCenter.
Confidential, NJ
Lead DBA and PL/SQL developer, SQL tuning and SSIS package development.
Responsibilities:
- Developed workflows to load the data from flat files and staging tables to the production database, Developed the scripts which includes stored procedures to update the master and child tables using complex logic of supply chain management. Extensively involved in star schema design and tune the SSIS packages. Written batch files to take single table/ database backup, schedule the SSIS packages for SQL Server 2005. Suggested changes for production server configuration setup and achieved better performance.
Environment: SQL Server 2K5, SQL Server Analysis Services.
Confidential, San Jose
Lead Oracle Database Administrator
Responsibilities:
- Lead the project by understanding the applications interaction with databases and provide and implement solutions which are scalable and provide highest availability.Improve the performance of database in given tight time window to meet the requirements, the current status of development, frequent variations, high importance of the system for the Client's business processes, physical remoteness of the users and other constraints of the database security, this project has been executed for the following tasks.
- Analysis to find out the scope for tuning of the existing stored procedures which are scheduled by the Control-M job.
- Rewrite the stored procedures using OORDBMS features like collections, bulk collect for insert and updates.
- Tune the materialized views query by using the TKProf utility, trace events and hints to minimize the complete refresh time frame.
- Analysis to find out the scope for tuning the Informatica mappings.
- Benchmarking on the existing and tuned stored procedures, materialized views refresh.
- Modification in the db configuration parameters to achieve better performance.
- Recommendations for Kernel parameter configuration settings to get better performance at OS level.
- Modifications to the complex Informatica mappings by using staging table approach.
- Full testing cycle performed using the System Prototype which includes the Performance (evaluation) tests.
Environment: Oracle 10g R2 (RAC), Solaris 5.10, Informatica 8.1
Confidential, San Jose
Consultant (Database expert)
Responsibilities:
- Worked as Oracle/DB2 DBA and mostly involved in the performance tuning, application tuning and instance tuning. Extensively involved in, porting Oracle code into DB2 and SQL Server 2005 databases, Introduced partitioning in DB2 V9.x for True Comp and True Producer applications.
- Written schema upgrade scripts for DB2 and SQL Server 2005. End user interaction for requirements and status call, Bug resolving, tune DB2 server configuration parameters for better performance.
Environment: Oracle 9i/10g R2, DB2 V9.1, Solaris 5.8, AIX
Confidential
Lead DBA
Responsibilities:
- Written the PL/SQL code to load the data from the fact tables
- Written the shell script to schedule the data load script
- Worked on database tuning, RMAN backup script and backup scheduling, checking backup validity.
- 24*7 support to keep the database up & running.
Environment: Oracle 9i, Solaris 5.x
Confidential
Lead DBA
Responsibilities:
- Installation and configuration of Solaris 5.9 and Oracle 9i
- Database instance creation for test, development and production environment, database space management
- Installation of Net genesis product
- Applied oracle 9i patches
- Performance benchmarking with Sun Solaris 5.9 and Oracle9i
- Written scripts in SQL and UNIX shell script to perform hot, cold and logical backups of the Oracle Database
- Tune SQL queries using table indexing and table partitioning
- Develop database/table - indexing strategy to improve response
- Write procedures in PL/SQL to modify production database/application tables
- Develop process to move database changes from test to production
- Creating Users and allocating Space
- Recovery of Database from Disk or Instance failure, Solved Network related problems.
Environment: Oracle 9i, Solaris 5.x
Confidential
Oracle DBA
Responsibilities:
- Managed more then 200 database on 24/7 support. Tuning the SQL and provide the suggestions to the client as and when required. Checking availability of databases and make sure that everything is fine.
- Creation of schemas and table spaces as per the clients requirements.
Environment: Oracle 9i, Solaris 9
Confidential
Oracle DBA
Responsibilities:
- Install, configured, upgrade software s: server, tools, applications Monitor, tune, size, backup, recover, analyze, defrag and migrate
- Design and implement DB security, user management
- SQL and PL/SQL: scripts, triggers, procedures, packages automation projects
- High availability, RMAN
- As a Oracle Apps DBA
- Installed and configured the applications on multi node.
- Applications upgrade, cloning and patching.
- Troubleshooting the servers (web server, form server etc)
- Configuration apache web server, Metric server, form servers and admin server.
- Monitor Applications and Database Backups.
- Performance Tuning of Applications and database
- User creation setups, Creation of Responsibilities
- Menu and functions creations, Profile Option Settings
- Creation of Concurrent Mangers, Programs, and Request sets.
- Troubleshooting of Concurrent Requests and Request sets
- Automation of manual day to day activates using Concurrent programs.
Environment: Oracle 9i, Red Hat Linux 9.0 AS
Confidential
Sr. Consultant
Responsibilities:
- Administering oracle databases which include installation, maintenance, tuning, backup & recovery, replication Analyzing Business processes and introducing new generic as well as customized modules in the system, Developing PL/SQL blocks, triggers, Procedures, Functions to make this package transaction base
- Responsible for Managing Storage (Table space, Rollback segments, and archive log), Security, Materialized views, indexes, views, stored procedures, table level, and schema level and database level triggers
- Created and implemented Database Backup and recovery Plan, Managed Oracle security and data Access Control.
Environment: Oracle 9i, Solaris 5.x, Win2K
Confidential
Software Engineer
Responsibilities:
- Assisting developers in package development and optimization of SQL Queries. Created Scheduled scripts for regular execution of overnight jobs.
- Managed 3 Programmers and more then 100 clients. Managed large scale databases (up to 25 GB).
- Installed new versions of Oracle including Oracle8i. Tuned and Monitored the Clients oracle Database ensuring almost 24x7.
Environment: Oracle 9i, Developer 2K, VB6.0, Java 2