We provide IT Staff Augmentation Services!

Hadoop Administrator Resume

0/5 (Submit Your Rating)

San Francisco, CA

SUMMARY

  • Over 2.5 years of Hands On Experience in Apache Hadoop (Cloudera Version)
  • Over 10 years of professional and progressive experience in DB2 UDB, Data warehousing Environment, Data Modeling, SQL, Perl, SAP, Oracle and SQL Server 2005 in a challenging, diverse, and dynamic environment.
  • UDB DBA with IBM AIX experience in systems, development, and management in a production environment.
  • Hands on Experience in Hadoop Administration using CDH4—Cloudera Distribution.
  • Hands on experience in Map Reduce programs using Pig.
  • Good Knowledge about Hadoop Hive, Impala.
  • Hands on experience in upgrading Postgres SQL 8.4 to 9.2
  • Excellent experience with Shell Scripting and other scripting languages.
  • Hands on experience on various DB2 areas which include database design, implementation and maintenance of different applications.
  • Professional and hands on experience on DB2 UDB Utilities like Export, Import, Load and DB2MOVE and other maintenance utilities like BACKUP, RESTORE, REORGCHK, REORG and RUNSTATS for database tables.
  • Has concrete experience on other supportive tools of DB2 which concretes vision on DB2 UDB.
  • Excellent Hands on experience on UDB DB2 in LUW (Linux, Unix and Windows)

TECHNICAL SKILLS

Databases\ERP\: IBM DB2 UDB, MySQL, Sybase, \SAP Netweaver 2004s, SAP R/3 4.7, \ Oracle 8/9i, MS SQL Server, \SAP R/3 4.6\ Informix, MS Access, Balanced \ Configuration Unit, SAN\

Miscellaneous Tools\Database Design Tools\: IBM Migration Tool Kit, Replication \ERWin, QDesigner, \ Tool Kit, Information Integrator, \Quest Data Factory\ BMC Patrol, Embarcadero \ DBArtisan, Quest System Catalog \ Views, Quest Central for DB2, \ Quest Knowledge Xpert for DB2, \ DB2 Connect\

Operating Systems\Security Tools\: Linux (Redhat), AIX 5L, Windows\Firewalls, IDS, File Checkers, \ (2000,NT XP), Solaris, Unix, MVS\Security Suites, Honeypots\

Hardware\Reporting tools\: Storage Area Network (SAN), \ Cognos, SAP BI 7.0, \ IBM RS 6000, DS4500, ESS800\SSRS (Microsoft)\

Programming Languages\Web Servers\: DB2 CLI, Embedded SQL, SQLJ, \IBM WebSphere, Apache Tomcat, \ Postgre SQL, Java Scripts, Shell \BEA Weblogic\ Scripting, Perl, Microsoft Visual basic, \ C, C++, Turbo Pascal, VB.NET, \ ASP.NET, PERL\

Web Technology\ ETL tools\: Web Service, SOAP, HTML, DHTML, \Informatica\ XML, VBScript, Adobe Photoshop, \ Dream Weaver, Flash, FrontPage, \ Apache, IIS, PHP, ASP \

Others\: DB2 UDB Utilities like Export, Import, \ Load and DB2MOVE and other \ maintenance utilities like BACKUP, \ RESTORE, REORGCHK, REORG \ and RUNSTATS for database tables, \ Experience in designing and \ implementing Database Security, \ Stored Procedures, Triggers, UDF, \ Troubleshooting database issues\

PROFESSIONAL EXPERIENCE

Confidential, San Francisco, CA

Hadoop Administrator

Responsibilities:

  • Upgraded Hadoop Production,UAT,DEV and DR Clusters memory from 32 GB to 128 GB
  • Crucial member in Production Support for One - Hadoop Cluster.
  • Upgraded PostgreSQL from Version 8.4 to Version 9.2, throughout the the entire OneHadoop Cluster.
  • Upgraded Hadoop Cluster from 5.1 to 5.3 as a part of Upgrade process.
  • Did various scripting using Bash and UNIX Shell for automating multiple jobs.
  • Hands on experience in administering PostgreSQL for Hadoop Clusters.
  • Hands on experience in working with Flume component
  • Various Hadoop Troubleshooting experiences in production Cluster.
  • Setup High Availability for PostgreSQL Server in all environments.
  • Upgraded Cloudera Manager for OneHadoop Environment.
  • Setup replication of Hadoop Components (HDFS and Hive)
  • Worked with developers for Impala and Hive issues.
  • Tuned various Hadoop parameters for bettering Performance of OneHadoop Cluster.
  • Managed and reviewed Hadoop Log File for locating errors and warnings.
  • Worked on maintaining the cluster (Adding and removing multiple Nodes)
  • Worked closely with Infrastructure team to ensure fully availability of Hadoop Services.
  • Opened multiple tickets with Cloudera for locating issues and resolving problems, worked closely with Cloudera Employees for the resolution.

Environment: Red Enterprise Linux Server 6.2, Cloudera Manager 5.3, 5.1, CDH 5.3.1 and 5.1.0, Hive 0.10 and 0.13, Postgres SQL 9.2 and 8.4, MapReduce 2.0, HDFS 2.0

Confidential, San Jose, CA

Hadoop Administrator

Responsibilities:

  • Installed and Configured Hadoop Cluster
  • Involved in loading data from UNIX file system to HDFS.
  • Involved in analyzing system failures, identifying root causes for Hadoop Clusters.
  • Hands on experience in writing pig Latin scripts and pig commands.
  • Worked on importing and exporting data from DB2 Database into HDFS and HIVE using SQOOP and also using Hadoop Commands.
  • Strong understanding of Cassandra database.
  • Hands-on experience in Working with Hadoop applications (such as administration, configuration management, monitoring, debugging, and performance tuning).
  • Worked with jobs using Fair Scheduler.
  • Managed, reviewed and Troubleshot Hadoop log files.
  • Added and decommissioned Data Nodes in Hadoop Cluster
  • Good Understanding of MapR and working knowledge of the same.
  • Hands on expericnce in writing Pig Scripts for Map Reduce Programs.
  • Hands on Experience in supporting Map Reduce programs that are run on the cluster.
  • Good Understanding of Hadoop Eco System Components.

Environment: CHD3, CentOs, MacOs Snow Leopard, Home Brew, Sqoop, Hive, MapR

Confidential

UDB DBA

Responsibilities:

  • Upgraded db2 from V8.2 to V9.7
  • Worked on multiple POC’s before fixing on the DB2 Version and level.
  • Audited the DB2 Ecosystems for DB2 Licensing and other cost reduction issues.
  • Worked with application developers and business users for DB2 Performance issues.
  • Compiled PreUpgrade & Post Upgrade DB2 sessions and compared the performances.
  • Worked with DB2 End users and developers to make the transition from db2 8.2 to 9.7 and completed the SDLC.
  • Converted db2 Type 1 Indexes to Type 2 Indexes.
  • Supported Production Support issues pertaining to the db2 upgrade.
  • Wrote CPU utilization scripts to assess the CPU utilization and memory utilization of servers.
  • Worked with tools like QMF, Uptime for db2 performance analysis.
  • Rewrote DB2 Governor as a custom application.
  • Deployed the Custom Developed DB2 Governor across the db2 ecosystems.
  • Worked with offshore team for DB2 Custom Governor Deployment and other db2 support issues.
  • Opened multiple IBM PMR tickets for db2 upgrade and db2 performance issues and worked with the IBM support team for performance impacts and other issues.
  • Understanding and working knowledge with big data technologies like Hadoop, Map reduce, and no SQL Mongo DB.
  • Good experience with DB2 LVM’s.
  • Created DB2 Disaster Recovery Procedures as and when needed.

Environment: DB2 UDB 8.2, UDB 9.7 Fix Pak 7, AIX 5.3, 6.1, Uptime, QMF, Sql Server 2008.Shell Scripting and Perl.

Confidential, Bloomington, IL

UDB/DB2 DBA

Responsibilities:

  • Worked with Application Developers to plan the mirgation of data from AIX to Linux.
  • Created UNIX shell scripts for Data Migration.
  • Created UNIX shell scripts for Data Validation of Special Characters in the data set.
  • Worked with the application developers to reengineer their databases with respect to their application perspective.
  • Created new table and table-spaces as per the requirement suggestions of the application owners.
  • Modified the Scripts of the Applications to suit the new environment.
  • Tuned SQL queries as a part of the Database performance evaluations.
  • Created Security Scripts to evaluate User Rights and Privileges in the existing environments.
  • Migrated the modified databases and utility scripts from DEV to QA and then to Production Servers.
  • Worked with Application Owners and Developes for the functionality testing of the applications.
  • Lead an offshore team to support the migration of Databases as and when it was required.
  • Created a Migration Document consistent to the Migration Policies followed and got it approved from the application owners with every Migration.
  • Worked with the Business Users for functionality testing.

Environment: DB2 UDB 9.1, UDB 9.5, AIX 5.3, RHEL

Confidential, Littlerock, AR

UDB/DB2 DBA

Responsibilities:

  • Working with Ab Initio Developers to successfully Implement Ab Initio Plans.
  • Developed UNIX Shell scripts for running Backups across the UDB environment.
  • Developed UNIX Shell scripts for running Restores across the UDB environment.
  • Created new Table spaces for the databases as and when necessary.
  • Created new tables for the Ab Initio developers as a part of their Data ware House Expansions
  • Tuned SQL Queries by tuning Database Parameters
  • Created new indexes for tables and assigned them to their Individual Tablespaces.
  • Worked with Developers and Business users to assign them to new Security Roles evolved as a result of SOX and SOD compliance.
  • Worked with the management team to create new roles and access lists based on SOX, SOD compliances and the business needs of Confidential .
  • Created UDB Security Document consistent to the recommendations for a secure Database Environment as a part of Best Practices.
  • Migrated the newly created objects from DEV to QA and then to Production Servers thereby completing a full life cycle of SDLC.
  • Worked with offshore teams to co-ordinate Job Scheduling of Dataware Houses.
  • Worked with Business Users for restoring and granting access to various Database objects.

Environment: DB2 UDB 9.1, UDB 9.5, AIX 5.3, AQT V 7.1.3, Ab Initio 3.0.2.1

Confidential, Windsor, CT

UDB/DB2 DBA

Responsibilities:

  • Wrote Security Codes for the UDB Databases in the ING Environment.
  • Developed UNIX Shell scripts for running Security Scans across the UDB environment.
  • Generated Scan Reports based on Security Scans on a weekly basis.
  • Evaluated the Security loopholes available in the Weekly Security Scans.
  • Worked with the UDB DBA’s as well as with the Business Users to gather important inputs for the Security Holes that was exposed on the Security Scans.
  • Provided remedy for Security issues that was exposed in the Security Scans.
  • Provided recommendations and design decisions to UDB DBA teams for dealing with UDB Security Lapses.
  • Created UDB Security Document consistent to the recommendations for a secure Database Environment as a part of Best Practices.
  • Migrated the Security Scanners from DEV to QA and then to Production Servers thereby completing a full life cycle of SDLC.
  • Worked with UDB DBA’s to create a Database model consistent to SOX, SOD expectations.
  • Worked with the System Administrators for OS Security pertaining to DB2 Installations and Log Files.
  • Worked with offshore teams to co-ordinate Cron Job Scheduling of Security Scans.
  • Worked with ING’s Gloabal Security Teams to provide guidelines of Database Hardening issues.

Environment: DB2 UDB 9.1, UDB 8.x, UDB 9.5, Red Hat Linux 5.4, Sun Solaris 9.4 or SPARC, Bash Shell Scripting, Korn Shell Scripting, Sarbanes Oxley, SoD.

Confidential, Philadelphia, PA

UDB/DB2 DBA

Responsibilities:

  • Supported DB2 UDB version 9.1 on EEE for Data Warehouse projects on AIX platform
  • Develop UNIX Korn Shell Scripts to build, populate and maintain databases on AIX platform
  • Performance tuning of DB2 databases on AIX platform
  • AIX Administration support tasks for DB2 EEE Warehouses, such as determination of space allocation, userid support and file system management
  • Migrated data from DEV to TST and to other environments as a part of DataMove process.
  • Restored database backups from Netbackup Environment.
  • Worked with Informatica Developers (from SYNTEL) to fine tune queries
  • Worked with IBM Infrastructure team for resource and space allocation for creating new databases as and when the need arises.
  • Worked with IBM Toronto team to resolve PMR tickets and issues.
  • Provided recommendations and design decisions on: backup and recovery techniques; maintenance plans; statistics gathering; monitoring techniques/scripts; data loading, extraction, and transformation techniques.
  • Helped in creating documentation and recommendations on strategic project planning.
  • Worked with Autosys team for co-ordinating job schedules and job queues for the databases.

Environment: DB2 UDB 9.1 with FixPak 8, AIX 5.3, DB2 EEE, IBM P595, Symantec NetBackup 6.5, Sun OS 5.10 on Sun Sparc Machine, Informatica 8.6.1

Confidential, Allentown, PA

Responsibilities:

  • Was the main Database Architect for the project.
  • Excellent experience on UDB on LUW.
  • Designed Logical and physical database for business transaction functionality
  • Installed UDB in the DEV box and created UDB instances and databases.
  • Created DDL's for table spaces, buffer pools, tables and indexes
  • Created Backup and recovery scripts using shell scripts.
  • Used db2 utilities like export, import, load utilities to manage table data.
  • Used RUNSTATS, REORGCHK and REORG to enhance application performance as a part of normal DBA activities.
  • Tuned UDB databases by tuning db and dbm cfg parameters.
  • Created EXPLAIN tables and ran the visual explain utility on SQL statements.
  • Configured Incremental database backup methodologies for the UDB databases.
  • Helped the developers write fine tuned SQL queries and detect missing indexes.
  • Performed redirected restore to clone production databases in Quality.
  • Used db2expln for assessing access paths of the SQL queries
  • Ran the capacity testing; perform benchmark testing, design and implement procedure for capacity testing.
  • Used db2advis for designing new indexes for the queries as a part of SQL query optimization.
  • Make suggestions/recommendations based on data manipulation needs of the application and manage DBA Service Request queues to meet reasonable project deadlines.
  • Work in close association with Business Analysts and Technical leads to model data.
  • Installed and administered Web Sphere for the project.
  • Hands on experience on RHEL 4.0 (Linux) Admin for the database hosted systems.
  • Used ETL tool Informatica to load data into the UDB database.

Environment: DB2 UDB 9.1, RHELinux 5.0 (LUW), ERWIN Data Modeler, Oracle 10g, SQL Server 2005, SAP Net Weaver 7.0, SAP ECC 6.0, IBM WebSphere 7.0

Confidential, Atlanta, GA

Responsibilities:

  • Created UDB instances and databases as per the need.
  • Hands on experience on databases in the range of 10 TB's or more and high transaction rates.
  • Hands on experience in the performance tuning of database.
  • Monitor database performance, like buffer pool hit ratio, package hit ratio, catalog hit ratios.
  • Helped developers create SQL queries as per the business needs and tuned the SQL queries for the purpose of testing UDB Databases.
  • Created Shell scripts for automating backup in incremental mode.
  • Created a document for, the best practices to follow daily, weekly, monthly to keep the database Health monitoring and DBA activities.
  • Used db2 utilities like db2expln, db2advis and db2move for cloning databases from DEV system to QA system and Prod Systems.
  • Created Snapshots for monitoring slow running queries and analyzed the SQL paths for checking performance.
  • Monitoring and providing 24x7 support for the production database.
  • Helped the Java developers to establish connectivity between Java code to the backend database namely UDB.
  • Migrated databases from production systems to quality systems using redirected restore.
  • Worked with users to resolve performance and connectivity issues.
  • Supported the development team with new releases.
  • Good understanding of SQL Server 2005 and Oracle 10g.
  • DBA for DB2 in SAP systems.
  • Good understanding of XML scripts.
  • Tested HADR for the systems as a part of yearly monitoring.
  • Hands on experience on DB2 EEE.
  • Good understanding of Multi Dimension Clusters and MQT's.
  • Good understanding of DB2 Partitioning for DB2 EEE Environments.

Environment: DB2 UDB 9.1 (LUW), AIX 5.3, ERWIN Data Modeler, Oracle 10g, SQL Server 2005, SAP Net Weaver 7.0, SAP ECC 6.0

Confidential, Chino Hills, CA

Responsibilities:

  • Created UDB instances and databases.
  • Created Snapshot monitors and event monitors to monitor health of the system
  • Usage of Import, Export and Load utilities along with DB2move and DB2look to assist in migrating databases to different operating systems
  • Migrated database from DEV to Quality and PRD as per requirements
  • Performance Tuning-Monitoring buffer pools and database configuration
  • Applied fixpacks, including alternate fixpacks to database servers
  • Automated REORGCHK, REORG, RUNSTATS and REBIND utilities in a complex database environment
  • Created Backup strategies for the database backup for SAP server. lead DBA for SAP UDB Systems.
  • Excellent understanding of Data Modelling in consistent to the requirements.
  • Hands on experience on root cause analysis of db2 issues and provided solutions for the same.
  • Excellent exposure to db2 EEE.
  • Was the DBA of DB2/UDB EEE Environment (Partitioned Database)
  • Good understanding on working with the clients for bigger databases.
  • Excellent understanding of sizing guidelines and networking infrastructure.

Environment: Windows 2003 Server, DB2 8.1(LUW), ECC 6.0, CRM 5.0, SAP Netweaver 7.0, Windows XP

Confidential, NJ

Responsibilities:

  • Provide 24X7 support for UDB databases
  • Dealt with production and design issues.
  • Provide valid methodologies for designing aspects
  • Provided good backup and disaster recovery methodologies for databases
  • Work with developers so that they will have a easy approach when they deal with their design approaches.
  • Work in close association with Project Managers and Technical leads to give a satisfied approach to Service Level Agreements.
  • Created and maintained databases, table-spaces, tables, views, and indexes.
  • Documented plans and procedures in terms of backups, restores and disaster
  • Used DB2 data maintenance activities like REORG, RUNSTATS, LOAD, UNLOAD, IMPORT and EXPORT.
  • Tuned application queries, Databases and Systems for best performance using db and dbm parameters.
  • Created Snapshots for analyzing bufferppols, tablespaces and SQL queries

Environment: IBM AIX 5.1, In DB2 UDB 8.1 and 8.2 and Using data modelling tools like Erwin data Modeller

Confidential, Richmond, Virginna

Responsibilities:

  • Design a database that could house 10TB of data. Provide solutions for DB2 EEE with respect to the data warehousing Environment.
  • Was the Database Architect for this Project.
  • Designed the Star Schema Model for the Datawarehouse system.
  • Designed BCU for the large database for IBM which was sold to Confidential for 2.5 million Dollars
  • Designed and Implemented Database for the Test and Development Environment in DB2 EEE.
  • Provide Backup and Recovery Methodologies for the Database.
  • Responsible for providing a free flowing and secure database data transfer.
  • Was responsible for providing Security database model for the database.
  • Provided support for creation of SAN and BCU.
  • Provided valid information for hardware and networking details of the environment.
  • Helped IBM in finalizing the business details of the environment.
  • Provided weekly presentations for planning the environment
  • Helped client in finalizing the goals and making it easy for them to reach the needed potential.

Environment: RHELinux 4.0, AIX 5.1, DB2 UDB 8.x on LUW, DB2 8.2 DPF, DB2 Admin Tools and DB2 Development Tools, SQL, Erwin Data Modeler, Data Warehousing Environment

We'd love your feedback!