Hadoop Developer II Resume , Miami, FL - Hire IT People

PROFESSIONAL EXPERIENCE:

Confidential, Miami, FL

Hadoop Developer II

Responsibilities:

Create Python scripts for data cleaning of output from Hive &HBase queries
Develop JUnit tests for testing ETL pipeline
Incorporated Flume to schedule workflow of Hadoop jobs (Sqoop, Hive, HBase/Ambari, Pig)
Create network graphs of customers& transactions for management & sales team presentations using Python Networkx&Gephi packages
Implement Cascading framework to increase development time on ETL & analysis pipeline
Maintain security permissions of Hadoop users on AWS using Identity Access Management & log files

Confidential, Miami, FL

Hadoop Developer I

Responsibilities:

Assisted manual installation of AWS 50 - node development Hadoop cluster on EC2
Expanded cluster to 200+ flexible node cluster for production on EC2 using Hortonworks HDP
Integrated Oracle Endeca for faceted search of market opportunities & customers
Wrote Sqoop jobs to push data into HDFS from RDBMS (SQL) & out of HDFS into RDBMS (SQL)
Developed Hive jobs for data query & analysis of financial market transactions
Incorporated Flume for processing of streaming log file data

Confidential, Charlottesville, VA

IT Associate I, Windows Administration

Responsibilities:

Upgraded Unix (Ubuntu) & Windows networks to stable releases
Maintain Norton Antivirus software by running weekly tests of new virus threats on standalone terminals
Maintain user account restrictions by keeping log of user permission changes & activities