We provide IT Staff Augmentation Services!

Hadoop Consultant Resume

0/5 (Submit Your Rating)

Kansas City, KS

SUMMARY

  • Over seven years of comprehensive IT experience in Business Intelligence, Web development using Java, C++, hadoop, Hbase, BigData and BigData Analytics, Banking, Insurance, and Energy.
  • Good experience writing MapReduce jobs in Java, Pigand Python.
  • Experience in working with Java, C++ and C.
  • Hands on experience in installing, configuring and using ecosystem components likeHadoopMapReduce,HDFS,Hbase,Oozie,Hive,Cassandra,Sqoop,Pig, Flume.
  • Extensive experience in SQL and NoSQL development.
  • In - depth understanding of Data Structure and Algorithms.
  • Experience in creating web-based applications using ActiveXControls,JSP,Servlets.
  • Experience in implementation of Open-Source frameworks like Struts,Spring,Hibernate,Web Services etc.
  • Experience in deploying applications in heterogeneous Application Servers TOMCAT,Web Logic and Oracle Application Server.
  • Worked on Multi Clustered environment and setting up ClouderaHadoopecho System.
  • Background with traditional databases such as Oracle,Teradata,SQL Server,ETL tools processes and data warehousing architectures.
  • Extensive experience in designing analytical OLAP and transactional OLTP databases.
  • Proficient using ERwin to design backend data models and entity relationship diagrams (ERDs) for star schemas, snowflake dimensions and fact tables.
  • Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.

TECHNICAL SKILLS

Big Data Eco System: Hadoop, MapReduce,HDFS,HBase,Zookeeper,Hive,Pig,Sqoop Cassandra,Oozie,Flume

Programming Languages: C++,Python,Java,J2EE(JDBC, Servlets, JSP,Multi Threading,)

Framework: Struts,Springs,Hibernate

Web Technologies: HTML,DHTML,JavaScript,Ajax,CSS,XML,DTD

Web Services: Apache CXF XFire,Apache Axis,SOAP

Testing Logging Tools: JUnit,EasyMock,JMock,log4Js

Database: Oracle 11g 10g,DB2,MySQL,SQL Server,Teradata

Application Server: Apache Tomcat,Jboss,Web Sphere,Web Logic,Tools ANT,TOAD

Operating System: Windows XP Vista 7,Unix,Linux

PROFESSIONAL EXPERIENCE

Confidential, Kansas City, KS

Hadoop Consultant

Responsibilities:

  • Installed and configured Hadoop MapReduce, HDFS and developed multiple MapReduce jobs in Java for data cleansing and preprocessing.
  • Involved in loading data from UNIX file system to HDFS.
  • Installed and configured Hive and also written Hive UDFs.
  • Evaluated business requirements and prepared detailed specifications that follow project guidelines required to develop written programs.
  • Devised procedures that solve complex business problems with due considerations for hardware/software capacity and limitations, operating times and desired results.
  • Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
  • Provided quick response to ad hoc internal and external client requests for data and experienced in creating ad hoc reports.
  • Responsible for building scalable distributed data solutions using Hadoop.
  • Responsible for cluster maintenance, adding and removing cluster nodes, cluster monitoring and troubleshooting, manage and review data backups, manage and review Hadoop log files.
  • Worked hands on with ETL process.
  • Handled importing of data from various data sources, performed transformations using Hive, MapReduce, and loaded data into HDFS.
  • Extracted the data from Teradata into HDFS using Sqoop.
  • Analyzed the data by performing Hive queries and running Pig scripts to know user behavior like shopping enthusiasts, travelers, music lovers etc.
  • Exported the patterns analyzed back into Teradata using Sqoop.
  • Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.
  • Installed Oozie workflow engine to run multiple Hive.
  • Developed Hive queries to process the data and generate the data cubes for visualizing..

Environment: Hadoop, MapReduce,HDFS,Hive,Ooozie, Java (jdk1.6), Cloudera,NoSQL,Oracle 11g 10g,PL SQL,SQL*PLUS,Toad 9.6,Windows NT,UNIX Shell Scripting.

Confidential, Richmond,VA

Hadoop Consultant

Responsibilities:

  • Responsible for complete SDLC management using different methodologies like Agile, Incremental, Waterfall, etc
  • Extensive experience inHadoopmap reduce as Programmer Analyst in business requirement gathering, analysis, scoping, documentation, designing, developing and creating Test Cases.
  • Developed big data analytic models for customer fraud transaction pattern detection models usingHivefrom customer transaction data.
  • Developed customer transaction event path tree extraction model usingHivefrom customer transaction data.
  • Enhanced and optimized the customer path tree GUI viewer to incrementally load the tree data from HBase NoSQL database.Used prefuse opensource java framework for the GUI.
  • Design and implement Map Reduce jobs to support distributed data processing.
  • Process large data sets utilizing ourHadoopcluster.
  • Designing NoSQL schemas in Hbase.
  • Developing map-reduce ETL in JavaPig.
  • Extensive data validation usingHIVE.
  • Installed and configuredHadoopMapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
  • Importing and exporting data into HDFS andHiveusing Sqoop.
  • Experienced in managing and reviewingHadooplog files.
  • Experienced in runningHadoopstreaming jobs to process terabytes of xml format data.
  • Load and transform large sets of structured, semi structured and unstructured data.
  • Responsible to manage data coming from different sources.
  • Supported Map Reduce Programs those are running on the cluster.
  • Jobs management using Fair scheduler.

Confidential, San Jose, CA

Java/ J2EE Developer

Responsibilities:

  • Involved in System Analysis and Design methodology as well as Object Oriented Design and development using OOA/OOD methodology to capture and model business requirements.
  • Proficient in doing Object Oriented Design using UML-Rational Rose.
  • Created Technical Design Documentation (TDD) based on the Business Specifications.
  • Created JSP pages with Struts Tags and JSTL.
  • Developed UI using HTML, JavaScript, CSS, AJAX and JSP for interactive cross browser functionality and complex user interface.
  • Implemented the web-based application following the MVC II architecture using Struts Framework.
  • Used XML DOM API for parsing XML.
  • Developed Scripts for automation of productions tasks using Perl,Unix scripts
  • Used ANT for compilation and building JAR, WAR and EAR files.
  • Used JUnit/Eclipse for the unit testing of various modules.
  • Project coordination with other Development teams, System managers and web master and developed good working environment.

Environment: Java, J2EE, JSP, Javascript, AJAX, MVC, Servlet, Struts, Oracle, PL/SQL, Weblogic Application Server 8.1, XML. UML, JUnit, ANT, Perl,Unix..

Confidential, Houston, TX

Java Developer

Responsibilities:

  • Involved in the process Design, Coding and Testing phases of the software development cycle.
  • Designed use-case, sequence and class diagram (UML).
  • Developed rich web user interfaces using JavaScript (pre-developed library).
  • Created modules in Java and C++, python.
  • Developed JSP pages with Struts framework, Custom tags and JSTL.
  • Developed Servlets, JSP pages, Beans, JavaScript and worked on integration.
  • Developed SOAP/WSDL interface to exchange usage and Image and terrain information from Geomaps.
  • Developed Unit test cases for the classes using JUnit.
  • Developed stored procedures to extract data from Oracle database.
  • Developed and maintained Ant Scripts for the build purposes on testing and production environments.
  • Involved in building and parsing XML documents using SAX parser.
  • Application developed with strict adherence to J2EE best practices.

Environment: Java, C++, Python, JavaScript, Struts, Spring, Hibernate, SQL/PLSQL, Web Services, WSDL, Linux, Unix.

Confidential

Software Engineer

Responsibilities:

  • Designed database and coded PL/SQL stored Procedures, triggers required for the project.
  • Created reusable components in java beans to keep track of all the business transactions of BSE listed companies.
  • Worked on conversion of some modules using Java, C++, Python..
  • Involved in generating screens and reports in JSP, Servlets, HTML and java script for the business users.
  • Business logic was developer in Python and C++
  • Supported Java J2EE applications

Environment: Servlets, JDBC, JSP, Java J2EE,Python,C++, Unix, Oracle

We'd love your feedback!