Hadoop Consultant Resume
Kansas City, KS
SUMMARY
- Over seven years of comprehensive IT experience in Business Intelligence, Web development using Java, C++, hadoop, Hbase, BigData and BigData Analytics, Banking, Insurance, and Energy.
- Good experience writing MapReduce jobs in Java, Pigand Python.
- Experience in working with Java, C++ and C.
- Hands on experience in installing, configuring and using ecosystem components likeHadoopMapReduce,HDFS,Hbase,Oozie,Hive,Cassandra,Sqoop,Pig, Flume.
- Extensive experience in SQL and NoSQL development.
- In - depth understanding of Data Structure and Algorithms.
- Experience in creating web-based applications using ActiveXControls,JSP,Servlets.
- Experience in implementation of Open-Source frameworks like Struts,Spring,Hibernate,Web Services etc.
- Experience in deploying applications in heterogeneous Application Servers TOMCAT,Web Logic and Oracle Application Server.
- Worked on Multi Clustered environment and setting up ClouderaHadoopecho System.
- Background with traditional databases such as Oracle,Teradata,SQL Server,ETL tools processes and data warehousing architectures.
- Extensive experience in designing analytical OLAP and transactional OLTP databases.
- Proficient using ERwin to design backend data models and entity relationship diagrams (ERDs) for star schemas, snowflake dimensions and fact tables.
- Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.
TECHNICAL SKILLS
Big Data Eco System: Hadoop, MapReduce,HDFS,HBase,Zookeeper,Hive,Pig,Sqoop Cassandra,Oozie,Flume
Programming Languages: C++,Python,Java,J2EE(JDBC, Servlets, JSP,Multi Threading,)
Framework: Struts,Springs,Hibernate
Web Technologies: HTML,DHTML,JavaScript,Ajax,CSS,XML,DTD
Web Services: Apache CXF XFire,Apache Axis,SOAP
Testing Logging Tools: JUnit,EasyMock,JMock,log4Js
Database: Oracle 11g 10g,DB2,MySQL,SQL Server,Teradata
Application Server: Apache Tomcat,Jboss,Web Sphere,Web Logic,Tools ANT,TOAD
Operating System: Windows XP Vista 7,Unix,Linux
PROFESSIONAL EXPERIENCE
Confidential, Kansas City, KS
Hadoop Consultant
Responsibilities:
- Installed and configured Hadoop MapReduce, HDFS and developed multiple MapReduce jobs in Java for data cleansing and preprocessing.
- Involved in loading data from UNIX file system to HDFS.
- Installed and configured Hive and also written Hive UDFs.
- Evaluated business requirements and prepared detailed specifications that follow project guidelines required to develop written programs.
- Devised procedures that solve complex business problems with due considerations for hardware/software capacity and limitations, operating times and desired results.
- Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
- Provided quick response to ad hoc internal and external client requests for data and experienced in creating ad hoc reports.
- Responsible for building scalable distributed data solutions using Hadoop.
- Responsible for cluster maintenance, adding and removing cluster nodes, cluster monitoring and troubleshooting, manage and review data backups, manage and review Hadoop log files.
- Worked hands on with ETL process.
- Handled importing of data from various data sources, performed transformations using Hive, MapReduce, and loaded data into HDFS.
- Extracted the data from Teradata into HDFS using Sqoop.
- Analyzed the data by performing Hive queries and running Pig scripts to know user behavior like shopping enthusiasts, travelers, music lovers etc.
- Exported the patterns analyzed back into Teradata using Sqoop.
- Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.
- Installed Oozie workflow engine to run multiple Hive.
- Developed Hive queries to process the data and generate the data cubes for visualizing..
Environment: Hadoop, MapReduce,HDFS,Hive,Ooozie, Java (jdk1.6), Cloudera,NoSQL,Oracle 11g 10g,PL SQL,SQL*PLUS,Toad 9.6,Windows NT,UNIX Shell Scripting.
Confidential, Richmond,VA
Hadoop Consultant
Responsibilities:
- Responsible for complete SDLC management using different methodologies like Agile, Incremental, Waterfall, etc
- Extensive experience inHadoopmap reduce as Programmer Analyst in business requirement gathering, analysis, scoping, documentation, designing, developing and creating Test Cases.
- Developed big data analytic models for customer fraud transaction pattern detection models usingHivefrom customer transaction data.
- Developed customer transaction event path tree extraction model usingHivefrom customer transaction data.
- Enhanced and optimized the customer path tree GUI viewer to incrementally load the tree data from HBase NoSQL database.Used prefuse opensource java framework for the GUI.
- Design and implement Map Reduce jobs to support distributed data processing.
- Process large data sets utilizing ourHadoopcluster.
- Designing NoSQL schemas in Hbase.
- Developing map-reduce ETL in JavaPig.
- Extensive data validation usingHIVE.
- Installed and configuredHadoopMapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
- Importing and exporting data into HDFS andHiveusing Sqoop.
- Experienced in managing and reviewingHadooplog files.
- Experienced in runningHadoopstreaming jobs to process terabytes of xml format data.
- Load and transform large sets of structured, semi structured and unstructured data.
- Responsible to manage data coming from different sources.
- Supported Map Reduce Programs those are running on the cluster.
- Jobs management using Fair scheduler.
Confidential, San Jose, CA
Java/ J2EE Developer
Responsibilities:
- Involved in System Analysis and Design methodology as well as Object Oriented Design and development using OOA/OOD methodology to capture and model business requirements.
- Proficient in doing Object Oriented Design using UML-Rational Rose.
- Created Technical Design Documentation (TDD) based on the Business Specifications.
- Created JSP pages with Struts Tags and JSTL.
- Developed UI using HTML, JavaScript, CSS, AJAX and JSP for interactive cross browser functionality and complex user interface.
- Implemented the web-based application following the MVC II architecture using Struts Framework.
- Used XML DOM API for parsing XML.
- Developed Scripts for automation of productions tasks using Perl,Unix scripts
- Used ANT for compilation and building JAR, WAR and EAR files.
- Used JUnit/Eclipse for the unit testing of various modules.
- Project coordination with other Development teams, System managers and web master and developed good working environment.
Environment: Java, J2EE, JSP, Javascript, AJAX, MVC, Servlet, Struts, Oracle, PL/SQL, Weblogic Application Server 8.1, XML. UML, JUnit, ANT, Perl,Unix..
Confidential, Houston, TX
Java Developer
Responsibilities:
- Involved in the process Design, Coding and Testing phases of the software development cycle.
- Designed use-case, sequence and class diagram (UML).
- Developed rich web user interfaces using JavaScript (pre-developed library).
- Created modules in Java and C++, python.
- Developed JSP pages with Struts framework, Custom tags and JSTL.
- Developed Servlets, JSP pages, Beans, JavaScript and worked on integration.
- Developed SOAP/WSDL interface to exchange usage and Image and terrain information from Geomaps.
- Developed Unit test cases for the classes using JUnit.
- Developed stored procedures to extract data from Oracle database.
- Developed and maintained Ant Scripts for the build purposes on testing and production environments.
- Involved in building and parsing XML documents using SAX parser.
- Application developed with strict adherence to J2EE best practices.
Environment: Java, C++, Python, JavaScript, Struts, Spring, Hibernate, SQL/PLSQL, Web Services, WSDL, Linux, Unix.
Confidential
Software Engineer
Responsibilities:
- Designed database and coded PL/SQL stored Procedures, triggers required for the project.
- Created reusable components in java beans to keep track of all the business transactions of BSE listed companies.
- Worked on conversion of some modules using Java, C++, Python..
- Involved in generating screens and reports in JSP, Servlets, HTML and java script for the business users.
- Business logic was developer in Python and C++
- Supported Java J2EE applications
Environment: Servlets, JDBC, JSP, Java J2EE,Python,C++, Unix, Oracle