Hadoop Developer Resume
PittsburgH
SUMMARY
- Around 5 years of experience with programming skills in analysis, design, development, testing and deploying various applications with emphasis on object oriented programming
- Hands - on experience with Hadoop MapReduce, HDFS components such as JobTracker, TaskTracker, NameNode, DataNode.
- Experience in working with the Hadoop eco systems ( PIG, HIVE, OOZIE, HBASE, FLUME, ZOOKEEPER, SQOOP)
- Knowledge in analyzing data using the Hive QL and Pig Latin
- Experience in writing Java programs for the Mapper, Reducer and Combiner
- Knowledge with NoSQL databases like HBase and Cassandra.
- Experience in using Apache Flume to move large amount of data from application servers to hadoop
- Experienced on loading of large sets of structured, semi structured and unstructured data.
- Scheduling the workflows and maintaining the clusters using ZooKeeper and Oozie
- Knowledge on several other echo systems like Kafka, Storm, Elasticsearch.
- Working with relative ease with different working strategies like Agile, Waterfall and Scrum methodologies
- Detailed knowledge and experience of Design, Development and Testing Software solutions using Java and J2EE technologies.
- Expertise in design and development of various web and enterprise applications using various frameworks like Struts, Hibernate, Spring and Web Services.
- Experience with front end technologies like HTML, CSS, JSP, AJAX and Javascript.
- Strong analytical skills with ability to quickly understand clients business needs. Involved in meetings to gather information and requirements from the clients.
- Research-oriented, motivated, proactive, self-starter with strong technical, analytical and interpersonal skills.
TECHNICAL SKILLS
Big Data Technologies: HDFS, Hive, Map Reduce, Pig, Sqoop, Flume, Zookeeper, Oozie, YARN
Scripting Languages: Python, Shell
Programming Languages: C, C++, Java
Front End Technologies: HTML, J2EE, CSS, JavaScript, AJAX, Servlets, JSP, DOM, XML.
Web Services: Restful, Soap
Java Frameworks: Struts, Spring, Hibernate
Application Server: Websphere, Weblogic Server, Apache Tomcat.
DB Languages: SQL, PL/SQL
Databases /ETL: Oracle 11g, MySQL, Informatica
NoSQL Databases: Hbase, Cassandra, Mongo DB.
PROFESSIONAL EXPERIENCE
Confidential, Pittsburgh
Hadoop Developer
Responsibilities:
- Developed Oozie Workflows for daily incremental loads, which gets data from Teradata and then imported into hive tables.
- Developed Pig scripts to transform the data into structured format and it are automated through Oozie coordinators.
- Developed Map Reduce programs for applying business rules on the data
- Used Sqoop widely in order to import data from various systems/sources (like MySQL) into HDFS
- Applied Hive queries to perform data analysis on HBase using Storage Handlerin order to meet the business requirements
- Developed Hive UDF’s to bring all the customers email id into a structured format.
- Hands on experience with NoSQL databases like HBase for POC (proof of concept) in storing URL's and images.
- Moved data from HDFS to HBase using Map Reduce using different file formats like Text files, Sequence Files, Avro.
- Cluster co-ordination services through Zookeeper
- Assisted in creating and maintaining Technical documentation to launching HADOOP Clusters and even for executing Hive queries and Pig Scripts
- Assisted in Cluster maintenance, cluster monitoring, adding and removing cluster nodes and Troubleshooting.
Environment: MapReduce, HDFS Sqoop, Flume, LINUX, Oozie, Hadoop, Pig, Hive, Hbase, Cassandra, Hadoop Cluster
Confidential
Hadoop Developer
Responsibilities:
- Design and developed Mapreduce programs in processing the sales data across the different stores in the country
- Worked on importing and exporting data into HDFS and Hive using Sqoop.
- Cluster coordination services through Zookeeper
- Develop Java Restful API.
- Implemented Solar search
- Data Raffinement through Pig and HIVE.
- Data migration between RDBMS and Hadoop through sqoop
- Involved in implementing web interface for UAS using oracle ADF and JDeveloper.
- Designed the web interface for the marketing user to enter the data and submit the request.
- Involved in optimizing the search query and designed the db link, materialized views and oracle scheduler
- Added the custom validation to check the promotion start date that it does not fell into the existing promotion.
- Designed the page navigation flow using the ADF task flow.
Environment: J2EE, JDK, ADF, Oracle SOA Suite, Oracle 11g, Weblogic, Oracle BPM Workspace, JDeveloper, SQL Developer, Mapreduce, Pig, Hive
Confidential, Reston, VA
Java/J2EE Developer
Responsibilities:
- Involved in developing business logic components using JavaBeans and Servlets.
- Involved in utilizing WebLogic specific connection pools in order to interact with the business data from the business components.
- Designed and Developed User Interface using JSP.
- Developed Server-side validation classes using JDBC calls.
- Designed user interface HTML, Swing, CSS, XML, Java Script and JSP.
- Implemented the presentation using a combination of Java Server Pages (JSP) to render the HTML and a well-defined API interface to Allow access to the application services layer.
- Implemented Configuration of Engage Administration and property files.
- Input validations were done using JavaScript.
- Developed applications using Mobile Supply Chain.
Environment: JDK, J2EE, Servlets, JSP, JSF, JMS, JavaScript, HTML, Swing, CSS, XML, XML Spy, Eclipse, Linux, Weblogic.
Confidential, Charlotte, NC
Java Developer
Responsibilities:
- Involved in developing and designing the front end part of the application using Java Swing.
- Helped in creating Use Case diagrams, Class diagrams using tools like rational rose.
- Responsible for designing and building the database using MySQL.
- Configured the application deployment onto the server using Apache Tomcat
- Extensively performed unit testing using tools like JUnit.
- Involved in creating connection to the database using connection pools.
- Performed client side validation using JavaScript and AJAX.
Environment: Java, JDK, Apache Tomcat, JavaScript, HTML, MySQL, JavaScript, AJAX.
Confidential
Jr Java Developer
Responsibilities:
- Gathering and analyzing business requirements.
- Developed user interfaces by using JSP, HTML.
- Involvement in the integration of Spring framework to get information from the user.
- Used Servlets in web application.
- Used JDBC API to interact with Database.
- Active involvement in creating tables, development and coding of stored Procedures using PL/SQL and SQL statements, functions, triggers in Oracle.
- Coded the JUnit test cases and suite for the system.
- Deployment of Application onto the JBOSS Application Server.
- SVN (Subversion) is used for version control.
- Implemented logging using log4j.
- Giving second-level support to QA, UAT and PROD Teams.
Environment: Core Java, Servlets, JSP, JDBC,Spring, WebServices, Oracle 10g, JUnit, Eclipse, Spring Source Tool Suite, JBOSS, Log4J, HTML,SQL,JMS.