Hadoop Developer Resume
Dover, DelwarE
SUMMARY
- Around 7.5 years of experience in Information Technology involving Analysis, Design, Coding, Testing, Implementation and Training. Excellent skills in state - of-the-art technology of client server computing, desktop applications and website development.
- 2.5 years of work experience in Hadoop with hands on experience in writing custom Map Reduce jobs.
- 5 years of professional experience as a Java/J2EE programmer developing applications using Servlets, JSP, EJB, Struts, Spring, JSF, Java Beans, JDBC, JMS, Hibernate and MVC architecture.
- Had good working experience on Hadoop architecture, HDFS, Map Reduce and other components in the Cloudera - Hadoop echo system.
- Good working experience onHadooparchitecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm
- Hands on experience in installing, configuring, and usingHadoopecosystem components like Hadoop, Map Reduce, HDFS, HBase, Hive, Sqoop, Pig, Zookeeper and Flume.
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice versa.
- Hands on experience in Sequence files, ORC files, Combiners, Counters, Dynamic Partitions, Bucketing for best practice and performance improvement.
- Good working experience onHadoopCluster architecture and monitoring the cluster.
In-depth understanding of Data Structure and Algorithms.
- Experience in managing and reviewingHadooplog files.
- Excellent understanding and knowledge of NOSQL databases like HBase, and Mongo DB.
- Progressive experience in all phases of the iterative Software Development Life Cycle (SDLC).Actively involved in Requirements Gathering, Analysis, Development, Unit Testing and Integration Testing.Worked on Agile Methodology projects extensively.
- Experience in implementing in setting up standards and processes forHadoopbased application design and implementation.
- Extensive experience working in JavaScript for client side validations and implemented AJAX with JavaScript for reducing data transfer overhead between user and server.
- Extensive experience working in Oracle, SQL Server and My SQL database.
- Hands on experience in application development using Java and RDBMS.
- Experience in the design and implementation of dynamic Web-based applications using Core Java, Struts, Java Server Faces, Hibernate and XML technologies.
- Implemented J2EE modules based on MVC Design Pattern.
- Strong knowledge in developing Internet/Intranet Applications with JSP, XML, CSS, HTML, JavaScript.
TECHNICAL SKILLS
Hadoop: Hadoop, HDFS, MapReduce, Pig, Hive, Sqoop, Zookeeper, Yarn, Solr,Elastic search,Impala,Kafka,tableau,NoSql-Hbase,Cassandra.
Web Technologies: DHTML, HTML, XHTML, XML, XSL (XSLT, XPATH), XSD, CSS, JavaScript
Server Side Scripting: UNIX Shell Scripting
Database: Oracle 10g, Microsoft SQL Server, MySQL, DB2,Optima,Teradata Sql,Sybase,RDBS.
Programming Languages: Java, J2EE, JSTL, JDBC, JSP, Java Servlets, JMS, JUNIT,Log4j,Python, Perl
Web Servers: Apache Tomcat, BEA Weblogic,IBM Websphere
IDE: WSAD, IRAD, Eclipse, Dreamweaver
OS/Platforms: Mac OS X,Windows2008/Vista/2003/XP/2000/NT,Linux(All major distributions), Unix.
Client side: JavaScript, CSS, HTML, JQuery
XML: XML, HTML, DTD, XML Schema, XPath
Methodologies: Agile, UML, Design Patterns, SDLC
PROFESSIONAL EXPERIENCE
Confidential, Dover, Delware
Hadoop Developer
Responsibilities:
- Gathered the business requirements from the Business Partners and Subject Matter Experts.
- Managing and scheduling Jobs on aHadoop cluster using Oozie.
- Responsible for designing and managing the Sqoop jobs that uploaded the data from Oracle to HDFS and Hive.
- Involved in moving all log files generated from various sources to HDFS for further processing through Flume.
- Worked on Hue interface for querying the data.
- Developed Pig scripts for data analysis and extended its functionality by developing custom UDF's.
- Created Hive tables and impala to store the processed results in a tabular format.
- Was done various compressions and file formats like snappy,Gzip,Bzip2, avro, parquet, text.
- Utilized cluster co-ordination services through ZooKeeper.
- Implemented test scripts to support test driven development and continuous integration.
- Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
- Analyzed large amounts of data sets to determine the optimal way to aggregate and report on it.
- Participate in requirement gathering and analysis phase of the project in documenting the business requirements by conducting workshops/meetings with various business users.
Environment: Hadoop,HDFS, Pig, Hive, Impala,Oozie, Sqoop, Flume, Oracle 10g, Java, Eclipse.
Confidential, Atlanta GA
Hadoop Developer
Responsibilities:
- Work with the Teradata analysis team to gather the business requirements.
- Worked extensively on importing data using Sqoop and flume.
- Responsible for creating complex tables using hive.
- Created partitioned tables in Hive for best performance and faster querying.
- Transportation of data to Hbase using flume.
- Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing with Pig.
- Experience with professional software engineering practices and best practices for the full software development life cycle including coding standards, code reviews, source control management and build processes.
- Worked collaboratively with all levels of business stakeholders to architect, implement and test Big Data based analytical solution from disparate sources
- Involved in source system analysis, data analysis, data modeling to ETL (Extract, Transform and Load)
- Written multiple MapReduce procedures to power data for extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV & other compressed file formats.
- Handling structured and unstructured data and applying ETL processes.
- Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS
- Developed the Pig UDF'S to pre-process the data for analysis.
- Develop Hive queries for the analysts
- Prepare Developer (Unit) Test cases and execute Developer Testing.
- Create/Modify shell scripts for scheduling various data cleansing scripts and ETL loading process.
- Supports and assist QA Engineers in understanding, testing and troubleshooting.
- Written build scripts using ant and participated in the deployment of one or more production systems
- Production Rollout Support which includes monitoring the solution post go-live and resolving any issues that are discovered by the client and client services teams.
- Designed, documented operational problems by following standards and procedures using a software reporting tool JIRA.
Environment: Apache Hadoop, Java (jdk1.6), Flat files, Oracle 11g/10g, MySQL, Windows NT, UNIX, Sqoop, Hive,Oozie,Hbase.
Confidential, Vienna, VA
Java J2EE Developer
Responsibilities:
- Coded the business methods according to the IBM Rational Rose UML model.
- Extensively used Core Java, Servlets, JSP and XML.
- Used Struts 1.2 in presentation tier.
- Generated the Hibernate XML and Java Mappings for the schemas.
- Used DB2 Database to store the system data.
- Used Rational Application Developer (RAD) as Integrated Development Environment (IDE).
- Used unit testing for all the components using JUnit.
- Used Apache log 4j Logging framework for logging of trace and Auditing.
- Used Asynchronous JavaScript and XML (AJAX) for better and faster interactive Front-End.
- Used IBM Web-Sphere as the Application Server.
- Used IBM Rational Clearcase as the version controller.
Environment: Java 1.6, Servlets, JSP, Struts1.2, IBM Rational Application Developer (RAD) 6, Websphere 6.0, iText, AJAX, Rational Rose, Oracle 9i, log4j.
Confidential, Huston,TX
Java Developer
Responsibilities:
- Prepared the sequence and class diagrams.
- Designed Database schema in Oracle and normalized them.
- Prepared Functional Design and Technical Design Documents.
- Developed stateless session EJBs for encapsulating the business logic.
- Developed MDBs for asynchronous messaging.
- Used JSPs on front end, Servlets as Front Controllers and JavaScript for client side validations.
- Designed and developed the application using design patterns such as Singleton.
- Worked extensively with collections, including implementing the use of maps, keys, sets, and linked lists.
- Developed Ant scripts for the build and deploy of application in different environments.
- Involved in application migration from Weblogic 7.0 to 8.1.
- Used XML Beans for the xml data parsing.
- XML messages were used to communicate between web services that are written using SOAP and WSDLJMS destinations were queue deployed on IBM MQ series 5.0.
- Used Hibernate as ORM tool for the re-modeling of DB schema.
- Involved in the development of web services and writing shell scripts for server on UNIX.
- Involved in writing JUnit test cases for test driven development.
- Implemented JMS for making asynchronous requests.
Environment: JEE5(Java 5), Eclipse, Weblogic Application server 8.1, Clear Case, Clear Quest, Design Patterns (MVC, Delegate, DAO, Data Transfer Object, Singleton, Service Locator), EJB (Session Bean)
Confidential, Jersey City, NJ
Java Developer
Responsibilities:
- Responsible for the Analysis, Documentation of the requirements & architecting the application based on J2EE standards.
- Strictly Followed Test Driven Development.
- Implemented different Design patterns like Factory, Singleton Pattern and MVC architectural design patterns.
- Interacted with the client in design and code review meetings.
- Created Web Services for Remote calling using SOAP
- Used Fusion-Jira for tracking the user stories.
- Used Crucible Review Tool for code review meetings.
- Extensively involved in the Pair Programming Methodology to increase the quality of code by two fold.
- Responsible for secure batch data flow to downstream systems using Middleware Java technologies.
- Participated in Daily Scrum Meetings and Sprint Retrospective and sprint planning for on time delivery of Business Needs.
- Extensively Worked with Eclipse as the IDE to develop, test the complete application.
- Involved in development of Web Services using JAX-WS
- Development of JPA Entities and Hibernate DAO for data fetching for batch and front-end processing.
- Front end screens development using JSF (Prime Faces 3.5.1), JQuery, Ajax, JavaScript and CSS.
- Designed and developed the new features in the existing application to meet the customer's satisfaction.
- Designed and developed the user interface screens, database design changes and changes to user access modules.
- Used parsers like SAX and DOM for parsing xml documents and used XML transformations using XSLT.
- Developed persistent classes, including association, inheritance, polymorphism, composition and the Java collections framework.
- Involved in the JMS Connection Pool and the implementation of publish and subscribe using Spring JMS. Used JMS Template to publish and Message Driven POJO (MDP) to subscribe from the JMS provider
- Active participation in WebLogic server and Oracle problems (killing instances, debugging server logs, applications logs) using Firebug.
- Written SQL queries, stored procedures modifications, local database changes and used Toad for Testing Environment for existing database structure as required per addition of new features.
- Extensively developed supporting Enterprise Java Beans.
- Involved in Code Refactoring and Implementing Solid Principles (Object Oriented Design)
- Client side validations and server side validations are done according to the business needs.
- Written test cases using JUnit4 (Mockito API) for unit testing the application.
- Building application and deployment in servers as per request from the QA team using Maven 2.2.1.
- Participated in User Acceptance Testing and issue resolution
- Production implantation and post production support.
Environment: JDK 1.5, Seam-EJB3 Framework, Maven 2.2.1, JSF (Prime Faces 3.5.1), Ajax, JQuery, JavaScript, HSQL, Hibernate 3.0, Toad, JBOSS 5.1.2, XML, JAX-WS, JUnit-4 (Mockito API), Web Services (SOAP-UI Pro-4.6.2, RestFul), JMS, Eclipse, OO Design Patterns, Agile Methodology, Test Driven Development (TDD)