We provide IT Staff Augmentation Services!

Hadoop Developer Resume

3.00/5 (Submit Your Rating)

Chicago, IL

SUMMARY

  • 7 Years of extensive experience in IT including two years of Big Data Ecosystem related technologies.
  • Experience in installation, configuration, management and deployment of Big Data solutions and the underlying infrastructure of Hadoop Cluster.
  • Good understanding/knowledge of Hadoop Architecture.
  • Hands - on experience on major components in Hadoop Ecosystem including Hive, HBase, HBase-Hive Integration, PIG, Sqoop, Flume and knowledge of Mapper/Reduce/HDFS Frame work.
  • Set up standards and processes for Hadoop based application design and implementation.
  • Experience in analyzing data using HIVEQL, PIG Latin and custom MapReduce programs in JAVA. Extending HIVE and PIG core functionality by using custom UDF’s.
  • Good experience in analysis using PIG and HIVE and understanding of SQOOP.
  • Experienced in developing MapReduce programs using Apache Hadoop for working with Big Data.
  • Experience in Designing, developing and implementing connectivity products that allow efficient exchange of data between our core database engine and Hadoop ecosystem.
  • Worked on NoSQL databases including HBase.
  • Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
  • Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
  • Diverse experience utilizing Java tools in business, Web, and client-server environments including Java Platform, J2EE, EJB, JSP, Java Servlets, Struts, and Java database Connectivity (JDBC) technologies.
  • Solid background in Object-Oriented analysis (OOAD) and design. Very good at various Design Patterns, UML and Enterprise Application Integration EAI.
  • Major strengths are familiarity with multiple software systems, ability to learn quickly new technologies, adapt to new environments, self-motivated, team player, focused adaptive and quick learner with excellent interpersonal, technical and communication skills.
  • Good communication skills, work ethics and the ability to work in a team efficiently with good leadership skills.

TECHNICAL SKILLS

Big data/Hadoop: HDFS, Map Reduce, HIVE, PIG, HBase, Sqoop, Flume, Oozie.

Java Technologies: Core Java, I8N, JFC, Swing, Beans, Log4j, Reflection.

J2EE Technologies: Servlets, JSP, JDBC, JNDI, Java Beans.

Methodologies: Agile, UML, Design Patterns (Core Java and J2EE).

Monitoring and Reporting: Ganglia, Nagios, Custom Shell scripts.

Frameworks: MVC, Struts, Hibernate, Spring.

Programming Languages: C,C++, Java, Python, Ant scripts, Linux shell scripts.

Database: Oracle 11g/10g/9i, MySQL, DB2, MS-SQL Server.

Web Servers: WebLogic, WebSphere, Apache Tomcat.

Web Technologies: HTML, XML, JavaScript, AJAX, SOAP, WSDL.

Network Protocols: TCP/IP, UDP, HTTP, DNS, DHCP.

PROFESSIONAL EXPERIENCE

Confidential, CHICAGO, IL

Hadoop Developer

Responsibilities:

  • Installed/Configured/Maintained Apache Hadoop clusters for application development and Hadoop tools like Hive, Pig, HBase, Zookeeper and Sqoop.
  • Wrote the shell scripts to monitor the health check of Hadoop daemon services and respond accordingly to any warning or failure conditions.
  • Managing and scheduling Jobs on a Hadoop cluster.
  • Deployed Hadoop Cluster in the following modes.
  • Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS
  • Developed the Pig UDF’S to pre-process the data for analysis
  • Develop Hive queries for the analysts
  • Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing with Pig.
  • Cluster co-ordination services through ZooKeeper.
  • Collected the logs data from web servers and integrated in to HDFS using Flume.
  • Implemented Fair schedulers on the Job tracker to share the resources of the Cluster for the Map Reduce jobs given by the users.
  • Managed and reviewed Hadoop log files

Environment: Hadoop, Hbase, HDFS, Hive, Java (jdk1.6), Pig, Zookeeper, Oozie, Flume.

Confidential, CHICAGO, IL

Hadoop developer

Responsibilities:

  • Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.
  • Installed and configured Hadoop Map Reduce, HDFS, Developed multiple map reduce jobs in java for data cleaning and preprocessing.
  • Worked on analyzing Hadoop stack and different big data analytic tools including Pig and Hive, Hbase database and Sqoop.
  • Worked on Hive for exposing data for further analysis and for generating transforming files from different analytical formats to text files.
  • Involved in loading data from UNIX file system to HDFS.
  • Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.

Environment: Hadoop, HDFS, Hive, Pig, Sqoop, Hbase, Java (jdk1.6), UNIX.

Confidential, Los Angeles, CA

Hadoop/ Java Developer

Responsibilities:

  • Worked extensively in creating MapReduce jobs to power data for search and aggregation
  • Designed a data warehouse using Hive
  • Worked extensively with Sqoop for importing metadata from Oracle
  • Extensively used Pig for data cleansing
  • Created partitioned tables in Hive
  • Worked with business teams and created Hive queries for ad hoc access.
  • Evaluated usage of Oozie for Workflow Orchestration
  • Mentored analyst and test team for writing Hive Queries
  • Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.

Environment: Hadoop, MapReduce, HDFS, Hive, Java (jdk1.6), Hadoop distribution of Hortonworks, Oozie, Oracle 11g/10g.

Confidential, White Plains, NY

Sr.J2EE Developer

Responsibilities:

  • EJB (Session Beans and Entity Beans) on Web sphere Studio Application Developer.
  • Used different Design patterns, like MVC, EJBs Session facade, Controller Servlets, while implementing the Framework.
  • Front End was built using JSPs, Servlets, JavaScript and HTML.
  • Built Custom Tags for JSPs.
  • Built the report module on reports based from Crystal reports.
  • Integrating data from multiple data sources.
  • Generating schema difference reports for database using toad.
  • Built Prototypes for internationalization.
  • Wrote Stored Procedures in DB2.

Environment: J2EE (JSP’s, Servlets, EJB), HTML, Struts, DB2.

Confidential, Atlanta, GA

Sr. J2EE Developer

Responsibilities:

  • Coded end to end (i.e. from GUI on Client side to Middleware to database and Connecting the back end Systems) on a subset of sub modules belonging to the above modules.
  • Worked extensively on Swing.
  • Most of the business logic is provided in Session Beans and the database transactions are performed using Container Managed Entity Beans.
  • Worked on Parsing of XML Using DOM and SAX.
  • Implemented EJB Transactions.
  • Used JMS for messaging with IBM MQ-Series.
  • Written stored procedures.
  • Developed the Presentation layer, which was built using Servlets and JSP and MVC architecture on Web sphere Studio Application Developer (WSAD).
  • Mentoring other programmers.
  • Studied the implementation of Struts
  • Implemented the Security Access Control both on client and Server side. Applet signing including Jar signing,

Environment: Java, Java Swing JSP, Servlets, JDBC, Applets, Servlets, JCE 1.2, RMI, EJB, XML/XSL, Visual Age java (VAJ), Visual C++.

Confidential

Java developer

Responsibilities:

  • Implemented the project according to the Software Development Life Cycle (SDLC).
  • Implemented JDBC for mapping an object-oriented domain model to a traditional relational database.
  • Created Stored Procedures to manipulate the database and to apply the business logic according to the user’s specifications.
  • Developed the Generic Classes, which includes the frequently used functionality, so that it can be reusable.
  • Exception Management mechanism using Exception Handling Application Blocks to handle the exceptions.
  • Designed and developed user interfaces using JSP, Java script and HTML.
  • Involved in Database design and developing SQL Queries, stored procedures on MySQL.
  • Used CVS for maintaining the Source Code.
  • Logging was done through log4j.

Environment: JAVA, Java Script, HTML, JDBC Drivers, Soap Web Services, Unix, Shell scripting, SQL Server.

Confidential

Jr Java developer

Responsibilities:

  • Developed JavaScript behavior code for user interaction.
  • Used HTML, JavaScript, and JSP and developed UI
  • Used JDBC and managed connectivity, for inserting/querying& data management including stored procedures and triggers.
  • Involved in the design and coding of the data capture templates, presentation and component templates.
  • Developed an API to write XML documents from database.
  • Used JavaScript and designed user-interface and checking validations.
  • Part of a team which is responsible for metadata maintenance and synchronization of data from database.

Environment: Java script, JSP, JDBC, HTML, XML.

We'd love your feedback!