Hadoop Developer Resume
Mason, OH
PROFESSIONAL SUMMARY:
- 8 years of IT experience in Big Data/Hadoop and Java/J2EE technologies.
- Worked in different domains like Retail, Entertainment, Media, Confidential
- Excellent understanding of Hadoop architecture and underlying framework including storage management.
- Experience in using various Hadoop Ecosystems such as HDFS, MapReduce, Pig, Hive, Sqoop, Flume and Oozie for data storage and analysis.
- Experience in developing custom UDF's for Pig and Hive.
- Collection of logs data from various sources and integrated in to HDFS using Flume.
- Experience in using Oozie for coordinating the cluster and scheduling workflows.
- Excellent understanding on Multinode Cluster Configurations.
- Excellent experience in extracting source data from text files, JSON files and transforming and loading them into HDFS.
- Good knowledge in HBASE.
- Good experience in NoSQL database called Mark Logic.
- Good experience in developing Java Web Applications using Spring2.x and Struts 1.x.
- Experience in developing and consuming Java REST web services and Apache Web services.
- Good UI knowledge with experience in JQuery, JavaScript, HTML and CSS.
- Good knowledge and experience in AJAX framework.
- Developed XML based applications using XML, XQuery, XSD, XSLT, JAXP (DOM, SAX), and JAXB.
- Sound knowledge in Digital Asset Management tool called Media Beacon.
- Good knowledge in Java architecture and developing the applications using Java/J2EE design Patterns such as MVC, Singleton, Front Controller and Data Access Objects.
- Excellent understanding of Software Development Life Cycle (SDLC) methodologies like Agile, Scrum, and SDLC.
- Thorough knowledge of Business Processes, Project Implementation Strategies, Software Methodologies, Project Life Cycle Management, and Quality Standards.
- Worked in all phases of Web Application development lifecycle, from gathering requirements to design, implementation, testing and support.
- Proficiency in developing applications using Oracle and SQL Server 2008 as backend databases.
- Good knowledge in Hibernate.
- Experience in building scripts using Ant.
- Experience in TSQL, Stored Procedures with SQL Server
- Expertise in Unit testing and Module testing using JUnit.
- Expertise in Log4j framework for logging errors, messages and performance logs..
- Basic knowledge in creating SQL Server SSIS packages.
- Basic knowledge in Jasper Reports.
- Experience in analyzing Functional requirements, designing UML, Use Case and Class Diagrams using Microsoft Visio.
- Excellent technical ability, team leading capabilities, good communication, analytical and problem solving skills and hardworking attitude, flexible working individual or in a team environments
PROFESSIONAL EXPERIENCE:
Confidential, Mason OH
Hadoop Developer
Responsibilities:
- Developed Simple to complex Map/reduce Jobs using Hive and Pig.
- Handled importing of data from various data sources, performed transformations using Hive, MapReduce, and loaded data into HDFS.
- Worked on UDF’s and Joins in Hive to give required data for other teams for business analysis.
- Used Partitions and Buckets to create external tables in Hive for efficient data access.
- Used Java Map Reduce programs for cleansing the data before loading them into HDFS.
- Imported the data from HDFS to SQL Server using Sqoop for visualization and generate reports for the BI team.
- Collected logs data from various sources and integrated in to HDFS using Flume.
- Written Pig jobs to parse the logs and structure them in required file format to facilitate effective querying on the log data.
- Worked on Pig UDF’s to produce required data.
- Worked on Oozie workflow engine to run multiple Hive and Pig jobs.
- Cluster coordination services through Zoo Keeper.
- Monitor System health and logs and respond accordingly to any warning or failure conditions.
- Created and maintained Technical documentation for launching HADOOP Clusters and for executing Hive queries and Pig Scripts.
- Interact and co - ordinate with external teams to resolve technical issues
- Co-ordinate with clients to ensure delivery on time
Environment: Hadoop, Map Reduce, HDFS, Hive, SQL Server 2008, HBase, Oozie, Java (jdk1.6), UNIX, SVN, ZooKeeper, Eclipse, WinSCP, Putty
Confidential, Dayton, OH
Senior Java, Mark Logic Developer
Responsibilities:
- Senior Java and Mark Logic Developer and helping other developers with technical and functional aspects of application.
- Responsible for developing the New Lexis Search service using Java, XQuery and XPath on top of Mark Logic Database.
- Worked on developing various internal tools related to Confidential Application using JQuery and XQuery
- Developed REST WebServices to make our Search service available to other systems of the application.
- Involved in fixing the defects both SIT and UAT for all the releases.
- Work with Confidential System Administrators/ Global Technology Integration Team to implement changes in Services in all Test Regions and Production.
Environment: Windows 7, JDK 1.6, J2EE, Eclipse 3.6, Jetty Server, MarkLogic 7.0, XQUERY, XSL, XPATH.
Confidential, Los Angeles, CA
Senior Java Developer
Responsibilities:
- Senior Java Developer and helped other developers with technical and functional aspects of application.
- Developed Core modules of GM AssetCentral system such as Collections and Confidential Collections using MediaBeacon, Signiant, Spring MVC framework, Spring JDBC and integrating with Digital Asset Management System using Ajax calls and Media Beacon plugins which are developed using Java.
- Developed Reporting Module of GM AssetCentral system using Spring MVC and Axis2 Web services.
- Also developed Migration process for migrating Production data to our Custom databases using SSIS packages of MS SQL 2008 r2 for pulling production data on a monthly basis.
- Involved in writing complex SQL queries related to Reporting module.
- Developed the view component using JSP, HTML, CSS and Java Script.
- Used Spring Inversion of Control (IOC) to inject services and their dependencies.
- Used Ant for build and deployment.
- Used Log4jfor logging errors, messages and performance logs.
- Involved in the configuration management and used version control using Tortoise SVN.
- Created several Exception classes to catch the error for a bug free environment and orderly logged the whole process, which gives the ability to pinpoint the errors.
- Also involved in writing JUnit test cases for the above modules.
- Involved in fixing the defects both SIT and UAT.
- Involved in code review and resolved P1, P2 and P3 issues based on Jcap Report.
Environment: Windows 7, JDK 1.6, J2EE,Eclipse 3.6, Spring MVC, Spring JDBC, Spring IOC, Axis2 Web services, Tomcat 6.0,SQL Server 2008,Toad, Visual Studio, SOAP UI,HTML, JSP, Java Script, JUnit and Log4j
Confidential
Java Developer
Responsibilities:
- Developed REST web services based on data coming in the form of feeds for all the modules using Stored Procedures.
- Developed Stored Procedures which are required for the web services.
- Consumed the REST web services in various modules to represent the back end data.
- Used Spring JDBC for the backend layer
- Also involved in the presentation layer by developing JSPs to display the retrieved results from web services.
- Used Java Script for front end validations.
- Used Log4jfor logging errors, messages and performance logs.
- Involved in fixing the defects both SIT and UAT.
Environment: Java, J2EE, Spring Framework, REST webservices, ORACLE 11g,Tomcat,SOAP UI, HTML, CSS, JavaScript, XML, Jersey API and JAXB
Confidential
Java Developer
Responsibilities:
- Involved in developing two modules TMP and TC using Struts 1.x framework.
- Developed the UI layer using JSPs and XSLT for both the modules.
- Performed validations using Struts validator framework.
- Used Struts tiles to achieve reusability among the view pages.
- Performed Unit Testing using JUnit.
- Involved in deployment using Maven.
- Performed code reviews and fixed all code review defects related to these two modules.
- Involved in fixing the defects both SIT and UAT.
Environment: Java, J2EE, Struts 1.x, WebSphere5.0, HTML, JavaScript, CSS, XML, XSLT
Confidential
Java Developer
Responsibilities:
- Involved in developing the application using Casper ( Confidential Internal) framework.
- Involved in developing the Dao layer using Hibernate.
- Developed the UI layer using JSPs
- Performed validations using Java Script.
- Performed Unit Testing using Junit.
- Worked on SQL queries required for the application.
- Performed code reviews and fixed the defects.
- Involved in fixing the defects both SIT and UAT.
Environment: Java, J2EE, Casper Framework, Oracle10g, Tomcat, HTML, JavaScript, CSS, Junit.
Confidential
Java Developer
Responsibilities:
- Involved in developing the backend layer using JDBC.
- Involved in developing the front end using JSP and Java Scripts
- Involved in writing the controllers using servlets.
- Involved in writing queries and stored procedures in Oracle.
Environment: Java, J2EE, Oracle10g, Tomcat, JavaScript, CSS, Junit.