Hadoop Developer Resume
PROFESSIONAL EXPERIENCE
- SUN Certified Java Programmer with 11 years of IT experience covering teh complete software development life cycle for different cases by designing, developing, integrating and testing applications in J2EE Environment.
- Over 3+ years of experience in Hadoop ecosystem's implementation, maintenance and Big Data analysis operations.
- Strong knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts.
- Experience in using various Hadoop infrastructures such as Map Reduce, Pig, Hive, Zookeeper, Sqoop, Oozie for data storage and analysis.
- Have knowledge on IBM SPSS analytical tool.
- Experience in using NOSQL DB like Hbase.
- Experiences in analyzing data using Hive QL and custom Map Reduce programs in Java.
- Experiences in writing UDF,UDAF in Hive to analyze data.
- Experience in Collecting log data from various sources and integrating into HDFS using SQOOP and developing custom UDFs for Hive.
- Experience in handling/processing GB of data per day.
- Experience in designing both time driven and data driven automated workflows using Oozie.
- Experience in designing low latency and high throughput application using HBASE,
- Having good understanding of HBASE rowkey, columnfamiliy, storage structure.
- Strong experience in cutting edge technologies like JSP, Servlet, EJB, Struts, Spring, iBatis, ext - js and Oracle, with deployment using jBoss Application/Tomcat server/Web Sphere.
- Experience of developing applications using J2EE Design patterns (ex: MVC, Value Object, Object (DAO), Data Transfer Object (DTO), Business Delegate, Session Facade, Service Locator etc.).
- Extensively used JDBC Statement, Prepared Statement, Callable Statement and Result Set interfaces while providing database interaction with teh RDBMS backend.
- Good exposure to Struts, Spring, i-Batis, Ext-js framework and Windows/Linux operating system.
- Extensively used tools such as PL/SQL developer, TOAD for programming of SQL, PL/SQL. Experience with databases including Oracle, SQL Server
- Hands-on experience in IDE Tools: Eclipse, Intellij Idea, RAD.
- Experience in Version management tools like CVS.
- Proven track record of multiple project implementations as Individual Contributor, Senior Software Engineer and Onsite Coordinator.
- Active team player and a self-starter, capable of working independently and motivate a team of professionals
- Onsite for UAT in countries Philippines, Malaysia, Indonesia and for Product Training in Switzerland.
TECHNICAL SKILLS:
Technology/Programming Languages: Java - J2EETechnology/Language Details JSP, Servlet, JDBC, EJB, Javascript, XML, HTML, PL/SQL
Frameworks: Struts, Spring (IoC, DAO), i-Batis, ext-js
Databases: Oracle 9i, SQL Server
Operating Systems: Windows, Linux, Solaris
Web/Application Servers: Tomcat/jBoss/Web Sphere
Tools/Packages: Eclipse/IntelliJ IDEA IDEA, CVS/VSS (version management), JUnit (Testing tool, TOAD, Bugzilla
Domain/Functional Area: e-Learning, Telecom, Finance
Hadoop Ecosystem: HDFS, Hive, SQOOP, Pig. NOSQL HBase, OOZIE
Analytical Tool: IBM SPSS
PROFESSIONAL EXPERIENCE:
Confidential
HADOOP Developer
Responsibilities:
- Involved in ETL, Data Integration and Migration. Imported data using Sqoop to load data from Oracle to HDFS on regular basis.
- Developing Scripts and Batch Job to schedule various Hadoop Program.
- Written Hive queries for data analysis to meet teh business requirements.
- Creating Hive tables and working on them using Hive QL. Importing and exporting data into HDFS from Oracle Database and vice versa using Sqoop.
- Implemented test scripts to support test driven development and continuous integration.
- Responsible to manage data coming from different sources.
- Prepared Hive scripts to covert TD SP to HQL similar
- Prepared Autosys/oozie jobs and dependencies.
- Prepared Validation HQL to compare teh data.
Confidential
Senior Java/HADOOP SR Developer
Responsibilities:
- Developed and configured Hadoop Mapreduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
- Have solid understanding of REST architecture style and its application to well performing web sites for global usage.
- Involved in ETL, Data Integration and Migration. Imported data using Sqoop to load data from Oracle to HDFS on regular basis.
- Developing Scripts and Batch Job to schedule various Hadoop Program.
- Written Hive queries for data analysis to meet teh business requirements.
- Creating Hive tables and working on them using Hive QL. Importing and exporting data into HDFS from Oracle Database and vice versa using Sqoop.
- Implemented test scripts to support test driven development and continuous integration.
- Responsible to manage data coming from different sources.
- Load and transform large sets of structured, semi structured and unstructured data.
- Experience in managing and reviewing Hadoop log files.
- Worked on Hive for exposing data for further analysis and for generating transforming files from different analytical formats to text files.
- Managing and scheduling Jobs on a Hadoop cluster.
- Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
- Importing and exporting data into HDFS and Hive using Sqoop.
- Involved in creating Hive tables, loading with data and writing hive queries, which will run internally in map, reduce way.
- Written Hive queries for data analysis to meet teh business requirements.
- Involved in writing Hive scripts to extract, transform and load teh data into Database.
- Implemented low latency, high throughput application using NOSQL like HBASE. This involves retrieving specific duration data from millions of rows in milliseconds, design ROWKEY/table structure to support low latency.
- Implemented MAPPER to load and process teh data into HBASE storage, integrated with JAVA application to fetch data from HBASE storage.
- Used JIRA for bug tracking.
- Used CVS for version control.
- Involved in all teh phases of SDLC including Requirements Collection, Design & Analysis of teh Customer Specifications, Development and Customization of teh Application.
- Used JAVA, spring framework for teh application.
- Solution mapping, designing and effort estimation.
- Used Log4J2 for generating teh logs.
- Maintaining teh document's like Technical Design, release notes etc.
- Writing code in fix for production/UAT issues.
- Writing queries, functions, and procedures in PL/SQL.
- Preparing JUnit Test Cases, Unit testing, Integrated testing.
- Version control and patch preparation.
Confidential
Senior Java Developer
Responsibilities:
- Involved in all teh phases of SDLC including Requirements Collection, Design & Analysis of teh Customer Specifications, Development and Customization of teh Application.
- Used JAVA, Struts, i-Batis, Spring framework for teh application.
- Use of teh Spring Framework with Hibernate, i-Batis as ORM for teh application based on teh MVC design/pattern.
- Solution mapping, designing and effort estimation.
- Used Log4J for generating teh logs.
- Maintaining teh document's like Technical Design, release notes etc.
- Writing code in fix for production/UAT issues.
- Writing queries, functions, and procedures in PL/SQL.
- Preparing JUnit Test Cases, Unit testing, Integrated testing.
- Version control and patch preparation.
Confidential
Senior Java Developer
Responsibilities:
- Involved in all teh phases of SDLC including Requirements Collection, Design & Analysis of teh Customer Specifications, Development and Customization of teh Application.
- Used JAVA, Struts, Spring framework for teh application.
- Solution mapping, designing and effort estimation.
- Used Log4J for generating teh logs.
- Maintaining teh document's like Technical Design, release notes etc.
- Writing code in fix for production/UAT issues.
- Writing queries, functions, and procedures in PL/SQL.
- Preparing JUnit Test Cases, Unit testing, Integrated testing.
- Version control and patch preparation.
Confidential
Senior Developer, Module Lead (Java)
Responsibilities:
- Study, understand teh functional specifications and perform requirement gap analysis.
- Involved in analysis of teh specifications from teh client and actively participated in documentation.
- Analyzed and designed a scalable system which includes using, Object oriented concepts, OOAD and teh various J2EE design patterns. Developed JSP pages using Struts tag libraries.
- Solution mapping, designing and effort estimation.
- Maintaining teh document's like Technical Design, release notes etc.
- Writing code in JSP, Java and EJB and deployment in jBoss.
- Writing queries, functions, and procedures in PL/SQL.
- Customize existing report generation process.
- Preparing Test Cases, Unit testing, Integrated testing.
- Version control and patch preparation.
Confidential
Java Developer
Responsibilities:
- Solution mapping, designing and effort estimation.
- Writing code in JSP, Java using struts framework and deployment in Tomcat Server.
- Writing queries, function, and procedures in PL/SQL when required.
- Preparing Test Cases, Unit testing, Integrated testing.
Confidential
Java Developer
Responsibilities:
- Solution mapping, designing and effort estimation.
- Writing code in JSP, Java using struts framework in Tomcat.
- Writing queries, function, and procedures in PL/SQL when required.
- Preparing Test Cases, Unit testing, Integrated testing.
Confidential
Java Developer
Responsibilities:
- Writing Java code as per requirement.
- Preparing test cases.