PROFESSIONAL SUMMARY:

• Over 14 years of professional IT experience in Systems Design, Development, Testing, Integration, Documentation, and Implementation of Client/Server and web based n - tier architecture systems.
• Three years of experience working on Spark and Hadoop platform. Extensively used Spark, PIG, Hive.
• Hands on experience with the Spark and Hadoop stack (Scala, MapReduce, HDFS, Sqoop, Pig, Hive, HBase, Flume,Yarn, Oozie, Solr, Kafka, Apache Storm and Zookeeper),Cassandra, Amazon Web Services, Cloud.
• Experience in importing and exporting terabytes of data using Sqoop from HDFS to Relational Database Systems and vice-versa.
• Experienced with performing real time analytics on NoSQL databases like HBase.
• Worked with Oozie workflow engine to schedule time based jobs to perform multiple actions.
• Analyzed large amounts of data sets writing Pig scripts and Hive queries
• Experienced in writing MapReduce programs &UDFs for both Hive & Pig in Java
• Used Flume to channel data from different sources to HDFS.
• Worked on Cassandra, Amazon Web Services, Cloud.
• Supported MapReduce Programs running on the cluster and wrote custom Map Reduce Scripts for DataProcessing in Java.
• Experience in analyzing data using HIVEQL, PIG Latin and custom Map Reduce programs in JAVA. Extending Hive and PIG core Functionality by using custom User Defined Functions.
• Experience with Oozie Workflow Engine to automate and parallelize Hadoop Map/Reduce and Pig jobs.
• Experienced in all facets of Software Development Life Cycle using Waterfall and Agile methodologies.
• Design & development of web technologies using Websphere/RAD/WebLogic/Eclipse, Java, J2EE (EJB, Servlets, JSP, Struts, Hibernate, XML/HTML), RESTfull APIs, Spring Frameworks, Oracle Portal, Sun Portal.
• Complete SDLC (Software Development Life Cycle) experience ranging from requirement gathering, design, technical specification writing, test case design, coding, development, unit testing, Integration Testing, acceptance testing for a Fortune 18th Client Company standards

TECHNICAL SKILLS:

Databases: Oracle 10g, DB2, Teradata, MS Access

Tool: /Languages & Platform Spark,PIG, Hive, MapReduce, Apache Hadoop, HDFSKafka, Solr, ApacheStorm, Scala, RESTfullAPIs,SpringFlume, Oozie,Java, J2EE (EJB, Servlets, JSP, Struts, XML, SOAP Services), Websphere Application Server, IBM WSAD Ver 5, JavaScript, SQLLDAP, OOAD, UML, PL SQL, JDBC, XSLT, HTML,CSS, Stored Procedure, Web Services, WSDL, RAD, Struts, Hibernate, JSTL,RAD 7.5, Spring framework, JSF, Ajax, OC4J, Rational ClearCase, ClearQuest, PVCS, VSS, Oracle Portal, Sun Portal

Operating Systems/Server: Windows 2000, IBM WAS, UNIX, Solaris

PROFESSIONAL EXPERIENCE:

Confidential

Platform & Tools: Spark, PIG, Hive, MapReduce , Apache Hadoop, HDFS, Flume, OozieOracle 10g, Teradata, Intelli J, My Eclipse, Java, Kafka, SolrApache Storm, Spring Frameworks, HBase, ExtJsREST services, XML, SVN, SQL, JDBC, PL SQL, Unix, HP ALM

Responsibilities:

• Extensively used spark and scala for data transformation and filtration.
• Involved in full life cycle of the project from Design, Analysis, logical and physical architecture modeling, development, Implementation, testing.
• Analyzed the data by performing Hive queries and running Pig scripts to know customer behavior.
• Developed various Map Reduce job using Hive.
• Extensively used Pig for data cleansing.
• Developed Pig Latin scripts to extract the data from the output files to load into HDFS
• Developed the Pig UDF's to pre-process the data for analysis
• Written complex Hive and SQL queries for data analysis to meet business requirements.
• Expert in importing and exporting data into HDFS and Hive using Sqoop.
• Expert in writing HiveQL queries and Pig Latin scripts.
• Experience in importing and exporting terabytes of data using Sqoop from Relational Database Systems to HDFS.
• Experience in providing support to data analyst in running Pig and Hive queries
• Experience in developing customized Hive UDFs and UDAFs in Java, JDBC connectivity with hive development and execution of Pig scripts and Pig UDF's
• Provided design recommendations and thought leadership to sponsors/stakeholders that improved review processes and resolved technical problems.
• Managed and reviewed Hadoop log files.
• Shared responsibility for administration of Hadoop, Hive and Pig.
• Installed and configured Storm, Spark, Kafka, Flume, Sqoop, Pig, Hive, HBase on Hadoop clusters.
• Experience in using Sqoop to migrate data to and fro from HDFS and Oracle and deployed Hive and HBase integration to perform OLAP operations on HBase data.
• Used Flume in Loading log data into HDFS.
• Moving the data from Oracle and Teradata in to HDFS using Sqoop and importing various formats of flat files in to HDFS.
• Responsible for design and creation of Hive tables and worked on various performance optimizations like Partition, Bucketing in hive. Handled incremental data loads from RDBMS into HDFS using Sqoop.
• Used Oozie scheduler to automate the pipeline workflow and orchestrate the sqoop,hive and pig jobs that extract the data on a timely manner.
• Exported data from HDFS to RDBMS via Sqoop for Business Intelligence, visualization and user report generation.
• Extensively worked on PIG scripts data cleansing and optimization.
• Responsible for design and creation of Hive tables, partitioning, bucketing, loading data and writing hive queries.
• Importing and exporting data into HDFS, Hive and Hbase using Sqoop from Relational Database.
• Exported analyzed data to downstream systems using Sqoop for generating end-user reports and Business Analysis reports.

Confidential

Platform & Tools: Hibernate, Spring, Intelli J, My Eclipse, Java, REST services, XML, SVN, SQL, JDBC, PL SQL, Unix, HP ALM

Responsibilities:

• Some of the key responsibilities in this project were:
• Design and development/upgrade of the systems
• Developed interfaces to other systems
• Writing low level design documents
• High Level Design
• Coding and Unit testing
• Used Spring framework for MVC
• Use of Hibernate for persistence

Confidential

Senior Developer

Platform & Tools: RAD 7.5, WAS 6.1, OC4j,Java, HTML/JSP, Servlets, JSTL, JavaScript, Struts framework, Hibernate, XML, Junit, WebServices, Ant, Rational ClearQuest, PVCS, SQL, JDBC, PL SQL, Unix, Oracle Portal

Responsibilities:

• Some of the key responsibilities in this project were:
• Analysis of upgrade requirements for Portal
• Writing low level design documents
• High Level Design
• Coding and Unit testing
• Used Struts framework for MVC
• Use of Hibernate for persistence
• Where needed, creating sequence diagrams/class diagrams to make the design more detail.
• Reviewing the prototype code for the project and approving the architecture of the project.

Confidential, Alpharetta, GA

Senior Developer

Platform & Tools: Sun Java Enterprise Server.Eclipse, Sun Portal, WSAD, WAS 5, Java, HTML/JSP, JavaScript, AJAX, Servlets, Struts framework, Hibernate, XML, Junit, WebServices, SQL, CSS, JDBC, Unix, Ant, Rational Clearcase

Responsibilities:

• Some of the key responsibilities in this project were:
• Requirement gathering from business partners
• Analyzing the requirements and translating them to system requirement specifications.
• Translating business requirements to technical design
• Used Struts framework for MVC
• Use of Hibernate for persistence
• Estimating the efforts for the modules.
• Integrating Sun Portal to Web Application.
• Creating the initial architecture diagram of the system.
• Coding and Unit testing
• High Level Design
• Unit testing for the application using Junit.

Confidential, Northfield, IL

Senior Developer

Platform & Tools: WebLogic, Java, HTML/JSP, Servlets, Struts framework, Hibernate, XML, Junit, Ant, Stored Procedure, PL SQL,Rational Clearcase

Responsibilities:

• Some of the key responsibilities in this project were:
• Writing low level design documents
• Coding and Unit testing
• Used Struts framework for MVC
• Use of Hibernate for persistence
• Where needed, creating sequence diagrams/class diagrams to make the design more detail.
• Handling the change requests from customers.
• Unit testing for the application using Junit.
• Regression testing of the application before sending it for user acceptance testing.

Confidential, Peoria, IL

Senior Developer

Platform & Tools: J2EE/RAD (Struts, Hibernate), LDAP,Oracle 9i, SQL, Ant, log4j, Junit

Responsibilities:

• Requirement gathering from business partners
• Analyzing the requirements and translating them to system requirement specifications.
• Translating business requirements to technical design
• Estimating the efforts for the modules.
• Creating the initial architecture diagram of the system.
• Coding and Unit testing
• Used Struts framework for MVC
• Use of Hibernate for persistence
• Reviewing the design document.
• Where needed, creating sequence diagrams/class diagrams to make the design more detail.

Confidential

Platform & Tools: J2EE/WSAD, JSP, TUF framework, LDAP,Oracle 9i, SQL, Ant, log4j, Junit

Responsibilities:

• Requirement gathering from business partners
• Analyzing the requirements and translating them to system requirement specifications.
• Translating business requirements to technical design
• Estimating the efforts for the modules.
• Creating the initial architecture diagram of the system.
• Coding and Unit testing
• Reviewing the design document.
• Where needed, creating sequence diagrams/class diagrams to make the design more detail.
• Reviewing the prototype code for the project and approving the architecture of the project.
• Handling the change requests from customers.
• Unit testing for the application using Junit.
• Regression testing of the application before sending it for user acceptance testing.
• Review all the audit tool reports(e.g.: checkstyle, PMD, CPD, JavaNCSS, Jdepend etc)
• Refining the code to get all the audit tool reports under specified guidelines.
• Deploying the application to test server and QA server.

Confidential, Bloomington, IL

System Analyst

Platform & Tools J2EE/Websphere (JSP, HTML, Servlets, EJB), Struts, IBM WSAD Ver 5, JNDI, JDBC, XML, SOAP, LDAP,DB2, SQL, Ant, log4j, WSDL, Junit

Responsibilities:

• Requirement gathering from business partners
• Translating business requirements to technical design
• Web side development using JSP/HTML/Java beans
• Used Struts framework for MVC
• Test servlets to access beans/EJBs and building stored procedures in DB2
• Configuration, deployment of JAR/WAR/EAR files
• Server side development of EJBs (EJB 2.0 including MDBs), JMS
• Coding Data Access Object.