Sr. Hadoop Developer Resume
Lyndhurst, NJ
PROFESSIONAL SUMMARY:
- Over Eight years of professional IT experience in requirement gathering, design, development, testing, implementation and maintenance. Progressive experience in all phases of the iterative Software Development Life Cycle (SDLC)
- Good Knowledge on Hadoop Cluster architecture and monitoring the cluster.
- Excellent understanding / knowledge of Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, NameNode, Data Node and MapReduce programming paradigm.
- Hands on experience in installing, configuring, and using Hadoop ecosystem components like Hadoop MapReduce, HDFS, HBase, Hive, Sqoop, Pig, Zookeeper and Flume.
- Good Exposure on Apache Hadoop Map Reduce programming, PIG Scripting and Distribute Application and HDFS.
- In - depth understanding of Data Structure and Algorithms.
- Experience in managing and reviewing Hadoop log files.
- Excellent understanding and knowledge of NOSQL databases like HBase, Cassandra.
- Experience in implementing in setting up standards and processes for Hadoop based application design and implementation.
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice versa.
- Experience in Object Oriented Analysis, Design (OOAD) and development of software using UML Methodology, good knowledge of J2EE design patterns and Core Java design patterns.
- Experience in coordinating .NET application development from onsite. Version control using TFS and code publish/build to QA and Production environments using MS Visual Studio.
- Experience in managing Hadoop clusters using Cloudera Manager tool
- Implemented workflows in Oozie using Sqoop, MapReduce, Hive and other Java and Shell actions.
- Excellent knowledge of Data Flow Lifecycle and implementing transformations and analytic solutions.
- Extending Hive and Pig core functionality by writing Custom UDFs.
- Expertise in creating Custom Serdes in Hive.
- Excellent knowledge in NoSQL databases like HBase, Cassandra and MongoDB.
- Expertise in implementing Data-Mining techniques like social network analysis and sentiment analysis.
- Good Knowledge in importing/exporting data into R objects to other formats and Text-Mining with R.
- Working knowledge in Data Warehousing with ETL tools like IBM - DB2 Warehouse Edition.
- Extensively worked on Database Applications using DB2, Oracle, MySQL, PL/SQL.
- Hands on experience in application development using Java, RDBMS.
- Strong experience as a senior Java Developer in Web/intranet, Client/Server technologies using Java, J2EE, Servlets, JSP, EJB, JDBC.
- Expertise in implementing Database projects which includes Analysis, Design, Development, Testing and Implementation of end-to-end IT solutions.
- Worked on End-To-End implementation with Data warehousing team and Strong understanding of Data Warehousing concepts and exposure to Data Modeling, Normalization and Business Process Analysis.
- Experience in Object Oriented Analysis, Design (OOAD) and development of software using UML Methodology, good knowledge of J2EE design patterns and Core Java design patterns.
- Excellent working knowledge of popular frameworks like Struts, Hibernate, and Spring MVC.
- Experience in Agile Engineering practices. Excellent interpersonal and communication skills, creative, research-minded, technically competent and result-oriented with problem solving and leadership skills.
TECHNICAL SKILLS:
Ecosystem: Big Data HDFS, HBase, Impala, Hadoop MapReduce, Zookeeper, Hive, Pig, Sqoop, Flume, Oozie, Cassandra.
Data Bases Oracle: (SQL & PL/SQL), Sybase ASE 12.5, DB2, MS SQL Server, MySQL
Programming Languages: and Scripting SQL, PL/SQL, C, C++, PHP, Python, Core Java, JavaScript, Shell ScriptHTML, XML, AJAX, SOAP, ODBC, JDBC, Java Beans, EJB, MVC, JSP, Servlets, Java Mail, Struts, Junit Frameworks MVC, Spring, Struts, Hibernate, .NET
Configuration Management Tools: TFS, CVS IDE / Testing Tools Eclipse. Data warehousing and NoSQL Databases Netezza, Hbase.
Methodologies Agile, V-model : Operating System Windows, UNIX, Linux
Software Products: Putty, Eclipse, Toad 9.1, DB Visualizer, Comptel's AMD 6.0.3 & 4.0.3, InterConnecT v7.1 & 6.0.7, MS Project 2003, HP Quality Center, MS Management studio, MS SharePoint
PROFESSIONAL WORK EXPERIENCE:
Sr. Hadoop Developer
ConfidentialLyndhurst, NJ
Responsibilities:
- Involvement in design, development and testing phases of Software Development Life Cycle.
- Involved in setting up the Hadoop cluster along with Hadoop Administrator.
- Installed and configured Hadoop Ecosystem components.
- Responsible for requirements gathering and performing real time analytics on the incoming data.
- Created a realtime log grepper using Elasticsearch and Kibana.
- Imported the data from Oracle source and populated it into HDFS using Sqoop.
- Developed a data pipeline using Kafka and Storm to store data into HDFS.
- Automated the process for extraction of data from warehouses and weblogs by developing work - flows and coordinator jobs in OOZIE.
- Performed transformations like event joins, filter bot traffic and some pre-aggregations using Pig.
- Developed MapReduce jobs to Convert data files into Parquet file format.
- Included MRUnit to test the correctness of MapReduce programs.
- Executed Hive queries on Parquet tables to perform data analysis to meet the business requirements.
- Implemented a POC with Spark SQL to interpret complex Json records.
- Created table definition and made the contents available as a Schema-BackedRDD.
- Developed business specific Custom UDF's in Hive, Pig.
- Optimizing MapReduce code, pig scripts and performance tuning and analysis.
- Exported the aggregated data onto Oracle using Sqoop for reporting on the Tableau dashboard.
Environment: CDH, Eclipse, Centos Linux, HDFS, MapReduce, Kafka, Elasticsearch & Kibana, Storm, Parquet, Pig, Hive, Sqoop, Spark, Oracle, Oozie, RedHat Linux, Tableau
New York, NY
ConfidentialJava /J2EE Developer
Responsibilities:
- Analyzed Business Functionality and use cases and interacted with Users.
- Responsible for designing, coding and developing the application.
- The total application was developed in J2EE using MVC architecture.
- Developed the web tier components using JSP , Struts , JavaScript and Ajax.
- Developed and modified the Action classes and custom business classes.
- Configured the struts and tiles config files to create and modify the navigation.
- Used web service calls for exchanging data with the other applications.
- Developed and modified the stored procedures, the DAO and VO classes.
- Modified the Business Delegate and connector classes.
- Used CVS integrated with Web Sphere for version control.
- Created Unit test cases.
- Extensively participated in application integration testing.
- Analyzed and resolved the crucial production defects.
- Used Log4j for logging.
- Used Rational Clear Quest for Defect resolution.
New York, NY
ConfidentialJAVA Developer
Responsibilities:
- Involved in business requirements analysis.
- Built the application using Struts framework with JSP as view part.
- Developed Dispatch Actions, Action Forms and Custom taglibs in Struts framework.
- Designed JSP pages as view in Struts for frontend templates.
- Developed Session Beans for handling the back business requirements.
- Used the RSD IDE for development and Clear Case for the versioning.
- Involved in configuring the resources and administering the Web sphere application server 6.
- Built and deployed the application on Web sphere application server.
- Written stored procedures in DB2.
- Developed code to handle web requests involving Request Handlers, Business Objects, and Data Access
- Objects. Has coded different package structures based on the purpose and security issues handled by that particular package which assists developers in future enhancements or modifications of code.
- Involved in making the client side validations with JavaScript.
- Involved in code reviews, system integration and testing. Developed unit test cases using JUnit framework.
- Involved in deploying the application on UNIX (DEV, QA and Prod Environments) box.
- Used Change management tool Service Center for promoting the War file from one environment to other.
- Involved in user acceptance testing, fixing bugs and Production support.
Environment: Java Java, J2EE, Apache Struts, Websphere 5 & 6, JNDI, JDBC, JSP, UNIX and Windows NT, DB2 and SQL Server.
Shelton, CT
ConfidentialJAVA Developer
Responsibilities:
- As Team member I involved mainly in implementation and customization of tasks related to module
- Creating of the database tables, writing the queries and stored procedures.
- Coding Java, JSP, and Servlets using the extended Contata Struts framework.
- Used JNI for calling the libraries and other implemented functionality in C language.
- Involved in writing the programs for the XA transaction management on multiple databases of the application.
- Writing stored procedures & functions (TSQL equal to PL/SQL) in the Sql server DB.
- Used the Stax API / JAXP to read / manipulate the xml properties files.
- Review, Deploying.
- Junit Testing.
Environment: Java, Extended Sturs Framework, JSP, Servlets, SQL, LDAP, Sql Server 2000, JBoss Server 4.0, Eclipse, Ant, CVS, Windows NT and Unix.