Hadoop Developer Resume
Chicago, IL
SUMMARY
- 7 Years of extensive experience in IT including two years of Big Data Ecosystem related technologies.
- Experience in installation, configuration, management and deployment of Big Data solutions and the underlying infrastructure of Hadoop Cluster.
- Good understanding/knowledge of Hadoop Architecture.
- Hands - on experience on major components in Hadoop Ecosystem including Hive, HBase, HBase-Hive Integration, PIG, Sqoop, Flume and knowledge of Mapper/Reduce/HDFS Frame work.
- Set up standards and processes for Hadoop based application design and implementation.
- Experience in analyzing data using HIVEQL, PIG Latin and custom MapReduce programs in JAVA. Extending HIVE and PIG core functionality by using custom UDF’s.
- Good experience in analysis using PIG and HIVE and understanding of SQOOP.
- Experienced in developing MapReduce programs using Apache Hadoop for working with Big Data.
- Experience in Designing, developing and implementing connectivity products that allow efficient exchange of data between our core database engine and Hadoop ecosystem.
- Worked on NoSQL databases including HBase.
- Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
- Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
- Diverse experience utilizing Java tools in business, Web, and client-server environments including Java Platform, J2EE, EJB, JSP, Java Servlets, Struts, and Java database Connectivity (JDBC) technologies.
- Solid background in Object-Oriented analysis (OOAD) and design. Very good at various Design Patterns, UML and Enterprise Application Integration EAI.
- Major strengths are familiarity with multiple software systems, ability to learn quickly new technologies, adapt to new environments, self-motivated, team player, focused adaptive and quick learner with excellent interpersonal, technical and communication skills.
- Good communication skills, work ethics and the ability to work in a team efficiently with good leadership skills.
TECHNICAL SKILLS
Big data/Hadoop: HDFS, Map Reduce, HIVE, PIG, HBase, Sqoop, Flume, Oozie.
Java Technologies: Core Java, I8N, JFC, Swing, Beans, Log4j, Reflection.
J2EE Technologies: Servlets, JSP, JDBC, JNDI, Java Beans.
Methodologies: Agile, UML, Design Patterns (Core Java and J2EE).
Monitoring and Reporting: Ganglia, Nagios, Custom Shell scripts.
Frameworks: MVC, Struts, Hibernate, Spring.
Programming Languages: C,C++, Java, Python, Ant scripts, Linux shell scripts.
Database: Oracle 11g/10g/9i, MySQL, DB2, MS-SQL Server.
Web Servers: WebLogic, WebSphere, Apache Tomcat.
Web Technologies: HTML, XML, JavaScript, AJAX, SOAP, WSDL.
Network Protocols: TCP/IP, UDP, HTTP, DNS, DHCP.
PROFESSIONAL EXPERIENCE
Confidential, CHICAGO, IL
Hadoop Developer
Responsibilities:
- Installed/Configured/Maintained Apache Hadoop clusters for application development and Hadoop tools like Hive, Pig, HBase, Zookeeper and Sqoop.
- Wrote the shell scripts to monitor the health check of Hadoop daemon services and respond accordingly to any warning or failure conditions.
- Managing and scheduling Jobs on a Hadoop cluster.
- Deployed Hadoop Cluster in the following modes.
- Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS
- Developed the Pig UDF’S to pre-process the data for analysis
- Develop Hive queries for the analysts
- Developed workflow in Oozie to automate the tasks of loading the data into HDFS and pre-processing with Pig.
- Cluster co-ordination services through ZooKeeper.
- Collected the logs data from web servers and integrated in to HDFS using Flume.
- Implemented Fair schedulers on the Job tracker to share the resources of the Cluster for the Map Reduce jobs given by the users.
- Managed and reviewed Hadoop log files
Environment: Hadoop, Hbase, HDFS, Hive, Java (jdk1.6), Pig, Zookeeper, Oozie, Flume.
Confidential, CHICAGO, IL
Hadoop developer
Responsibilities:
- Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.
- Installed and configured Hadoop Map Reduce, HDFS, Developed multiple map reduce jobs in java for data cleaning and preprocessing.
- Worked on analyzing Hadoop stack and different big data analytic tools including Pig and Hive, Hbase database and Sqoop.
- Worked on Hive for exposing data for further analysis and for generating transforming files from different analytical formats to text files.
- Involved in loading data from UNIX file system to HDFS.
- Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
Environment: Hadoop, HDFS, Hive, Pig, Sqoop, Hbase, Java (jdk1.6), UNIX.
Confidential, Los Angeles, CA
Hadoop/ Java Developer
Responsibilities:
- Worked extensively in creating MapReduce jobs to power data for search and aggregation
- Designed a data warehouse using Hive
- Worked extensively with Sqoop for importing metadata from Oracle
- Extensively used Pig for data cleansing
- Created partitioned tables in Hive
- Worked with business teams and created Hive queries for ad hoc access.
- Evaluated usage of Oozie for Workflow Orchestration
- Mentored analyst and test team for writing Hive Queries
- Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.
Environment: Hadoop, MapReduce, HDFS, Hive, Java (jdk1.6), Hadoop distribution of Hortonworks, Oozie, Oracle 11g/10g.
Confidential, White Plains, NY
Sr.J2EE Developer
Responsibilities:
- EJB (Session Beans and Entity Beans) on Web sphere Studio Application Developer.
- Used different Design patterns, like MVC, EJBs Session facade, Controller Servlets, while implementing the Framework.
- Front End was built using JSPs, Servlets, JavaScript and HTML.
- Built Custom Tags for JSPs.
- Built the report module on reports based from Crystal reports.
- Integrating data from multiple data sources.
- Generating schema difference reports for database using toad.
- Built Prototypes for internationalization.
- Wrote Stored Procedures in DB2.
Environment: J2EE (JSP’s, Servlets, EJB), HTML, Struts, DB2.
Confidential, Atlanta, GA
Sr. J2EE Developer
Responsibilities:
- Coded end to end (i.e. from GUI on Client side to Middleware to database and Connecting the back end Systems) on a subset of sub modules belonging to the above modules.
- Worked extensively on Swing.
- Most of the business logic is provided in Session Beans and the database transactions are performed using Container Managed Entity Beans.
- Worked on Parsing of XML Using DOM and SAX.
- Implemented EJB Transactions.
- Used JMS for messaging with IBM MQ-Series.
- Written stored procedures.
- Developed the Presentation layer, which was built using Servlets and JSP and MVC architecture on Web sphere Studio Application Developer (WSAD).
- Mentoring other programmers.
- Studied the implementation of Struts
- Implemented the Security Access Control both on client and Server side. Applet signing including Jar signing,
Environment: Java, Java Swing JSP, Servlets, JDBC, Applets, Servlets, JCE 1.2, RMI, EJB, XML/XSL, Visual Age java (VAJ), Visual C++.
Confidential
Java developer
Responsibilities:
- Implemented the project according to the Software Development Life Cycle (SDLC).
- Implemented JDBC for mapping an object-oriented domain model to a traditional relational database.
- Created Stored Procedures to manipulate the database and to apply the business logic according to the user’s specifications.
- Developed the Generic Classes, which includes the frequently used functionality, so that it can be reusable.
- Exception Management mechanism using Exception Handling Application Blocks to handle the exceptions.
- Designed and developed user interfaces using JSP, Java script and HTML.
- Involved in Database design and developing SQL Queries, stored procedures on MySQL.
- Used CVS for maintaining the Source Code.
- Logging was done through log4j.
Environment: JAVA, Java Script, HTML, JDBC Drivers, Soap Web Services, Unix, Shell scripting, SQL Server.
Confidential
Jr Java developer
Responsibilities:
- Developed JavaScript behavior code for user interaction.
- Used HTML, JavaScript, and JSP and developed UI
- Used JDBC and managed connectivity, for inserting/querying& data management including stored procedures and triggers.
- Involved in the design and coding of the data capture templates, presentation and component templates.
- Developed an API to write XML documents from database.
- Used JavaScript and designed user-interface and checking validations.
- Part of a team which is responsible for metadata maintenance and synchronization of data from database.
Environment: Java script, JSP, JDBC, HTML, XML.