Hadoop Developer Resume
SUMMARY
- Having 8+yrs hands on experience in Data Profiling, Big Data Analysis, R - Programming, Core Java development, Hadoop framework and big data processing, RDBMS database Design & Analysis.
- Experience in data mining extremely large data sets, high proficiency in SQL-Oracle, MySQL, MS SQL server 2012 relational database systems and design.
- Good experience in SQL complex queries, optimization and query tuning.
- Experience in complex reports and dashboard, score card development and big data connectivity using tableau.
- Efficient knowledge and experience in MS-Excel data analysis report creation.
- Good Object Oriented Analysis and Design (OOAD), Data Ware housing and Data modelling.
- Knowledge in Hadoop Framework, Map Reduce, Hive, Pig and R Programming etc.
- Essential Mathematical Statistical calculation knowledge related to data analysis.
- Knowledge in Machine learning algorithms
- Good understanding and knowledge in NoSQL database - Mongo DB.
- Experience in data warehousing projects, views, procedures, functions, triggers, sequences, cursor, ref cursor, materialized view creation.
- Expertise in Java programs using eclipse IDE, debugging and deploying the code.
- Knowledge of ETL processing, and Big data processing for the data extraction, import, export and visualization.
- Experience in Java web services and frameworks - Struts, Spring, Hibernate etc..
- Experience in SQL Query tuning and instance tuning as the part of performance tuning.
- Good team player and efficient in problem solving
- Experience and exposure in advanced concepts - collections and bulk collect - for all
- Functional expertise includes Telecom, Manufacturing, Health care, Insurance, Banking, Retail Store, Insurance, Stock market, automotive and Financial Accounting
- Experience in UNIX shell scripting.
- Professional Certification in Data Analytics and Database at UCSC (University of California).
- Oracle Certified Professional in oracle 11g Advanced Pl/Sql programming
- Oracle Certified Associate in oracle 11g DBA
TECHNICAL SKILLS
Operating System: Windows NT 4.0 / XP/2000/7/8, UNIX
Hadoop Eco System: Hadoop eco system (HDFS, Map Reduce, Pig & Hive, HBase), oozie.
Programming Languages: Java, Python, C++, PL/SQL, SQL, HTML,XML, Bash shell scripting
Java, j2ee specific skills: J2EE Common Services APIs, Web Services, Java JSP Servlet Struts driven web sites.JDBC connections, Applet, SOAP, REST, JUNIT
Database: Oracle 8i,9i,10g,11g, MS Access, MySQL, Sql Server 2012
NoSQL- Mongo DB: Web Server: Apache Tomcat 7.0, Derby
Designing and modeling Tools: OOAD- DIA, MS-Visio, Star UML
Tools: & Utilities: Eclipse IDE, Net Scape,JDK1.6,SQL*Plus, SQL & pl/sql Developer, SQL * Loader, CVS
Domain: Manufacturing, Health care, Medical Insurance, Telecom, Automotive
Internet Technologies: Oracle Web Tool kit, Java Script, HTML
Visualization tools & Program: R Studio, R-Programming, Tableau8.0,Advanced Excel VBA, Macro
Methodologies: Agile and Water fall methodology
PROFESSIONAL EXPERIENCE
Confidential
Hadoop Developer
Responsibilities:
- Design & developed the Hadoop stack
- Import geospatial data from various external file formats and
- Translating data from one projection to another
- Fetch the un-projected co-ordinates to track it.
- Data Warehouse (DW) data integrated from different sources in different format (PDF, TIFF, JPEG, web crawl and RDBMS data MySQL, oracle, sql server etc.)
- Collected the data and store it through import and export properties.
- Virtualize and split the data to different systems for analyze and visualize it for the end users and business development team.
- Visualization reports share with the concern groups through the report format (Pdf, documentation) and web publishing (knit) and e-mail attachment format.
- Geo-map analysis linked with the google map location co-ordinates and location map.
- Debugging and logs analyze and verify for the better performance.
- Track the vehicles, if it goes out of the tracking area or out of control.
- Monitor the tracking system.
- Client and server and node setup for these application
- Sensor data publish in the cloud system and receive it for the further analysis.
Confidential
Hadoop Developer
Responsibilities:
- Install and Configure the Cloudera Manager in cloud.
- Ansible modules use to control the Amazon Web Services (AWS).
- Extract the customers from the huge warehouse data for processing.
- Data Warehouse (DW) data integrated from different sources in different format (PDF, TIFF, JPEG, web crawl and RDBMS data MySQL, oracle, sql server etc.)
- Monitor the performance and tune it.
- Written the mapper, reducer and combiner.
- Install Eco system components pig, hive, oozie etc.
- Measure the loss and profit percentage and the changing duration through the time series.
- ERP diagram for the extract process.
- Load and extract the data from the data-ware house model and collect the necessary information for the visualization.
Confidential
Hadoop Developer/Administrator
Responsibilities:
- Cloud setup
- Ansible modules use to control the Amazon Web Services (AWS).
- Written custom User Defined Functions.
- Assisted with performance tuning and monitoring.
- Data Warehouse (DW) data integrated from different sources in different format (PDF, TIFF, JPEG, web crawl and RDBMS data MySQL, oracle, sql server etc.)
- R-programming script for the analysis, designing and visualization.
- Create multiple visualization reports.
- Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from UNIX, NoSQL and a variety of portfolios.
- Supported code/design analysis, strategy development and project planning
- Created reports for the BI team using sqoop to export data into HDFS and Hive.
- Developed multiple Map Reduce jobs in Java for data cleaning and preprocessing.
- Assisted with data capacity planning and node forecasting.
- Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability.
- Administrator for Pig, Hive and Hbase installing updates, patches and upgrades.
- Most of the data scientist activities done in this project.
- It prepared and send to the Business Development team for making decision.
Confidential
Java Developer-Data Analyst
Responsibilities:
- Requirement gathering, analysis and customer interaction
- Tableau reports and dashboards created and distributed in pdf format.
- Design the database object
- Module development, Involved to create views for the Ford of Mexico region
- Inline views, join conditions given based on the requirement and conditions
- Packages, Procedures, Triggers, functions developed for this application
- Prepared Application Design Document
- Involved in data modeling- constraints, relationship decided based on the business logic
- Enhancements
- Data Warehouse(DW) data integrated from different sources in different format (PDF,TIFF,JPEG, web crawl and RDBMS data mysql, oracle, sql server etc)
- Small change document preparation
- Client interaction- interact with business unit, assigned schedule and organized the meeting.
- Prepared unit test cases
- Upload the developed databased codes(Views and database objects) to the database under VIP schema in DEV environment and migrate to QA and Prod environment.
- Give privileges and create synonym to these objects.
- Packages, stand alone procedures and functions, triggers compiled and executed using DBCR-ADS tool.
Confidential
Senior Software Engineer
Responsibilities:
- Analyze the internal process using R for report creation
- Module development, Involved to build a changes in SHDS indicative quotations for single quote and bulk quote, changes in pl/sql module in ICSQQ Frames
- Complete understanding about ICSQQ and ORQQ
- Packages, Procedures, Triggers, functions developed for this application
- Write and execute commands in Oracle client server and view through BT ip VPN Services.
- Packages, procedures and functions written in Pl/Sql program
- Enhancement works under the SHDS section as per client’s requirement
- Attend team meeting and planning the time line and prepare the time sheet for the requirements
- Design document and test case prepared for Quick quote application
- Auditing document preparation (DP Sheet)
- Installed and configure the environment for both development and production
- In wave stream region UN wanted options dropped, found the related java script object related to the pl/sql code and bug fix based on the customer report.
- Handled knowledge Transfer session from development team to support team
Confidential
Senior Programmer
Responsibilities:
- Tracking the transactions and create the Analytics reports using google analytical tool in the web based system.
- Involved in full life cycle of Intelligence Information System application development
- Build model of this IIS system modules HLD & LLD
- Transferred business narrative into a graphical representation (flow diagram) of business information needs and rules
- Confirm and refine the model with the analysts and experts
- Achieved to store the AutoCAD diagrams and its storage locations in the database
- Creating and adding new fields to existing database
- Participated in meetings with development team & support team
- Installed and configured environment for both development and production
- Created packages for easy handling
- Handling Deployment Activity
- Maintain Release Plan
- Prepared Performance analysis report for both Oracle databases in development and production
Confidential
Senior Programmer
Responsibilities:
- Design and Development using MS-Visio for the flow diagram and the system design.
- Module development, Involved to build procurement pl/sql module in MTS system
- Modified design and the database based on MTS system model developed in the strategy and analysis phase
- Write and execute commands to create the tables and supporting objects for the database.
- Packages, procedures and functions written in Pl/Sql program
- Involved in full life cycle of Manufacturing Trade System application
- Arrange knowledge Transfer session from development team to support team
- Preparing Performance analysis report for this procurement module
- Develop user documentation, help text and operations manuals to support the use and operation of the MTS system
- Monitor its performance and enhance and refine the system
Confidential
Programmer
Responsibilities:
- Providing customer support
- VBA module development and SQL scripts and pl/sql module development
- Resolving user raised defects and service request
- Involving housekeeping activity for change requests
- Handling deployments for new releases
- Handling Medical codes related with its price and its medical name
- Help team members to resolve users defects with in the module
- Balance sheet and ledger preparation.
- Account analysis and system designing flow chart development.
- Agile methodology designing and implementing methodology.
Confidential
Programmer - Analyst
Responsibilities:
- Design and Develop the database, Schema design and User privilege setup for the huge growing RDBMS database. understand the function details of this specific module and flow of this system
- Resolve the customers issues with in the SLA
- Generation of various report for maintain production environment healthy
- Involved in problem management
- Involved in resoling critical defects
- Train up new joiners in our project
- Monitor schedule jobs
- Visualization report prepare using Excel.