We provide IT Staff Augmentation Services!

Senior Hadoop Developer Resume

0/5 (Submit Your Rating)

Sacramento, CA

SUMMARY:

  • 10+ years of experience in IT Industry encompassing wide range of skill sets and roles - Project Lead, Technical Team Leader, Senior Systems Analyst, Senior developer for different projects primarily using Microsoft Technologies and Hadoop & Big Data Analytics . Have experience in working with diversified projects - healthcare - MMIS, Media & Entertainment industry.
  • Confidential Certfied Solution Advisor for BigData analytics and Hadoop professional with 10+ years of experience in IT industry domain expertise in Media Industry, Health Insurance & Healthcare.
  • Over 3+ years of work experience as Hadoop Developer with good experience of Hadoop framework, Hadoop Distributed file system and Parallel processing implementation.
  • Experience in Hadoop Ecosystems HDFS, Map Reduce, Hive, Pig, HBase, Sqoop.
  • Working experience in Hadoop framework, Hadoop Distributed file system and Parallel processing implementation.
  • PMP Certified result Oriented technical project lead with one plus year of experience in managing all aspects of SDLC (both Agile & Waterfall), Project & People Management Health care domain .
  • Experienced in providing project Effort Estimations, Work Breakdown Structure, Risk Analysis, Mitigation & GAP Analysis
  • Capable of handling multiple projects and delivering high quality results
  • Experienced in resource planning, organizing, prioritizing, and delegating assignments based on the customer needs
  • Experienced in project progress tracking, reporting & deliverables tracking
  • Experienced in waterfall & agile methodologies
  • Strong Knowledge in Azure and Angular JS.
  • Excellent knowledge of Transact SQL
  • Strong Knowledge in Content Management systems
  • Hands-on experience with the overall Hadoop eco-system - HDFS, Map Reduce, Pig/Hive, HBase.
  • Working experience with large scale Hadoop environments build and support including design, configuration, installation, performance tuning and monitoring.
  • Excellent understanding / knowledge of Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm.
  • Good Exposure on Apache Hadoop Map Reduce programming, Hive, Oozie,PIG scripting and HDFS.
  • Experience in managing and reviewing Hadoop log files.
  • Hands on experience in Import/Export of data using Hadoop Data Management tool SQOOP.
  • Strong experience in writing Map Reduce programs for Data Analysis. Hands on experience in writing custom partitioners for Map Reduce.
  • Performed data analysis using Hive and Pig.
  • Knoweldge in Scala Language.
  • Experience in using SPARK.
  • Excellent understanding and knowledge of NOSQL databases like Mongo DB, HBase, and Cassandra.
  • Experience with distributed systems, large-scale non-relational data stores, RDBMS, NoSQL map-reduce systems, data modeling, database performance, and multi-terabyte data warehouses.
  • Experience in Software Development Life Cycle (Requirements Analysis, Design, Development, Testing, Deployment and Support).
  • Microsoft Certified Professional (MCP) with Expert level programming skills in C#,VB.Net, ASP.Net, AJAX, WCF, WWF, WPF, LINQ, Visual Sutdio Team Suite 2008/2005/2010/2012/2013 , Team Foundation Server(TFS), SharePoint Server (MOSS) 2007, Office SharePoint Designer 2007, Windows SharePoint Services (WSS), VSTO, OBA, ASP, VB, VBA, ADO.Net, ADO/RDO,Visual Interdev 6/5, VBscript, Javascript, CSS, XML, XSD, XSL, XSLT, XAML, XPath, Webservice Contract First(WSCF), Web Services, WCF,WPF,REST and Web Service Enhacement(WSE).
  • Expertise in databases like SQL Server 2008/2005/2012 , Oracle 9i
  • Good exposure in Object Oriented Analysis and Design(OOAD) programming and.Net Architecture and ASP.Net MVC, MVP, MVVM Patterns.
  • Strong Experience in SQL Server 2008 Integration Services (SSIS) and SSRS.
  • Experience in Implementing vendor applications by coordinating with client, end users and vendors
  • Experience in Agile Software development method such as SCRUM.
  • Pretty good experience designing and Developing WebForms and WinForms using C#/VB.Net Languages.
  • Excellent team player with problem-solving and trouble-shooting capabilities.
  • Excellent communication and interpersonal skills and appetite to learn new technologies.

TECHNICAL SKILLS:

Hadoop ECO Systems: HDFS, Map Reducing, HDFS, Oozie, Hive, Pig, Sqoop, Flume, Zookeeper and HBase, Cassandra

NO SQL: Mongo DB, Cassandra

Data Bases: MS SQL Server 2000/2005/2008/2012 , MY SQL, Oracle 9i/10g, MS access, DB2

Languages: C#,VB.NET,VB6.0, Java JDK1.4 1.5 1.6 (JDK 5 JDK 6), C/C++, SQL, SQL, PL/SQLScala, Spark,Angular JS

Operating Systems: Windows Server 2000/2003/2008 , Windows XP/Vista, Mac OS, UNIX, LINUX

Frame Works: JUnit and JTest, LDAP.

IDE’s & Utilities: Visual Studio.NET,Eclipse

SQL Server Tools: SQL Server Management Studio, Enterprise Manager, QueryAnalyser, Profiler, Export & Import (DTS).

WebDev. Technologies: ASP.NET, HTML,XML

Testing Tools: Bugzilla, QuickTestPro(QTP)9.2, Selenium, Quality Center, Test Link

Management Tools/Methodologies: WaterFall,Agile, MS Project Server 2007,Rational Team Concert (RTC),Estimation Tool, Forecasting Matrix,Identify Access Management (IAM), Confidential PWC (IPWC),VISIO

PROFESSIONAL EXPERIENCE:

Confidential, Sacramento, CA

Senior Hadoop developer

Responsibilities:

  • Create, validate and maintain scripts to load data using Sqoop manually.
  • Create Oozie workflows and coordinators to automate Sqoop jobs weekly and monthly.
  • Worked on reading multiple data formats on HDFS using Scala.
  • Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs and Scala.
  • Moved 10 TB of Claims data into HDFS and did analysis for finding the claims count, average, variance past 5 years
  • Analyzed the SQL scripts and designed the solution to implement using Scala
  • Running reports in Pig and Hive.
  • Develop, validate and maintain HiveQL queries.
  • Create, validate and maintain scripts to load data from and into tables in SQL Server 2012.
  • Fetch data to/from HBase using Map Reduce jobs.
  • Writing Map Reduce jobs.
  • Running reports in Pig and Hive Queries.
  • Analyzing data with Hive, Pig.
  • Designed Hive tables to load data to and from external tables.
  • Writing DistCp shell scripts to load data across servers.
  • Run executive reports using Hive and Qlik View.
  • Knowledge Transitioning, mentoring and cross members in the team.
  • Involved in System Integration Testing and fixed bugs encountered during SIT.
  • Preparation of transition documents
  • Involved in UAT and fixed bugs encountered during UAT.
  • Involved in Production Support activities.
  • Worked in dual role as Project Leader and Senior developer. Resolved Technical issuesRaised by business users
  • Proactively communicated project status, issues and risks to internal stakeholders and top management
  • Conducted regular project status/quality meetings and reports. Kept management and key stakeholders well informed on a weekly basis on project progress, status and/or concerns for each assignment.
  • Responsible to set up weekly status meetings with the team and report the monthly status to program manager
  • Responsible for leading the complete technical life cycle of project completion starting from 10-Day estimate to Testing to Deployment to project closure
  • Responsible to coordinate with conflicting project requirements with other stakeholders while defining the project scope

Environment: Hadoop, Map-Reduce, Java, HDFS, Hbase, Hive,SQL, Pig, Sqoop, Oozie,Scala,spark

Confidential, Sacramento, CA

Hadoop developer/Admin

Responsibilities:

  • Piloted Proof of Concept (PoC) to implement big data solution for Health care account.
  • Designed big data solution using Confidential BigInsights product to process, store and analyze 80TB of data.
  • Administered Hadoop cluster with three worker nodes, and installed relevant Confidential tools on four linux physical machines separately for test preparation.
  • Performed testing on structured data using bigSQL and used duration time and accuracy rate metrics to identify query performance issues.
  • Loaded semi-structured log into HBase using Confidential BigInsights with Apache Hadoop for further analysis.
  • Extracted request time and webpage URL columns from semi-structured webpage log data and transformed into structured table using Confidential BigInsights Text Analytics to analyze frequency of webpage request.
  • Proactively communicated project status, issues and risks to internal stakeholders and top management

Environment: Hadoop, Map-Reduce, Java, HDFS, Hbase, Hive,SQL, Pig, Sqoop, Oozie: Confidential Big Data Engineer/Team Lead Confidential

Confidential, Burbank, CA

Big Data Engineer/Team Lead

Responsibilities:

  • Worked with Data Ingestion techniques to move data from various sources to HDFS.
  • Analysed different formats of Data.
  • Worked on writing Map reduce programs using Java.
  • Extensly worked with Partitions, Bucketing tables in Hive and designed both Managed and External table.
  • Worked on optimization of Hive Queries.
  • Created and worked with Sqoop jobs with full refresh and incremental load to populate Hive External tables.
  • Worked on Pig to do data transformations.
  • Developed UDF's in Map/reduce, Hive and Pig.
  • Worked on Hbase and Its integration with Strom.
  • Worked on Apache flume for getting data from Twitter to HDFS.
  • Worked with MongoDB and Cassandra NoSql Db's.
  • Involved in importing the data from Oracle and MySQL to Amazon S3 using ETL
  • Use Spark Dataframe APIs to inject Oracle data and MySQL data to S3 and store in Redshift.
  • Presently implementing Strom, Spark.
  • Designing and creating Oozie workflows to schedule and manage Hadoop, Hive, pig and sqoop jobs.
  • Worked with RDBMS import and export to HDFS.
  • Involved in requirement analysis.
  • Involved in giving KT to other team members.
  • Involved in preparing Project documentation.

Environment: Hadoop, HDFC, HBASE, HIVE, PIG, Zookeeper, Map Reduce, Sqoop, SQL, ORACLE, NOSQL, JDK 1.6, Struts, JSP, Java, JSF, Spring, Hibernate, Eclipse, Maven, Log4j, JAXB, XSD, SVN, ant, Tomcat, Hadoop, HDFS, Pig, Sqoop, Mapreduce, Ubuntu/centOS, Red hat LINUX, Confidential infoshpehere streams, BigDataSQL,Bigsheets

Confidential, Burbank, CA

Technical Team Leader(.NET)

Responsibilities:

  • Part of critical enhancements and server migrations. Performed tech lead role in onsite and offshore model for various application development and maintenance activities.
  • Designed and developed bulk employee delete functionality using windows services.
  • Designed and developed session time out handling module which would preserve the data for future editing when user logs in back using JavaScript and Ajax.
  • Migration of DTS packages to SSIS, debugging and resolution of complex database issues.
  • Design and development of Talent Planning module.
  • Design and development of SQL Tables and stored procedures for reports.
  • Debugging of critical & complex production issues and provided fixes in timely manner.
  • Provided Support for the Production issues for related to application and DB by coordinating with the
  • BTP s(Client) and end users.
  • Handled full life cycle of Excel based Office automation solutions using C#, VB.Net, WCF Web ServicesWeb API, VBA and XML, SAP integration, single sign on, IIS 7.5, etc.
  • Designed and implemented user integration to SharePoint libraries using Active Directory, C# and SQL
  • Server. Maintained and supported Share Point library solution.
  • Design and development of SSIS packages, debugging and resolution of complex database issues.
  • Designed and developed modules for finance applications using ASP.Net MVC and SQL Server.
  • Handled complete life cycle and played key role in building successful project.
  • Designed and developed key enhancements in Ariba using Integration Tool Kit ITK 11S2
  • Performed several Migrations and ugrades of the application from Unix to Linux
  • Supported day to day maintenance of the application.
  • Implemented solutions for long pending and complex data issues in ITK and Spend Management
  • Visibility tool.

Environment: Microsoft VB.Net, C#.Net, ASP.Net, MS SQL Server 2008/2012, SSIS, PGP, Tectia, Integration Tool Kit 11S2, Spend Management, Linux,NET 4.5, Visual Studio 2012,Web services, WCF

Confidential, Burbank, CA

IT specialist

Responsibilities:

  • Designed and developed key enhancements. Supported day to day maintenance of the application. Implemented Internet Explorer Automation for implementing Single Sign On.
  • Performed several application upgrades and coordinated UAT.
  • Provided Support for the Production issues by coordinating with the client and Vendor CA
  • Implementation of enhancements for Plant Maintenance and Request for Inventory Disposition applications using
  • ASP.Net, C#, Web Services, SSRS and SQL Server
  • Design and development of Document Name Generator application using ASP.Net MVC, C#, Entity Framework, SQL
  • Server, JQuery and JavaScript
  • Performed enahancements, Upgrade of the application from Clarity 13.1 to 13.3
  • Developed new functionalities based on the requirement from Disney
  • Provided 24 * 7 Support for the Production issues by coordinating with the client and Vendor CA

Environment: Microsoft VB.Net, C#.Net, ASP.Net, MS SQL Server 2008,Informatica, Unix .VSS, Windows 2008,Crystal reports,Visual Studio 2010, Windows Communication Foundation WCF, WPF,Ajax: Lorshi Technologies Midlevel Developer ICS (Infinity Computer Solutions)

Confidential, Sterling, VA

Midlevel developer

Responsibilities:

  • Responsible for developing solutions for all tiers of the major modules of the application; code-behinds, controls, middle-tier business components, database layer, etc.
  • Documented the UML (Use Cases, Class Diagrams. etc).
  • Designed the User Interfaces screens with C# Win forms.
  • Developed windows application for DMS, to process Medical records and store it in the SQL Server database. (Database application development).
  • Implemented windows service to interact DMS windows application with Encryption application.
  • Developed the Line, Bar and other chart controls to display the statistical data using windows GDI controls.
  • Implemented the Business logic Layers
  • Worked for different modules implementations.
  • Worked on PGP for encryption and Citrix.
  • Worked on SFTP and Microsoft active directory.
  • Developed SQL stored procedures and jobs to meet the expected functionality of the system.
  • Developed the Web services using WCF for accessing the medical files from file repository.
  • Implemented 508 compliance for web as well windows applications.
  • Implement the window services for monitoring the work flows in the system.
  • Used ADO.net to connect to SQL Server 2005.
  • Used Connection and Command Objects of ADO.NET, also worked with Data Adapters and Datasets using C#.
  • Worked on TFS Source and Version Control.
  • Test Cases Implemented inNUnit frame work.

Environment: - Visual Studio 2008,ASP.Net 2.0, C#, ADO.Net 2005, SQL Server 2005,MVC, PGP,LINQ, Win forms, JavaScript, AJAX, XML,XLT,XPATH, CSS,T-SQL, TFS (Team Foundation Server), NUnit.

Midlevel Developer

Confidential

Responsibilities:

  • Involved in all phases of implementation including requirements gathering, design, development, testing, deployment, and
  • Designed and implemented an Intranet portal Site to connect the users, teams, and information.
  • The site allows customization and personalization of the content and layout. It integrates information from various systems into one solution and has enterprise application integration capabilities.
  • Designed and Developed the SharePoint Portal Architecture which included developing SharePoint Site Templates, creating WSS Sites and Portal Sites.
  • Involved in Administration of SharePoint portal and other WSS sites.
  • Created documentation and trained administrators and tech support personnel in SharePoint.
  • Created SharePoint support site for users to use as a knowledge base.
  • Developed Winforms for Translation layer tool.
  • Add Auto Contribution features for the midnight scheduler job task which is developed in VB.Net and windows services.
  • Modified existing T-SQL Stored procedures.
  • Updated ASP pages interface and rewritten existing code.
  • Prepared Use Cases, Technical Specifications and SRT’s.
  • Resolving Vantives of the production severity Level -3.
  • Created tables,views and indexes.
  • Debug & Manual testing. Developed Unit test case reports.
  • Everyday Build & Deployed Code daily basis in various environment.
  • Created Functional,Business and Deployment docs in Share Point.

Environment: C#, VB.Net, ASP,Windows Services, Winforms,COM+,SQL Server200,XML,IIS6.0 and Tomcat, Java,JSP,VisualStudio.net 2003/2005, JavaScript, PVCS, SharePointPortalServer2003, VBA, WASD

Junior Developer

Confidential

Responsibilities:

  • Produced UML Use Cases, Class Diagrams and Sequence Diagrams for Customer integration component and sub-components. Revised existing systems and procedures to correct deficiencies and maintain more effective data handling, conversion, input/output requirements, and storage.
  • Design, Development of Web Forms Using C#. NET. Integrating COM+ Components into .Net Framework.
  • Designed the components for middle tier, Database and written stored procedures.
  • Developed composite controls, web server controls for application templates.
  • Developed Data base components using ADO.NET.
  • Developed Custom User Controls to reduce the Complexity in User Interface Coding.
  • Testing of the code by developing various test cases.
  • Implemented MS Application Blocks for Database Interface layer.
  • Calling Web Services Component for Address Validation.
  • Worked with the Rational Unified Process (RUP)
  • Developed User Controls to reduce the Complexity in User Interface Coding.
  • Created stored procedures,Functions,Indexes,Views,Clusters and Sequences by using PL/SQL.
  • Used ADO.NET in C#. NET to execute stored procedures.
  • Client side validations are done using JavaScript.
  • Written Middle-tier components such as Business Layer and Data Layer.
  • Created reports using Crystal reports 10.
  • Developed this application in ASP.NET using C# Language.
  • Deployed the application on to IIS 5.

Environment: C#,ASP.Net,Oracle8i,PL/SQL,VisualStudio.Net2003,VB,XMLSpy,JavaScript,CrystalReports10,VisualSourceSafe 6.0,Windows-XP,IIS,Microsoft Application Blocks.

We'd love your feedback!