Senior Hadoop Developer Resume
Sacramento, CA
SUMMARY:
- 10+ years of experience in IT Industry encompassing wide range of skill sets and roles - Project Lead, Technical Team Leader, Senior Systems Analyst, Senior developer for different projects primarily using Microsoft Technologies and Hadoop & Big Data Analytics . Have experience in working with diversified projects - healthcare - MMIS, Media & Entertainment industry.
- Confidential Certfied Solution Advisor for BigData analytics and Hadoop professional with 10+ years of experience in IT industry domain expertise in Media Industry, Health Insurance & Healthcare.
- Over 3+ years of work experience as Hadoop Developer with good experience of Hadoop framework, Hadoop Distributed file system and Parallel processing implementation.
- Experience in Hadoop Ecosystems HDFS, Map Reduce, Hive, Pig, HBase, Sqoop.
- Working experience in Hadoop framework, Hadoop Distributed file system and Parallel processing implementation.
- PMP Certified result Oriented technical project lead with one plus year of experience in managing all aspects of SDLC (both Agile & Waterfall), Project & People Management Health care domain .
- Experienced in providing project Effort Estimations, Work Breakdown Structure, Risk Analysis, Mitigation & GAP Analysis
- Capable of handling multiple projects and delivering high quality results
- Experienced in resource planning, organizing, prioritizing, and delegating assignments based on the customer needs
- Experienced in project progress tracking, reporting & deliverables tracking
- Experienced in waterfall & agile methodologies
- Strong Knowledge in Azure and Angular JS.
- Excellent knowledge of Transact SQL
- Strong Knowledge in Content Management systems
- Hands-on experience with the overall Hadoop eco-system - HDFS, Map Reduce, Pig/Hive, HBase.
- Working experience with large scale Hadoop environments build and support including design, configuration, installation, performance tuning and monitoring.
- Excellent understanding / knowledge of Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and Map Reduce programming paradigm.
- Good Exposure on Apache Hadoop Map Reduce programming, Hive, Oozie,PIG scripting and HDFS.
- Experience in managing and reviewing Hadoop log files.
- Hands on experience in Import/Export of data using Hadoop Data Management tool SQOOP.
- Strong experience in writing Map Reduce programs for Data Analysis. Hands on experience in writing custom partitioners for Map Reduce.
- Performed data analysis using Hive and Pig.
- Knoweldge in Scala Language.
- Experience in using SPARK.
- Excellent understanding and knowledge of NOSQL databases like Mongo DB, HBase, and Cassandra.
- Experience with distributed systems, large-scale non-relational data stores, RDBMS, NoSQL map-reduce systems, data modeling, database performance, and multi-terabyte data warehouses.
- Experience in Software Development Life Cycle (Requirements Analysis, Design, Development, Testing, Deployment and Support).
- Microsoft Certified Professional (MCP) with Expert level programming skills in C#,VB.Net, ASP.Net, AJAX, WCF, WWF, WPF, LINQ, Visual Sutdio Team Suite 2008/2005/2010/2012/2013 , Team Foundation Server(TFS), SharePoint Server (MOSS) 2007, Office SharePoint Designer 2007, Windows SharePoint Services (WSS), VSTO, OBA, ASP, VB, VBA, ADO.Net, ADO/RDO,Visual Interdev 6/5, VBscript, Javascript, CSS, XML, XSD, XSL, XSLT, XAML, XPath, Webservice Contract First(WSCF), Web Services, WCF,WPF,REST and Web Service Enhacement(WSE).
- Expertise in databases like SQL Server 2008/2005/2012 , Oracle 9i
- Good exposure in Object Oriented Analysis and Design(OOAD) programming and.Net Architecture and ASP.Net MVC, MVP, MVVM Patterns.
- Strong Experience in SQL Server 2008 Integration Services (SSIS) and SSRS.
- Experience in Implementing vendor applications by coordinating with client, end users and vendors
- Experience in Agile Software development method such as SCRUM.
- Pretty good experience designing and Developing WebForms and WinForms using C#/VB.Net Languages.
- Excellent team player with problem-solving and trouble-shooting capabilities.
- Excellent communication and interpersonal skills and appetite to learn new technologies.
TECHNICAL SKILLS:
Hadoop ECO Systems: HDFS, Map Reducing, HDFS, Oozie, Hive, Pig, Sqoop, Flume, Zookeeper and HBase, Cassandra
NO SQL: Mongo DB, Cassandra
Data Bases: MS SQL Server 2000/2005/2008/2012 , MY SQL, Oracle 9i/10g, MS access, DB2
Languages: C#,VB.NET,VB6.0, Java JDK1.4 1.5 1.6 (JDK 5 JDK 6), C/C++, SQL, SQL, PL/SQLScala, Spark,Angular JS
Operating Systems: Windows Server 2000/2003/2008 , Windows XP/Vista, Mac OS, UNIX, LINUX
Frame Works: JUnit and JTest, LDAP.
IDE’s & Utilities: Visual Studio.NET,Eclipse
SQL Server Tools: SQL Server Management Studio, Enterprise Manager, QueryAnalyser, Profiler, Export & Import (DTS).
WebDev. Technologies: ASP.NET, HTML,XML
Testing Tools: Bugzilla, QuickTestPro(QTP)9.2, Selenium, Quality Center, Test Link
Management Tools/Methodologies: WaterFall,Agile, MS Project Server 2007,Rational Team Concert (RTC),Estimation Tool, Forecasting Matrix,Identify Access Management (IAM), Confidential PWC (IPWC),VISIO
PROFESSIONAL EXPERIENCE:
Confidential, Sacramento, CA
Senior Hadoop developer
Responsibilities:
- Create, validate and maintain scripts to load data using Sqoop manually.
- Create Oozie workflows and coordinators to automate Sqoop jobs weekly and monthly.
- Worked on reading multiple data formats on HDFS using Scala.
- Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs and Scala.
- Moved 10 TB of Claims data into HDFS and did analysis for finding the claims count, average, variance past 5 years
- Analyzed the SQL scripts and designed the solution to implement using Scala
- Running reports in Pig and Hive.
- Develop, validate and maintain HiveQL queries.
- Create, validate and maintain scripts to load data from and into tables in SQL Server 2012.
- Fetch data to/from HBase using Map Reduce jobs.
- Writing Map Reduce jobs.
- Running reports in Pig and Hive Queries.
- Analyzing data with Hive, Pig.
- Designed Hive tables to load data to and from external tables.
- Writing DistCp shell scripts to load data across servers.
- Run executive reports using Hive and Qlik View.
- Knowledge Transitioning, mentoring and cross members in the team.
- Involved in System Integration Testing and fixed bugs encountered during SIT.
- Preparation of transition documents
- Involved in UAT and fixed bugs encountered during UAT.
- Involved in Production Support activities.
- Worked in dual role as Project Leader and Senior developer. Resolved Technical issuesRaised by business users
- Proactively communicated project status, issues and risks to internal stakeholders and top management
- Conducted regular project status/quality meetings and reports. Kept management and key stakeholders well informed on a weekly basis on project progress, status and/or concerns for each assignment.
- Responsible to set up weekly status meetings with the team and report the monthly status to program manager
- Responsible for leading the complete technical life cycle of project completion starting from 10-Day estimate to Testing to Deployment to project closure
- Responsible to coordinate with conflicting project requirements with other stakeholders while defining the project scope
Environment: Hadoop, Map-Reduce, Java, HDFS, Hbase, Hive,SQL, Pig, Sqoop, Oozie,Scala,spark
Confidential, Sacramento, CA
Hadoop developer/Admin
Responsibilities:
- Piloted Proof of Concept (PoC) to implement big data solution for Health care account.
- Designed big data solution using Confidential BigInsights product to process, store and analyze 80TB of data.
- Administered Hadoop cluster with three worker nodes, and installed relevant Confidential tools on four linux physical machines separately for test preparation.
- Performed testing on structured data using bigSQL and used duration time and accuracy rate metrics to identify query performance issues.
- Loaded semi-structured log into HBase using Confidential BigInsights with Apache Hadoop for further analysis.
- Extracted request time and webpage URL columns from semi-structured webpage log data and transformed into structured table using Confidential BigInsights Text Analytics to analyze frequency of webpage request.
- Proactively communicated project status, issues and risks to internal stakeholders and top management
Environment: Hadoop, Map-Reduce, Java, HDFS, Hbase, Hive,SQL, Pig, Sqoop, Oozie: Confidential Big Data Engineer/Team Lead Confidential
Confidential, Burbank, CA
Big Data Engineer/Team Lead
Responsibilities:
- Worked with Data Ingestion techniques to move data from various sources to HDFS.
- Analysed different formats of Data.
- Worked on writing Map reduce programs using Java.
- Extensly worked with Partitions, Bucketing tables in Hive and designed both Managed and External table.
- Worked on optimization of Hive Queries.
- Created and worked with Sqoop jobs with full refresh and incremental load to populate Hive External tables.
- Worked on Pig to do data transformations.
- Developed UDF's in Map/reduce, Hive and Pig.
- Worked on Hbase and Its integration with Strom.
- Worked on Apache flume for getting data from Twitter to HDFS.
- Worked with MongoDB and Cassandra NoSql Db's.
- Involved in importing the data from Oracle and MySQL to Amazon S3 using ETL
- Use Spark Dataframe APIs to inject Oracle data and MySQL data to S3 and store in Redshift.
- Presently implementing Strom, Spark.
- Designing and creating Oozie workflows to schedule and manage Hadoop, Hive, pig and sqoop jobs.
- Worked with RDBMS import and export to HDFS.
- Involved in requirement analysis.
- Involved in giving KT to other team members.
- Involved in preparing Project documentation.
Environment: Hadoop, HDFC, HBASE, HIVE, PIG, Zookeeper, Map Reduce, Sqoop, SQL, ORACLE, NOSQL, JDK 1.6, Struts, JSP, Java, JSF, Spring, Hibernate, Eclipse, Maven, Log4j, JAXB, XSD, SVN, ant, Tomcat, Hadoop, HDFS, Pig, Sqoop, Mapreduce, Ubuntu/centOS, Red hat LINUX, Confidential infoshpehere streams, BigDataSQL,Bigsheets
Confidential, Burbank, CA
Technical Team Leader(.NET)
Responsibilities:
- Part of critical enhancements and server migrations. Performed tech lead role in onsite and offshore model for various application development and maintenance activities.
- Designed and developed bulk employee delete functionality using windows services.
- Designed and developed session time out handling module which would preserve the data for future editing when user logs in back using JavaScript and Ajax.
- Migration of DTS packages to SSIS, debugging and resolution of complex database issues.
- Design and development of Talent Planning module.
- Design and development of SQL Tables and stored procedures for reports.
- Debugging of critical & complex production issues and provided fixes in timely manner.
- Provided Support for the Production issues for related to application and DB by coordinating with the
- BTP s(Client) and end users.
- Handled full life cycle of Excel based Office automation solutions using C#, VB.Net, WCF Web ServicesWeb API, VBA and XML, SAP integration, single sign on, IIS 7.5, etc.
- Designed and implemented user integration to SharePoint libraries using Active Directory, C# and SQL
- Server. Maintained and supported Share Point library solution.
- Design and development of SSIS packages, debugging and resolution of complex database issues.
- Designed and developed modules for finance applications using ASP.Net MVC and SQL Server.
- Handled complete life cycle and played key role in building successful project.
- Designed and developed key enhancements in Ariba using Integration Tool Kit ITK 11S2
- Performed several Migrations and ugrades of the application from Unix to Linux
- Supported day to day maintenance of the application.
- Implemented solutions for long pending and complex data issues in ITK and Spend Management
- Visibility tool.
Environment: Microsoft VB.Net, C#.Net, ASP.Net, MS SQL Server 2008/2012, SSIS, PGP, Tectia, Integration Tool Kit 11S2, Spend Management, Linux,NET 4.5, Visual Studio 2012,Web services, WCF
Confidential, Burbank, CA
IT specialist
Responsibilities:
- Designed and developed key enhancements. Supported day to day maintenance of the application. Implemented Internet Explorer Automation for implementing Single Sign On.
- Performed several application upgrades and coordinated UAT.
- Provided Support for the Production issues by coordinating with the client and Vendor CA
- Implementation of enhancements for Plant Maintenance and Request for Inventory Disposition applications using
- ASP.Net, C#, Web Services, SSRS and SQL Server
- Design and development of Document Name Generator application using ASP.Net MVC, C#, Entity Framework, SQL
- Server, JQuery and JavaScript
- Performed enahancements, Upgrade of the application from Clarity 13.1 to 13.3
- Developed new functionalities based on the requirement from Disney
- Provided 24 * 7 Support for the Production issues by coordinating with the client and Vendor CA
Environment: Microsoft VB.Net, C#.Net, ASP.Net, MS SQL Server 2008,Informatica, Unix .VSS, Windows 2008,Crystal reports,Visual Studio 2010, Windows Communication Foundation WCF, WPF,Ajax: Lorshi Technologies Midlevel Developer ICS (Infinity Computer Solutions)
Confidential, Sterling, VA
Midlevel developer
Responsibilities:
- Responsible for developing solutions for all tiers of the major modules of the application; code-behinds, controls, middle-tier business components, database layer, etc.
- Documented the UML (Use Cases, Class Diagrams. etc).
- Designed the User Interfaces screens with C# Win forms.
- Developed windows application for DMS, to process Medical records and store it in the SQL Server database. (Database application development).
- Implemented windows service to interact DMS windows application with Encryption application.
- Developed the Line, Bar and other chart controls to display the statistical data using windows GDI controls.
- Implemented the Business logic Layers
- Worked for different modules implementations.
- Worked on PGP for encryption and Citrix.
- Worked on SFTP and Microsoft active directory.
- Developed SQL stored procedures and jobs to meet the expected functionality of the system.
- Developed the Web services using WCF for accessing the medical files from file repository.
- Implemented 508 compliance for web as well windows applications.
- Implement the window services for monitoring the work flows in the system.
- Used ADO.net to connect to SQL Server 2005.
- Used Connection and Command Objects of ADO.NET, also worked with Data Adapters and Datasets using C#.
- Worked on TFS Source and Version Control.
- Test Cases Implemented inNUnit frame work.
Environment: - Visual Studio 2008,ASP.Net 2.0, C#, ADO.Net 2005, SQL Server 2005,MVC, PGP,LINQ, Win forms, JavaScript, AJAX, XML,XLT,XPATH, CSS,T-SQL, TFS (Team Foundation Server), NUnit.
Midlevel Developer
Confidential
Responsibilities:
- Involved in all phases of implementation including requirements gathering, design, development, testing, deployment, and
- Designed and implemented an Intranet portal Site to connect the users, teams, and information.
- The site allows customization and personalization of the content and layout. It integrates information from various systems into one solution and has enterprise application integration capabilities.
- Designed and Developed the SharePoint Portal Architecture which included developing SharePoint Site Templates, creating WSS Sites and Portal Sites.
- Involved in Administration of SharePoint portal and other WSS sites.
- Created documentation and trained administrators and tech support personnel in SharePoint.
- Created SharePoint support site for users to use as a knowledge base.
- Developed Winforms for Translation layer tool.
- Add Auto Contribution features for the midnight scheduler job task which is developed in VB.Net and windows services.
- Modified existing T-SQL Stored procedures.
- Updated ASP pages interface and rewritten existing code.
- Prepared Use Cases, Technical Specifications and SRT’s.
- Resolving Vantives of the production severity Level -3.
- Created tables,views and indexes.
- Debug & Manual testing. Developed Unit test case reports.
- Everyday Build & Deployed Code daily basis in various environment.
- Created Functional,Business and Deployment docs in Share Point.
Environment: C#, VB.Net, ASP,Windows Services, Winforms,COM+,SQL Server200,XML,IIS6.0 and Tomcat, Java,JSP,VisualStudio.net 2003/2005, JavaScript, PVCS, SharePointPortalServer2003, VBA, WASD
Junior Developer
Confidential
Responsibilities:
- Produced UML Use Cases, Class Diagrams and Sequence Diagrams for Customer integration component and sub-components. Revised existing systems and procedures to correct deficiencies and maintain more effective data handling, conversion, input/output requirements, and storage.
- Design, Development of Web Forms Using C#. NET. Integrating COM+ Components into .Net Framework.
- Designed the components for middle tier, Database and written stored procedures.
- Developed composite controls, web server controls for application templates.
- Developed Data base components using ADO.NET.
- Developed Custom User Controls to reduce the Complexity in User Interface Coding.
- Testing of the code by developing various test cases.
- Implemented MS Application Blocks for Database Interface layer.
- Calling Web Services Component for Address Validation.
- Worked with the Rational Unified Process (RUP)
- Developed User Controls to reduce the Complexity in User Interface Coding.
- Created stored procedures,Functions,Indexes,Views,Clusters and Sequences by using PL/SQL.
- Used ADO.NET in C#. NET to execute stored procedures.
- Client side validations are done using JavaScript.
- Written Middle-tier components such as Business Layer and Data Layer.
- Created reports using Crystal reports 10.
- Developed this application in ASP.NET using C# Language.
- Deployed the application on to IIS 5.
Environment: C#,ASP.Net,Oracle8i,PL/SQL,VisualStudio.Net2003,VB,XMLSpy,JavaScript,CrystalReports10,VisualSourceSafe 6.0,Windows-XP,IIS,Microsoft Application Blocks.