Big Data Lead Developer Resume
SUMMARY:
- Architect / Principal Software Engineer / Consultant with 18+ years of proven experience in architecture, designing & developing enterprise solutions.
- 3+ years of experience providing Bigdata solutions using Hadoop 2.x, Spark 1.6+ and Spark 2.x, Scala, Hive, and Apache Sqoop.
- Experience in streaming applications using Spark Core, Spark SQL, Spark Streaming, Kafka, HDFS and MongoDB.
- Excellent knowledge in Hadoop Ecosystem including HDFS, Hive, HBase, Sqoop, Yarn, Oozie and Zookeeper.
- Good knowledge in analyzing and manipulating large data sets including structured, semi - structured and unstructured data.
- Experience in migrating the data from HDFS to Relational Database System and vice versa using Sqoop.
- Worked on different file formats like AVRO, Parquet, RC, and ORC.
- Used different types of joins while Working with different types of data in Confidential .
- Developed multiple Confidential jobs in Scala for preprocess the data and cleaning.
- Strong Enterprise Java skills providing end to end solutions.
- Designed and developed databases to serve enterprise application.
- Experience with software development processes Agile, Scrum, Rapid-application development, Waterfall.
- Expert in full project life cycle of software development from analyzing process, requirements, writing high level architectural and detailed designs, development, establishing standards & best practices, leading development & implementation efforts, reviewing the QA test plans, fine tuning performance to delivering the fine quality and scalable products.
- Involved in data modeling, database design and development.
- Leading and coordinating mid to large size global project teams.
- Deep understanding of technology for delivering well-served business needs.
- Designed and built cross technology frameworks such as utility services, Retail, Health care, Financial Accounts, and Financial Transactions.
- Proven leadership skill for leading and motivating teams. A quick learner and adapts to new environments easily.
- Expertise advises and assistance to tier-3, tech support and on-demand services for client queries and Production Issues.
- Implemented continuous integration systems.
- Good knowledge in working AWS cloud environment.
- Hands on experience with frameworks JBoss Seam, Spring and JSF.
- Excellent interpersonal, leadership and communication skills.
TECHNICAL SKILLS:
Bigdata: Hadoop 2.x, Spark 2.x, Scala 2.x, Hive, Sqoop, Yarn, Zookeeper, Kafka, HBase, SBT
Languages: Java, JEE, Scala, SQL, EQL, XSL, XML, XSD, HTML, Python, AngularJS, jQuery, Java Script, Bootstrap, CSS, PHP, C++, C, ABAP/4, Visual Basic
Enterprise Technologies: EJB, JPA, JDBC, JMS, Servlets, JSP, SOA, REST, JNDI, JAXB, SAX/DOM, WSDL, SOAP, Webservices, JSON, Hibernate, POI, iText, JXL, Log4j, Junit, JBehave
Databases: Oracle, MySQL, DB2, MongoDB, Cassandra, SQL Server, Access
Application Servers: HTTP Server, Tomcat, JBOSS, WebLogic, WebSphere, Jetty
Platforms / OS: Windows, Linux, UNIX, Ubuntu, CentOS, DOS
Frameworks: JBoss Seam, Spring, JSF, Vertex
Tools: Eclipse, My Eclipse, Intellij, NetBeans, Enterprise Architect, XML Spy, SQL Developer, Toad, Gradle, Maven, ANT, fortify, Clarify, FindBugs, PMD, SonarQube, Splunk, Track it, SharePoint, Confluence, tiki, MS TFS, MS Office, SharePoint, Confluence, tiki, MS TFS and MS Office
Version Control: SVN, JIRA, Git, Fisheye, Hudson, Jenkins, Star Team, Bug Zilla, ClearCase, ClearQuest, Clarify CRM, Track-it
PROFESSIONAL EXPERIENCE:
Confidential
Big Data Lead Developer
Responsibilities:
- Implemented the administration module for Confidential to manage customers, servers, and payments.
- RDBMS and NoSQL database design and implementation.
- Fetched data like customer data, server access data from proxy servers distributed across the globe in intervals of 10 seconds using Kafka and Spark Streaming.
- Uploaded the data to HDFS and then to Hive tables.
- Implemented transformations using Scala and analyzed the data, finally publishing the data to MongoDB for integrating with the admin module.
- Imported various server log files from all the Proxy servers to HDFS for analysis.
- Analyzed the logs for band width usage by customers, up time, idle time, and down time.
- Publishing the analytical data to MySQL for administration purpose.
- Involved in data modeling and database design.
- Built the Spark application with SBT tool.
- Deployed Spark jobs using Oozie Scheduler.
- Exposing the resultant data using Restful Web Services.
- Worked with the DevOps team to deploy applications to AWS cloud.
Confidential
Architect/ Tech Lead
Responsibilities:
- Lead the project since inception phase.
- Worked closely with the client and business analysts for getting the requirements.
- Worked closely with Project management team for preparing the project plan.
- Set up concurrent build and development environment to SIT and QA.
- Architected all tiers, UI, Business, and database layers.
- Modeled data, designed and implemented database to fit the client’s requirements.
- Designed, developed, and implemented CAMS Automation system from scratch using JEE technologies Java, JSF, JPA, SEAM, EJB3, EQL, Rich Faces, Tomahawk, AJAX, POI, JSAPER, SOA.
- Implemented persistence layer, databases Oracle 11g using Hibernate.
- Wrote build scripts using ANT, for packaging and automated deployment.
- Designed deployment environment for WebLogic 12c server on multi operating systems.
- Designed database schema for CAMS, SQL scripts for creating schema.
- Implemented final deliverables using Apache POI.
- Implemented reports module using JASPER reports.
- Wrote batch jobs for archiving data at regular intervals.
- Deployed UAT/SIT environments to AWS cloud.
- Worked with the DevOps team to deploy applications to AWS cloud.
Confidential
Principal Developer
Responsibilities:
- Designed and implemented RESTful Web Services that resides in Orchestration Layer.
- Implemented Vert.x main and worker verticals for high performance needs of web services.
- Implemented Data access layer for CRUD operation on Cassandra.
- Wrote JUnit and JBehave tests.
- Addressed code coverage issues reported by Confidential .
- Performed pier code reviews.
Confidential
Principal Developer
Responsibilities:
- Evaluated and tuned the enterprise applications for bottle necks in the performance in all UI, business, and database tiers.
- Fine Tuned WebSphere application server, to deliver the best performance.
- Wrote JMETER test scripts for testing application performance in various deployment scenarios to analyze the bottle necks.
- Implemented automated build and deploy environments for continuous integration using Hudson, Build Forge for application servers WebSphere 7.x.
- Built continuous build and deploy environment using Hudson.
Confidential
Architect/ Technical Lead
Responsibilities:
- Research the needs of IT and Software development teams.
- Designed the framework to serve cross technology development teams.
- Developed Synchronous and Asynchronous web services using JAX-WS, EJB3, JPA and hibernate.
- Designed and developed various services.
- Implemented central service registry platform (UDDI) for publishing and easy searching of services.
- Developed data services that can access data from multiple databases.
- Designed and developed reporting framework using Crystal Reports.
- Participated in the data center resource allocation and moving the applications data center.
Confidential
Technical Lead
Responsibilities:
- Designed and developed Navistar framework using JSF, XHTML, AJAX, Ice Faces, JBoss Seam, Drools, EJB3 and Hibernate.
- Designed and developed Rich User Interfaces (GUI) for the Navistar applications using Ice Faces.
- Developed editable data grid using AJAX, Row Select components and IceFaces.
- Designed and developed pdf reports using iText and JFree charts.
- Implemented central login authentication modules using SiteMinder.
- Implemented web services using JAX-WS.
- Developed dynamic reports using BIRT.
- Implemented automated build and deploy environments for continuous integration using Hudson for application servers WebSphere 7.x, WebLogic11g and Tomcat7.x
Confidential
Architect/ Technical Lead
Responsibilities:
- Lead the project since inception phase.
- Worked closely with the client and business analysts for getting the requirements.
- Worked closely with Project management team for preparing the project plan.
- Set up proper development environment starting from source control to the concurrent builds.
- Architected all tiers, UI, Business, and database layers.
- Modeled data, designed and implemented database to fit the client’s requirements.
- Designed, developed, and implemented Draw Automation system from scratch using J2EE technologies Java, JSF, JPA, SEAM, EJB3, EQL, IceFaces, Rich Faces, AJAX, jxl, iText, SOA.
- Implemented persistence layer, databases Oracle 10g using Hibernate.
- Wrote build scripts using ANT, for packaging and automated deployment.
- Designed deployment environment for WebLogic 10.3 server on multi operating systems.
- Designed database schema for CAMS, SQL scripts for creating schema.
- Created SIT and UAT environments in the data center.
Confidential
Principal Software Engineer/ Technical Team Lead
Responsibilities:
- Lead the project from functional requirements to release.
- Coordinated with Product, Program, QA, Release Engineering, Application & Implementation, and Project management teams for timely delivery of the product.
- Provided Estimates for developing the product, Patches, Hot fixes and CCR.
- Reviewed functional specifications, workbooks, and User Centric Designs.
- Wrote High Level, discrete Design specifications and release notes.
- Developed enterprise applications using J2EE technologies Java, Servlets, JSP, EJB, JMS, JDBC, JNDI, Struts, AJAX, XML, XSD, XSL, SAX, DOM, JAXP, JAXB, JDOM, JCache.
- Implemented user interface using HTML, DHTML, CSS, Java script.
- Implemented persistence to databases Oracle (8i/9i/10g) using Data Access Objects (DAO ‘s).
- Implemented MQ series, Apache Http Client for enterprise application to communicate with host systems.
- Designed systems for multi-cluster, multi-provider high availability enterprise applications in IBM WebSphere, BEA WebLogic application servers in both windows and Linux environments.
- Designed revision control structure for all modules for current revision, patches and hot fixes for StarTeam revision and bug tracking environment.
- Implemented application’s security of data using Cipher models for PCI Compliance.
- Extensively used MVC tools like Together and Enterprise Architect for designing Enterprise Applications.
- Participated in data modeling discussions and development of database.
- Developed easily scalable, extensible, configurable, customizable, rules-based enterprise applications.
- Developed framework components that serve the needs of all applications within the product.
- Wrote command-line applications for batch jobs like audit extracts in Windows and Linux.
- Provided quick fixes as drop-in ‘s, Hot fixes apart from the patch and release cycles.
- Used third party tools like Daeja image viewers for displaying images of different formats.
- Designed and developed Web services using SOA and WSDL.
- Reviewed QA test plans and supervised QA turnovers.
- Provided technical assistance and reviewed design specifications of all modules for all tiers.
- Lead the development team, assigning tasks and coordinated with other teams.
- Conducted training sessions to other team members both here as well as offshore.
- Provided requirements for the release engineering team for implementing the installer for the applications.
- Worked on application’s security vulnerabilities using web proxy tools like Paros and Burf proxy, multi-cluster environments for fail overs and high availability.
- Detailed system structure in out-source and in-house environments, configuration and integration with other applications.
- Reviewed code for quality, security, scalability, and performance as required.
- Coordinated Product acceptance testing, helped client’s smooth transfer from per production to production environments.
- Actively participated in client’s change requests (CCR/CSM) to accommodate them into mainstream product without compromising for customization.