Spark/akka Developer Resume
3.00/5 (Submit Your Rating)
Irving, TX
PROFESSIONAL SUMMARY:
- Around 3 years of professional experience in IT, in different phases of Software Development Life Cycle, involved mainly designing, development/implementation, testing and maintenance.
- Experience working on Hadoop Ecosystem i.e., MapReduce, Hive, Impala, Flume, Sqoop, Oozie, Kafka, Zookeeper and spark Systems, Scala and Storm.
- Developed Spark jobs using SCALA and Spark - SQL for faster testing and processing of data.
- Excellent understanding and knowledge of NOSQL databases like HBase, MongoDB and Cassandra.
- Hands on experience on Java8,Scala and Play/Akka framework.
- Experience working with Redis.
- Hands-on experience with message brokers such as Apache Kafka.
- Worked with Solr Fusion, Elastic search, LogStash, Kibana and Banana.
- Hands on experience in RDBMS, and Linux shell scripting
- Experience in using version control tools like GIT,SVN.
- Comprehensive knowledge in design patterns like DAO, Singleton, Front Controller and implementation of MVC architecture using struts for reusing the most efficient and effective strategies for effective development.
- Excellent interpersonal and communication skills, creative, research-minded, technically competent and result-oriented with problem solving and leadership skills.
PROFESSIONAL EXPERIENCE:
Confidential, Irving, TX
Spark/Akka Developer
Responsibilities:
- Experienced working with different Big Data analytic tools including Hive, HBase, Oozie, Sqoop, Kafka, Spark .
- Experience in developing prediction models using Spark.
- Experience in loading data from Hive/SQL and performing spark transformations using Spark RDDs, Scala.
- Experience working with DateFrames and Datasets in Spark.
- Hands on Experience working with Spark UDFs and UDAFs.
- Worked with Spark-streaming, reading data from Kafka, transforming and ingesting into Elastic Search.
- Worked with Play framework and Akka parallel processing.
- Experience developing rest APIs.
- Hands on experience working with lambdas and Java8.
- Experience working with non-blocking reactive pattern with ComputableFuture, CompletionStage classes.
- Used Play Logger to integrate it with ELK stack.
- Used Kibana to view logs from Elastic search.
- Hands on experience in Multithreaded programming using akka actors .
- Used sbt for build and packaging.
- Involved in production support of various applications & Responding immediately for fixing code bug issues, Escalation, Enhancement .
- Worked in Agile environment with active scrum participation
- Used Stash(Git) for Version control.
Environment: Scala, spark, Kafka, Hive, Horotonworks, oozie,play framework,akka, Git, ElasticSearch, Logstash, Kibana,redis, Kerberos.
Confidential
Hadoop Developer
- Involved in creating Hive Tables, loading with data and writing Hive queries which will invoke and run Map Reduce jobs in the backend.
- Designed and implemented Incremental Imports into Hive tables.
- Very good understanding of Partitions, Bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance.
- Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.
- Experience in both SQLContext and SparkSession
- Used Spark API over Hadoop YARN to perform analytics on data in Hive.
- Worked on different file formats like Sequence files, XML files and Map files using Map Reduce Programs.
- Experience creating dashboards on Tableau.
- Used Zookeeper to co-ordinate cluster services.
- Implemented the workflows using Oozie to automate tasks.
- Experience working with different data formats including parquet,avro and ORC.
- Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability.
Environment: Hadoop, HDFS, Pig, Hive, Sqoop, Flume, Kafka, Spark, Shell Scripting, HBase, Scala, Kerberos.
Confidential
Java Developer
Responsibilities:
- Involved in various phases of Software Development Life Cycle like requirement gathering, design, analysis and code development
- Developed Use Cases, Class Diagrams, Activity Diagrams and Sequence Diagrams..
- Developed Java Server Pages (JSP) for the front end and Servlets for handling Http requests.
- Worked with Tomcat Server for deployment.
- Developed Graphical User Interfaces using XML and used JSP's for user interaction
- Used JSP custom tags and Stored Procedures in the web tier to dynamically generate web pages .
- Used SVN as version control and Ant to build the J2EE application.
- Developed JUNIT test cases.
- Worked on Oracle to perform DML and DDL operations .
- Involved in Unit Integration, Pre-Production testing, Client Acceptance Tests and Approvals .
Environment: Java, J2EE, Eclipse IDE, Spring 3.0, JavaScript, JPA, JSON, XML, JAXB, WebSphere, MySQL, PL/SQL, iBATIS, SOAP/Restful Web service, Ant, SVN