SUMMERY

• Seasoned Professional with 11 years of IT experience including
• Experience and deep understanding of overall Hadoop eco system tools like HDFS, Map Reduce, Pig, Hive, Sqoop, Oozie, Yarn, Hue and Spark
• Experience and deep understanding of Spark, Spark Streaming and Spark SQL with Scala
• Experience and deep understanding of Qlikview end to end setup, schedule and developing dashboards, reports
• Experience in designing and developing data ingestion using apache NiFi, Apache Camel, Spark Streaming, Kafka, Flume, Sqoop and Shell Script
• Experience in to build Hadoop cluster and development using AWS EC2 and S3 cloud technology
• Experience in to build Hadoop applications using Lambda architecture
• Experience in designing and developing solutions using Hadoop,AngularJS,.Net, and Qlikview
• Experience in design end to end setup of Hadoop cluster using Cloudera, Hortonworks distribution and plain apache Hadoop
• Experience in working with RDBMS(Microsoft SQL Server, Oracle, and MySql),Vertica,Terdata and NoSQL(HBase)
• Experience in developing Web and Windows applications, Client - Server technology using Microsoft .NET technologies
• Conceptual understanding and implementation experience of Java and .NET projects using N-Tier Client/Server Architecture, Service Oriented Architecture (SOA) and Model View Controller (MVC)
• Experience in build and deploy teh code into production servers using NANT and shell script
• Strong experience in leading & managing large onsite/offshore teams
• Google Analytics, ecommerce, Airline Cargo, Banking, and Finance domain experience & knowledge
• Experience in requirements gathering & translating business requirements into low level documents
• Experience in Agile framework with Jira and TFS as scrum master
• Excellent communication, interpersonal and presentation skills
• Experience of working with UK clients at client location

TECHNICAL SKILLS

Primary Technical skills: Spark, Scala, HDFS, MapReduce, Hive, Pig, Azkaban, Flume, Sqoop, Oozie, Cloudera, Hortonworks, Amazon S3, Java, Java Spring, JSP, Apache Camel, NiFi, QlikView, Python, Kafka, Solr, YARN, ASP.NET, VB.NET, C#.NET,WCF,AJAX, Web Services, MVC, JavaScript, AngularJS JSON, JQuery, XML, HTML, CSS, HBase (NoSQL), MySql, Microsoft SQL Server, Oracle, Eclipse, Microsoft Visual Studio, GitHub, Visual Source Safe, TFS, Agile, SDLC, IIS 5.0/6.0/7.0, nANT Script 9.0, Power shell script

Secondary Technical Skills: C, Zookeeper, Node JS

OS: Windows, Linux

RDBMS: MS SQL Server 2005/2008/2012/2014, Oracle, MySQL

Industries: Finance, Google Analytics, Airline Cargo, Ecommerce, Banking, Software Services

PROFESSIONAL EXPERIENCE

Hadoop Architect

Confidential

Responsibilities:

• Write spark jobs to pull data from Teradata and .dat files using scala
• Improve teh performance of existing spark jobs using different spark and Teradata options to handle ~200GB of data for one month
• Write Hive queries to enable data for modeling
• Write shell script to automate Spark or Sqoop jobs to run for 12 years of data one month at a time.

Senior Technical Architect

Confidential

Environment: Hadoop, Java Spring, Apache Camel, Apache NiFi, Hive, Spark, Scala, HDFS, Oozie, Hue, Oracle, AngularJS, JavaScript, HTML, Java server Page, JQuery, QlikView, IntelliJ, Eclipse, Java

Responsibilities:

Confidential

Quantitative Finance Risk Management

Responsibilities:

• Providing architectural support to Big Data and Qlikview projects
• Developed risk engine using spark, Scala, Hive, Cloudera time series and Oracle
• Developed data Importer using Apache camel, Java spring and Groovy
• Developed Stress testing UI using AngularJS, JavaScript, JQuery, HTML5 and JSP
• Giving high level development support to teh team members
• Big Data, AngularJS UI and Qlikview design and development
• Project Manager and Senior Technical Architect
• Developed a POC for delta airline to upgrade project from Informatica to Bigdata using AWS EC2 cluster, Hive, Tez, Horton works, Impala, Spark with Scala
• Developed POC to test Apache NiFi fits to import data for QFRM project
• Developed POC to connect Stress testing UI to Hive instead of Oracle and Connect Qlikview to Hive instead of Oracle
• Modified whole Qlikview script to improve dash board performance.
• Member of Interview panel for Big Data / Hadoop recruitment

Technical Lead

Confidential

Responsibilities:

• Providing architectural support to big data projects
• Worked on multiple projects and POCs using Hadoop, Pig, Hive, Oozie, Python, Azkaban, Node JS, AngularJS, Shell Script, Oracle, Hue, Spark, Scala, Solr, MySQL Cloudera, Horton works and AWS EC2 (S3)
• Hadoop design and development
• Hadoop Technical lead and Senior developer
• Member of Interview panel for Big Data / Hadoop recruitment

Software Dev Staff Enginer

Confidential

Responsibilities:

• Design and develop big data project Manage and support Hadoop cluster
• Developed Confidential project using Hadoop, MapReduce, Pig, Hive, Sqoop, HBase, SQL Server, Cloudera
• Technical lead, scrum master and manage teh technical requirements
• Code review, manage TFS check-ins and support production incidents on .NET project
• Deploy .NET project code into Dev, SIT,UAT,PROD severs
• Document and support production servers disaster recovery test
• Responsible for production servers web server level incidents and failures
• Train and mentor new team members on business knowledge

Senior Consultant

Configurator

Responsibilities:

• Support production incidents on .NET project
• Deploy .NET project code into Dev, SIT,UAT,PROD severs
• Document and support production servers disaster recovery test
• Responsible for production servers web server level incidents and failures

Sr. Software Engineer

Confidential

Responsibilities:

• Design and development new requirement
• Develop JAWS on web application
• Develop multi language support web application

Sr. Software Engineer

Confidential

Responsibilities:

• Get requirements from clients and design requirement document
• Explain client requirements to developer and manage RTS product for multiple clients
• Technical lead and manage teh 3-5 members team
• Design database tables and write database scripts based on requirement
• Design and develop windows and web based applications
• Trained and mentored new team members on business knowledge
• Manage RTS Production team with support tickets resolved within SLA limits