Big Data Solution Architect Resume
SUMMARY:
- Over 11 years of experience in Information Technology Industry.
- Worked as a Big Data Architecture, Admin, Developer, Analyst, and Programmer in variety of industries.
TECHNICAL SKILLS:
Languages: Java, C#.
Hadoop Core: HDFS, MapReduce, YARN.
Hadoop ecosystem: Hive, Pig, Hbase, Sqoop, Flume, ZooKeeper, Oozie, Ganglia, Nagios, R, RHadoop, Mahout, Kafka, Storm, Spark, Solr, Banana, Drill, Knox, Tableau.
Hadoop Cluster: Setup, Chef, Installation, maintainance, Cloudera, Hortonworks, Apache Hadoop, Amazon EC2
Web tech: J2EE, Web Services, REST, HTTP, XML, Javascript, CSS.
Mobile Tech: MobileWeb.
Databases: HBase, Cassandra, MongoDB, Riak, Sql Server, MySQL, Oracle.
Web Servers: Web Sphere, Tomcat, Jboss.
Version Tools: Visual Source Safe, SVN.
OS: Windows, Linux/Unix.
Process: CMM, ISO, Agile.
PROFESSIONAL EXPERIENCE:
Confidential
Big Data Solution Architect
Environment: HDP, Hadoop, HDFS, Map Reduce, Hive, Flume, Kafka, Storm, Solr, Banana, HBase, Oozie, Java, Tableau, R, Mahout, Machin Learning, Revolution R, node.js, Spark, Drill, Knox, Linux CentOS/SELS.
Responsibilities: Architecture, Administration, Development, Data Analytics
- Architecture, End to End implementation.
- Kafka producer events generation, broker simulation, isolating topics, event parsing, Kafka Spout Configuration.
- Storm Topology creation, Schema development and HDFS, HBASE, Health Monitor Bolts Implementation.
- Hive DDLs, Partitions creation on files.
- Visual Analytics using Tableau.
- Architecture, end to end implementation.
- Twitter Api Creation, Search Api, Power Stack Api implementation, Acquisition of Historical Data.
- Live stream ingestion with Flume.
- Hive implementation on tweets. Data indexed with Solr.
- Data cleansing with RHadoop, Machin Learning technics applied on tweets data like TFIDF, KMeans Clustering.
- Performed sentiment Analysis.
- Visual Analytics with Banana on top of Solr Index and with Tableau.
- Architecture, end to end implementation.
- Data ingestion from Main Frames, Teradata, Oracle to HDFS.
- Hive Implementation with Partitions.
- Linear Regression Models, Predictive analysis with R.
Confidential
Big Data Infrastructure Consultant
Environment: Hadoop, HDFS, Map Reduce, Chef, Ruby, Ganglia, Hive, Flume, Oozie, Java, Riak, Linux CentOS.
- Architecture end to end Admin, development and support of Hadoop, Riak.
- Currently working on Hadoop 2.x of Hadoop.
- Experienced in Cluster Setup, Chef provisioning and administering Hadoop, Riak clusters.
- Administrating core components Name Node, Resource Manager, Node Manager, Data Node and SNN.
- Managing Hadoop and Riak Clusters, checking cluster Health, Version Upgrades.
- Strong experience in performance tuning, troubleshooting.
- Setting permissions, Commissioning, Decommissioning, Balancing, and Managing Nodes.
- Setup and monitoring tools Ganglia and Nagios
- Analytics implemented with using Map Reduce programming (MPP), Java, Hive scripting.
- Worked on Continuous data ingestion/integration tools with Jenkins, Oozie, and Flume.
- Experience on Disaster Recovery(DistCp) implementation for Hadoop
- Involved in setup and maintenance of Hadoop clusters for Dev and Prod environments.
Confidential
Big Data Consultant
Environment: Hadoop, HDFS, Map Reduce, Hive, Pig, HBase, Sqoop, Flume, Oozie, Java, J2EE, ZooKeeper, Splunk, Cassandra, Chef, CDH3/4, Amazon EC2, Cloud Computing, R&D, Linux CentOS, Windows.
- Installation, end to end Admin, development and support of Hadoop, hive, Pig, Sqoop, HBase, Oozie & related Hadoop stack.
- Providing analytical dash boards, reports and POC’s to the Directors, Service Managers and stack holders. And participate and presenting the work progress of the System.
- Worked on Design patterns like summarization, bloom filtering, join and Meta Patterns.
- Analytics implemented with using Map Reduce programming (MPP), Java, Hive and Pig scripting.
- Worked on Continuous data ingestion/integration tools with Sqoop, Flume.
- Experience on HBase, MongoDB and Cassandra NoSQL databases.
- Solid understanding and experience with extract, transform, load (ETL) methodologies.
- Currently working on Cloudera distribution of Hadoop.
- Experienced in installing, Chef configuring, monitoring and administering Hadoop, Cassandra clusters.
- Administrating core components Name Node, Job Tracker, Task Tracker, Data Node and SNN.
- Managing Hadoop Cluster, checking cluster Health, Version Upgrades.
- Tuning and performance improvement of cluster
- Migrating data from one cluster to another using distcp
- Involved in setup and maintenance of Hadoop clusters for distributed dev/staging/production.
- Created scripts to form Amazon EC2 clusters and for processing to the internal resources.
- Onsite & Offshore team management and call rotation
Confidential
Lead Consultant
Environment: Java, J2ee, Spring MVC, Mobile Web, JavaScript, jQuery, CSS3, IBM RSA, JAX - RS, Jersey, Web Sphere, SVN, Web Services, AJAX, UI, XML, HTML, Agile/Scrum, Windows XP/2007.
Supporting Tools: HP Service Manager, Diagnostics, BAC, Splunk Business Intelligence and Warehouse analysis, THS Tracker, JRF Data Tool, and Tealeaf.
Responsibilities:
- Proposed design patterns and emerging technologies to support application development projects.
- Worked on front end tools JQuery, JSON, and JSTL and with style sheets CSS3.
- Creating and consuming REST and SOAP Web Services.
- Performing the maintenance work of the j2ee applications as per the stipulations listed by the firm.
- Worked with JEE controller frameworks (Spring MVC, DDUI, Struts).
- Supporting and monitoring live-deployed production environments supporting high concurrent user load.
- Triaging Auto Quote Purchase prod issues through Technical Observation Post.
- Production support, Root Cause Analysis, Clustering, Assigning tasks for related teams and escalation.
- SME in Service, Problem, Incident, and Request tickets Management, Metrics and reports.
- Checkout for infrastructure, implementation and maintenance windows.
- Coordinated with development and testing teams to complete applications. Onsite & Offshore team management and call rotation.
Confidential
Social Telephony Architect
Environment: Java, J2EE, Python, Web Services, Face book API, Visio, MySQL, .Net CF, Windows Mobile SDK, Windows XP/2003, Linux/Unix, WAS, JavaScript, CSS.
Responsibilities:
- Architecture, Created detailed workflows, prototypes and the requirements that effectively communicate the interactive design.
- Understand and explore the market products and Come up with innovative ideas.
- Created the formulated product visually with Visio, PowerPoint tools.
- Implemented the Call flow Apps like Community Call, Click 2 call, Messaging, Voice monetization, Parental control, Voice micro blogging, Virtual numbers.
- Created Traceability matrix, Reviewed the tasks time to time.
- Face Book, Twitter, Pudding media Integration.
- Developed all Apps for Windows mobile environment and Implemented web service.
- Implemented web application for managing subscriber's information.
Confidential
Programmer
Environment: Java, J2EE, Web Services, SQL Server, Windows, Web Sphere, JavaScript, HTML, VSS
Responsibilities:
- Created composite web custom controls for easy reuse.
- Server -side validation utilizing J2ee controls.
- Extensive use of Web services.
- Involved in migration of ASP application to J2EE
- Design and development of Web pages using JSP, JScript, HTML, DHTML, JDBC and XML.
- Extensive user of Stored Procedures, Triggers.
Confidential
Sr Consultant
Environment: ASP.NET, C#, Web Services, Dexterra 4.5, Windows Mobile, .NET CF, SQL Server CE2.0/3.0.
Confidential
Software Engineer
Environment: .NET, ASP.NET, C#, DNN, ADO.NET, SQL Server2000, Crystal Reports.