SUMMARY

• Professional IT Experience of 12 years, including 4 years of work experience in BigData, Hadoop solution architect, design, development and Ecosystem Analytics in Banking and Financial sectors
• Excellent understanding and knowledge of Big Data and Hadoop architecture
• Hands on experience on major components in Hadoop Ecosystem like Spark, MapReduce, HDFS, HIVE, PIG, HBase, Sqoop, Oozie, Flume, Kafka, Tableau
• Strong knowledge in using Map reduce programming model for analyzing the data, implementing custom business logic and perform join optimization, secondary, custom sorting
• Hands on experience writing complex Hive, SQL queries, PIG scripts for data analysis to meet business requirements
• Excellent understanding of NoSQL databases like HBase, Cassandra and MongoDB
• Experience in importing and exporting data using Sqoop from HDFS (Hive & HBase) to Relational Database Systems and vice - versa
• Worked on Spark SQL, Streaming and involved in Performance optimizations in Spark
• Extensive hands-on experience using Informatica Power Center 9.x/8.x/7.x (Repository Manager, Mapping Designer, Workflow Manager, Workflow Monitor,) and SAS EG
• Experience in reporting tools SAP Business Objects (IDT, UDT, Interactive Analysis and BI Launch Pad/InfoView, CMC, CCM, Dashboards, Lumira)
• Certified and Strong experience with MPP database Netezza, its architecture and underlying data distribution
• Experience in using different file formats like AVRO, Parquet, RC, Sequence and CSV
• Worked on Performance Tuning, identifying and resolving performance bottlenecks in various levels
• Able to work collaboratively, quickly understand system architecture and business needs while committed to achieving corporate goals
• Experienced in Agile/Lean and PMI project management methodologies

TECHNICAL SKILLS

Big Data/Hadoop: HDFS, Hive, Pig, Sqoop, HBase, Oozie, Spark

ETL Tools: Informatica, BODS, SSIS, SAS EG

BI Tools: SAP BusinessObjects, QlikView, Tableau

Database: Netezza, Oracle, DB2, SQL Server, MySQL, MS Access

Operating Systems: UNIX (AIX/Solaris), Linux, Windows 2008, AS400

Language: NZSQL, PL\SQL, T-SQL, Shell Script, Java, Scala

Database Tools: SQL Developer, SQL Data Modeler, SSMS, TOAD

Testing Tools: HP Quality Center, Jira, Remedy

Methodologies: PMP, Agile

PROFESSIONAL EXPERIENCE

Confidential, Los Angeles

BigData Senior Analyst/Architect

Responsibilities:

• Gathered business requirements in meetings for successful implementation and moving it to Production
• Analyse the business requirements and converting into technical documentation for easy understanding for the development team
• Job duties involved the design, development of various modules in Hadoop Big Data Platform and processing data using Spark, HBase, Sqoop, Hive
• Implemented POC to migrate MapReduce jobs into Spark RDD transformations using Scala
• Ingested huge amount of ClickStream data into Hadoop using Parquet storage format
• Performed advanced procedures like text analytics and processing, using the in-memory computing capabilities of Spark
• Developed Spark scripts by using Scala shell commands
• Successfully loaded files to Hive and HDFS from Oracle SQL Server using SQOOP
• Worked with Oozie Workflow manager to schedule Hadoop jobs and high intensive jobs
• Extensively used Hive/HQL or Hive queries to query data in Hive Tables and Loaded data into HIVE tables
• Worked closely in setting up of different environment and updating configurations
• Introduced Tableau Visualization from hadoop to produce reports for Business and BI team
• Daily Scrum Meetings with the team for the Updated status and the action plan of the day

ENVIRONMENT: Hadoop, HDFS, HBase, Spark, Spark Streaming, SparkSQL, Pig, Hive, Sqoop, Tableau, Linux, Oracle, Shell Script, Scala

Confidential, Los Angeles

BigData Senior Analyst/Architect

Responsibilities:

• Involved in design, development of various modules in Hadoop Big Data Platform and processing data using MapReduce, Hive, Pig, Sqoop, Oozie
• Designed & implemented Java MapReduce programs to support distributed data processing
• Importing and exporting the data using Sqoop from HDFS to Oracle and vice-versa
• Developed Hive scripts to handle Avro and JSON data in Hive using Hive SerDe's
• Automated all the jobs for pulling data from FTP Server to load data into Hive tables, using Oozie workflows
• Used Oozie to automate the data loading into Hadoop Distributed File System
• Involved in implementation of Hadoop Cluster for Development and Test Environment
• Used different file formats like Text files, Sequence Files, Avro
• Assisted in creating and maintaining Technical documentation to launching HADOOP Clusters and even for executing Hive queries and Pig Scripts.

ENVIRONMENT: Hadoop, MapReduce, Pig, Hive, Sqoop, Linux, Oracle, Shell Script

Confidential

Senior Project Associate

Responsibilities:

• Participated in planning sessions with offshore technical team for resource allocation and capacity planning
• The project requirement is to build a scalable and reliable Big Data platform that will be core component for forthcoming business needs
• Designed & implemented MapReduce programs to support distributed data processing
• Importing and exporting data using Sqoop from HDFS to Netezza and vice-versa
• Developed UDF functions for Hive and wrote complex queries in Hive for data analysis
• Involved in loading and transforming large sets of Structured, Semi-Structured and Unstructured data and analyzed them by running Hive queries
• Loaded and transformed large sets of structured, semi structured data using Pig Scripts

ENVIRONMENT: Hadoop, MapReduce, HBase, Hive, Pig, Sqoop, Netezza

Confidential

Senior Project Associate

Responsibilities:

• Interacting with various internal functional teams and team members to analyze business requirements and to outline the initial setup architecture and reporting solution
• Involved in Dimensional modeling (Star Schema) of the Data warehouse and created conceptual, logical, physical data models
• Involved in building the ETL architecture and Source to Target mapping to load data into Data warehouse
• Created technical ETL mapping documents to outline data flow from sources to targets
• Extracted the data from the flat files and SQL Server databases into staging area and populated onto Data warehouse
• Review existing code, lead efforts to tweak and tune the performance of existing Informatica processes
• Extensively used SQL* loader to load data from flat files to the database tables in Oracle
• Build the new universes as per the user requirements by identifying the required tables from Data Warehouse and by defining the universe connections
• Used Derived tables to create the universe for best performance, and use context and alias tables to solve the loops in Universe
• Created complex reports stating Trading Statistics per month and per year using cascading and user objects like measure objects by using @aggregate aware function to create the summarized reports
• Daily/Weekly/Monthly MAS Regulatory reporting with consolidated exchange statistics for Market Operations Dept and Clearing & Settlement Dept

ENVIRONMENT: Informatica 8.6, SAP BusinessObjects XIR3.1, Netezza, Oracle 11g, PL\SQL, SQL Server 2008, Shell/Batch/VB Script, Linux, Win 2008

Confidential

Senior Consultant

Responsibilities:

• Interacted with business analysts to identify information needs and business requirements for reports Involved in the design of Conceptual
• Logical and physical data modeling of the data warehouse based on star schema methodology, Created Data Models using Erwin
• Scheduling and monitoring Informatica workflows and batches
• Maintenance of mappings and load process, Enhancements of existing mapping and developing new mappings to facilitate change requests
• Responsible for supporting, troubleshooting, Data Quality and Enhancement Issues.
• Debugging, performance tuning of mappings, session recovery and maintenance of workflow jobs in production
• Build the new universes as per the user requirements by identifying the required tables from Data mart and by defining the universe connections.
• Developed critical reports like drill down, Slice and Dice, master/detail for analysis.
• Created complex reports using the multiple data providers and synchronized the data providers by linking the common objects to create the common reports.
• Developed universe user documentation guide for the end users reference.

ENVIRONMENT: Informatica 7.1, Business Objects, SAS Base, SAS EG, Oracle 10g, PL/SQL, DB2, Shell Scripting, Clear Case, Clear Quest, HP Quality Center, Control-M, UNIX, AS400 and Win 2000

Confidential

Senior Consultant

Responsibilities:

• Developed complex mapping using Expression, Aggregate, Lookup, Sequence Generator, Update Strategy, Stored Procedure, Router and Dynamic parameters.
• Implemented slowly changing dimensions to maintain historical data using Type I Type II
• Scheduling and monitoring Informatica workflows and batches
• Responsible for supporting, troubleshooting, Data Quality and Enhancement Issues.

ENVIRONMENT: Informatica 7.1, Windows 2000, Oracle 9i, Erwin, Cognos Series 7 and Cognos Reportnet 1.1 Mr1

Confidential

Developer

Responsibilities:

• Responsible for complete life cycle of the system.
• Responsible client side requirement study, preparation of system specification, requirement specification.
• Responsible for creating application setup, installation, testing and troubleshooting

ENVIRONMENT: HP, MySQL, SQL, Java script, Linux, Apache

Confidential

Developer

Responsibilities:

• Cleaned up and rewrote much of the front end code to meet validation requirements
• Provide detailed project requirements, technical specifications as well as a step by step map for project execution
• Actively participated in all database related activity

ENVIRONMENT: PHP, MySQL, SQL, Java script, Linux, Apache