Hadoop Architect Resume
Dallas, TX
SUMMARY:
- 20 years of professional experience in building Enterprise applications in US.
- Experience in developing software solutions to build out capabilities on a Big Data Platform in Hortonworks and Cloudera.
- Experience in configuring cluster and installing the services, monitoring the cluster by eliminating the compatibility errors.
- Hands - on experience in installing, configuring, and using Hadoop ecosystem components like Hadoop MapReduce, HDFS, HBase, Hive, Sqoop, Pig, Zookeeper, Oozie, Solr and Flume.
- Technical Leader with 15 years of data modeling, database design and data architecture experience
- Experience with UNIX/Linux including basic commands, shell scripting.
- Hands on development and basic administration experience in Oracle 12c/11g/10g/9i/8i/7 RDBS server
- Expertise in Conceptual, Logical and Physical design of both OLTP and OLAP (Data warehouse) databases
- Very strong programming skills in SQL, ANSI SQL, PL/SQL, Database Packages/Procedures/Triggers, ERWIN, Oracle SQL Modeler, Oracle Designer, SQL*Loader, Data Pump and Data Base Administration tools
- Very strong programming skills in In-line Views, Correlated Sub-Queries, Non Correlated Sub-Queries
- Aggregate functions, Merge SQL Commands, User-defined data types and record types
- Expertise in high transaction database modeling, design and development
- Sound knowledge in MySQL, Teradata, MS SQL server and ETL Tools (SAS, Data Stage and INFORMATICA)
- Sound knowledge in BIG data, Hadoop, NoSQL databases, Apache PIG and SQOOP
- Expertise in building J2EE Enterprise applications for financial, medical, automobile, insurance, telemarketing, production planning, MRP II and human resources management industries
- Experience in complete software development life cycle (SDLC) and software maintenance
- Very strong programming skills in Java, Servlets, JDBC, JSP, HTML and JavaScript
- Strong programming skills in EJB, Java/J2EE, Struts framework, Spring Frame Work and Spring MVC
- Sound knowledge in Hibernate, JPA and IBATIS
- Hands on experience in WebSphere App Server 6.x /7.x, Web Logic 9.x/10.x, RAD 7.x/8.x and WSAD.
- Strong programming skills in Business Objects and Crystal XI
- Sound knowledge in RUP and Agile methodology- SCRUM, Rational Tools and Eclipse IDE
- Experience in onshore-off shore around the clock project development and maintenance model
- Excellent written and verbal communication skills
- Dedicated and self-motivated achiever, an efficient team-player, focused, and goal-oriented with a clear vision of future objectives who is committed to high-quality delivery.
TECHNICAL SKILLS:
Big Data/Hadoop Technology: HDFS, YARN, MapReduce, Hive, Pig, Sqoop, Flume, Spark, Zookeeper and Oozie in Hortonworks HDP 2.x and Cloudera.
NoSQL Database: HBases, Cassandra, MongoDB
Languages: C, Java, Python, SQL, PL/SQL, Pig Latin, HiveQL, Java Script, Shell Scripting,Java & J2EE Technologies Core Java, Servlets, Hibernate, Spring, Struts, JMS, EJB, RESTful
Application Servers: Web Logic, Web Sphere, JBoss, Tomcat.
Databases: Oracle, MySQL, Teradata, DB2, Microsoft SQL Server
Operating Systems: UNIX, Windows, LINUX
Build Tools: Jenkins, Maven, ANT
Business Intelligence Tools: Business Object, Crystal, TableauDevelopment Tools: Microsoft SQL Studio, Eclipse, NetBeans, IntelliJ
Development Methodologies: Agile/Scrum, Waterfall
Version Control Tools: SVN, CVS, Clear Case. VSS
PROFESSIONAL EXPERIENCE:
Confidential, Dallas, TX
Hadoop Architect
Responsibilities:- Work with business stake holders and business analysts to create conceptual and logical design.
- Perform data modeling and design for Chase Mortgage, HELOC and Auto loan applications.
- Create database design artifacts, ERD, DFD, conceptual, logical and physical designs using ERWIN for various databases, Oracle and MySQL.
- Design data warehouse for star schemas, dimensional, bottom-up Kimball approach
- Design architecture for ETL loads.
- Lead and hands-on effort in Develop, Test and Optimize about 300 Oracle APIs-business logic units in PL/SQL
- BMC Control M designs and implementation for project automation.
- Conversion of SQL Server database procedures into Oracle database packages in PL/SQL using MS visual studio and TOAD.
- Source code control of Oracle APIs, Database packages, Triggers, DDL, DML and DCL scripts in Subversion.
- Integration of Oracle application with TERADATA data warehouse used for Tableau business intelligence for Confidential mortgage services.
- Worked on transfer of Oracle data to company’s new initiative on BIG Data - Hadoop echo system in Hortonworks.
- Provided level-3 production support using JIRA and HP ALM.
- Implementation of projects using Agile SCRUM product development strategy.
- Mentor and train junior staff in the team.
- Demonstrated competence around the areas of product knowledge, relationship building, professionalism and personal excellence, leadership, people focus, and business development.
Confidential, Chicago
Hadoop Architect/ Solution Architect
Responsibilities:- Perform data modeling and analysis for NT Compliance Analyst and Liquidity applications.
- Work with business stake holders and business analysts to create conceptual and logical design.
- Participates in facilitating the definition of project scope, goals and project deliverables.
- Create data modeling artifacts using ERWIN for OLTP and OLAP (Data warehouse) projects.
- Create detailed design for new projects. Generate DDL, DML, DCL scripts for both traditional and dimensional
- Create design artifacts and documentation in UML (ERD, DFDs, Sequence diagrams, Class Diagrams…)
- Design and create database tables with partitions to store billions of rows.
- Code and Test several database packages with several stored procedures and functions.
- Develop and test Data Stage (ETL) Jobs to extract data into data repository and Oracle database from upstream systems.
- Written a number of shell scripts to automate data extraction from several upstream systems Bloomberg, AIP, NDR and OTC DataMart
- Work on project automation using Control M scheduler.
- Write and optimize several SQL queries and database views for batch processing.
- WebLogic 10.x administration tasks. Guide QA team to test the software components developed.
- Involved in unit testing, integration testing, feature testing and Regression testing.
Confidential
Technical Lead/ Data Architect
Responsibilities:- Perform data modeling and analysis for a 4 Terabytes OLTP data model.
- Create database design with integrity constraints and triggers.
- Create design artifacts and documentation for OLTP and Data warehouse
- Work with business stake holders and business analysts to create credit models
- Design and create database tables with partitions to store billions of rows.
- Perform basic database administration on DEV and QA instances.
- Develop over 30 database packages with dozens of stored procedures and functions.
- Written several SQL*Loader script to migrate data from legacy databases.
- Written a number of shell scripts to automate data loads from CSV files.
- Write and optimize hundreds of SQL queries and database views for Java/J2EE UI interface.
- Design data warehouse for star schemas, Top-down Inmon methodology
- Develop and implement data integration architecture with OLAP database using SAS.
- Develop technical detail design for all the major tasks.
- Assign tasks to team members onsite/offshore and monitor status till completion.
- Conduct project status and follow-up meetings and discussions.
- IBM application server WebSphere 7.x administration tasks
- Perform root cause failure analysis and recommend resolutions.
- Mentor and guide junior team members onsite/offshore.
- Guide QA team to test the software components developed.
- Involved in unit testing, integration testing, feature testing and Regression testing.
- Participate in software gap analysis with business analysts and product managers.
Confidential, Chicago
Technical Lead/Application Architect
Responsibilities:- Work with business users and business analysts to develop requirements and translate requirements into technical designs.
- Functional analysis, data modeling and database design for Oracle 11g RDMS Databases.
- Data migration from legacy systems and other DBMS Systems.
- Research advanced concepts to develop reusable solutions to recurring problems.
- Work with product managers on capacity planning.
- Participate in software gap analysis with business analysts and product managers.
- Created several DB packages, stored procedures, functions, and triggers
- Wrote large number of Oracle queries. Heavy coding effort in PL/SQL. Data base administration
- Analyze functional requirements, Use Cases and technical specifications for J2EE Architecture and design
- IBM application server WebSphere 6.x administration tasks
- Preparation of design documents in UML
- Lead and mentor developers in the team
- Implementation of Struts MVC pattern frame work using Struts2
- Unit testing using JUnit
- Involved in unit testing, integration testing, feature testing and Regression testing
- UNIX and Shell scripts, Source control management in Subversion
Confidential
Team Lead and Solution Architect
Responsibilities:- Conduct sessions/interviews with the business side to secure detailed information pertaining to application and data usage.
- Worked both directly with business users and with business analysts to develop requirements and translate requirements into technical design
- Functional analysis, data modeling and database design for Oracle 11g RDMS Databases
- Preparation of design documents in UML
- Weekly communication and reporting of project status risks and issues
- Construct and optimize complex SQL queries
- Heavy coding effort in PL/SQL
- Assign tasks to team members onsite/offshore and monitor status till completion.
- Mentor and guide junior team members onsite/offshore.
- Guide QA team to test the software components developed.
- UI coding efforts in JSP, JavaScript and HTML
- Develop applications using Spring MVC pattern frame work.
- Integration with IBM MQ series
- Used SOA and Web services for importing BOM structure from TEAMCENTER application
- Develop WSDLs, SOAP.
- Heavy hands on programming efforts in control and UI layer.
Confidential, Chicago
Solution Architect
Responsibilities:- Analyze functional requirements, Use cases and technical specifications.
- Application architecture and design.
- Preparation of design documents in UML.
- Research advanced concepts to develop reusable solutions to recurring problems.
- Construct and optimize complex SQL queries.
- Go to guy in the team for Oracle queries, stored procedures, functions, packages and triggers.
- Implementation of Spring MVC pattern frame work.
- Data management and persistent layer development in open source ORM tool IBATIS.
- Implementation of Dependency Injection using Light weight Spring frame work
- Heavy hands on server side programming efforts in Java.
- UI coding efforts in JSP, AJAX, JavaScript and HTML.
- Extensive coding efforts to develop oracle data base packages and IBATIS mapping files.
- Design and develop SSL encryption and single sign on features of the application.
- Rational tools Clear case and Clear quest for source control and defect tracking.
- Mentor junior programmers in the team.
Confidential, Chicago
Application Architect
Responsibilities:- Data migration and data loading programs in Oracle environment
- Conversion of Oracle PL/SQL systems into J2EE Application.
- Written a number a Database packages and triggers in PL/SQL
- Data modeling and database design focused on Oracle environment
- Installation, administration and maintenance of Oracle 10G Database for the development and QA environment
- Construct and optimize complex SQL queries
- Analyze functional requirements, Use Cases and technical specifications
- Preparation of design documents in UML
- Implementation of Struts MVC pattern frame work using Action Servlets and JavaBeans
- Data management and Persistent layer development in open source ORM tool Hibernate
- Implementation of Dependency Injection and AOP using Light weight Spring Frame Work
- UI coding efforts in JSP, JavaScript and HTML
- Extensive programming efforts in server side Java business layer
- Rational tools Clear case and Clear Quest for version control and defect tracking
- Mentor junior programmers in the team, both onshore and offshore.
- Involved in unit testing, integration testing, feature testing and Regression testing
Confidential, Chicago
Senior Oracle/ Java/J2EE Consultant
Responsibilities:- Analyze functional requirements, Use Cases and technical specifications.
- Implementation of MVC pattern in Struts frame work and Tiles using Action Servlets and Java beans
- Data management and Persistent layer development in open source ORM tool Hibernate
- Implementation of Inversion of Control and AOP using Light weight Spring frame work
- UI coding efforts in JSP, JavaScript XML, CSS and HTML
- Rational tools for defect tracking and version control
- Construct complex SQL queries in Oracle and DB2
- Conversion of legacy reports into Crystal4Eclipse in J2EE environment
- Developed Business Object report designs.
- Perform administration on WebLogic app server for QA and DEV environment
Confidential, North Brook
Application Architect
Responsibilities:- Worked directly with business users to develop requirements and translate requirements into technical design
- Analyze functional requirements, Use Cases and technical specifications.
- Develop design documents in UML
- Weekly communication and reporting of project status risks and issues
- Detailed design review and introduce best practices for the new application development.
- Mentor junior programmers in the team
- Used RUP software development methodologies
- Construction and programming of business layer in EJB 2.x Session beans
- Implementation of MVC pattern in Struts frame work and Tiles using Action Servlets and Java beans
- Heavy UI coding efforts in JSP, JavaScript XML and HTML
- Data modeling and database design focused on Oracle environment
- Oracle 10g Administration, write and optimize complex SQL queries
- Intensive coding efforts in PL/SQL for OLAP, batch process, data migration and data integrity
- Crystal XI Administration