Big Data/hadoop Application Architect Resume
Chicago, IL
SUMMARY
- Over twelve years of pragmatic experience within the Information Technology industry as Solution Architecture, Technology Lead and System Analyst in insurance, life science, retail/ecommerce and finance sectors.
- Proven delivery track record involving streamlining of organizational processes and procedures, building strong teams, leading staff toward maximum potential and on - time delivery of projects.
- Managed delivery of large project teams and known for high-quality deliverables that meet or exceed timeline and budgetary targets.
- Expertise in Big Data Ecosystem with hands-on experience in installing, configuring and administrating Hadoop Distributed File System (HDFS) cluster on in-house data center, Amazon EC2 and Virtual Machines.
- Hands-on experience in installing, configuring and using HDFS ecosystem components MapReduce, Sqoop, Pig, Hive, MySQL metastore and NoSQL databases including HBase, Cassandra, MongoDB.
- Expertise in IBM InfoSphere Information Server’s (IIS) family of product (DataStage, QualityStage) technology coupled with a strong working knowledge on Big Data, Mainframes & Teradata.
- Strong knowledge and understanding of Data Warehouse, Business Intelligence, Enterprise Database Integration and Management, with various databases like DB2 UDB, Teradata, Datacom, Oracle, Netezza.
- Exceptionally organized, proven track record for outstanding results, and self-motivated
- Excellent troubleshooting and analytical abilities, outstanding interpersonal and communication skills
- Ability to grasp and adapt to new environments in short time frame.
TECHNICAL SKILLS
Environment: MVS OS/390, MS-DOS, Windows, UNIX, IBM AIX & Red Hat Enterprise Linux
Big Data/Hadoop Ecosystem: Hadoop 1.X, 2.X (Hortonworks HDP 2.X, Cloudera CDH4/5), MapReduce, Sqoop, Hive, Apache Pig, HBase, Cassandra, MongoDB
ETL Tool: IBM InfoSphere DataStage & Quality Stage 11.3/9.1/8.5 /8.0/7.5.2 , Teradata Utilities on Mainframe (BTEQ, FEXP, FLOAD, MLOAD & TDM)
Mainframe Tools/Utilities: Endevor, Elips Librarian, Change Man, Xpediter, SPUFI, QMF, PST, Platinum, Mapr, VSAM, File Aid, Natural, CICS
Languages: C, C++, Java, JSON, Python, Visual Basic, VS COBOL II, JCL, SQL
Data Modeling: CA ERwin, ER/Studio, Power Designer
Database: DB2 UDB, Teradata, Datacom, Sybase, Oracle, Netezza, MySQL
Reporting & Analytical Tools: Cognos, DB2 Cubing Services, MicroStrategy, QlikView & Tableau
Scheduling Tools: Control-M, Active Batch, Autosys, Zeke & Zena
Project Management: MS Office Suite, MS Project, MS Visio, Clarity
PROFESSIONAL EXPERIENCE
Confidential, Chicago, IL
Big Data/Hadoop Application Architect
Responsibilities:
- Requirement gathering and analysis, prototyping on Big Data tools and technologies using Hadoop Ecosystem.
- Interact with business teams to understand requirements and propose solutions.
- Analyzed the source and the target systems to aid the design of the Operational Data Warehouse.
- Oversee the development of low-level design to depict the functionality of each individual system.
- Involved in capacity planning & aided HDFS Cluster sizing.
- Handled importing of data from various data sources using Sqoop, performed transformations using Hive, Pig and loaded data into HDFS.
- Designed and Implemented Data Warehouse in Hadoop Ecosystem using HiveQL
- Converted existing RDBMS reporting Views to Hive Views and Hive Tables.
- Performance tuning of Hive Tables/Scripts for reporting needs.
- Conducted performance analysis and optimized the jobs performance.
Environment: Hortonworks HDP 2.1, MapReduce, Sqoop, Hive, Apache Pig, Cassandra, Java, JSON, Python, Red Hat Enterprise Linux, IBM AIX, IBM InfoSphere DataStage 11.3/9.1/8.5 , CA ERwin, HPDM, DB2, Teradata, Zena, Tableau, MS Office Suite, MS Project, MS Visio, Clarity
Confidential, Northbrook, IL
Application Architect
Responsibilities:
- Interact with business teams to understand requirements and propose solutions.
- Reviewed current state of architecture and made recommendations to improve quality and performance.
- Responsible for establishing data modeling, data integration and enterprise information management standards and techniques.
- Interact with senior business executives to ensure the successful flow down of business requirements to projects for implementation.
- Developed high level systems and functional requirements for enterprise systems
- Supervise activities of leads & resources, ensuring status reporting & achieving delivery milestone.
- Defining the roles of team members in Project Management Plan
- Task allocation and performance management of team members
- Management of risks & status reporting to management and client.
Environment: IBM AIX, IBM InfoSphere DataStage 8.5/8.1, Oracle, Netezza, Power Designer, Active Batch, QlikView, MS Office Suite, MS Project, MS Visio, Clarity
Confidential, Miami, FL
Application Architect
Responsibilities:
- Developed tracking and reporting process, led project review meetings and maintained project history.
- Worked closely with the project team to ensure we meet our project deliverables.
- Created business process improvement documents for the deliverables.
- Manage the project scope, delivery, quality levels and cross functional teams as required for integrated and enhancement release projects.
- Reviewed current state of solution and architecture and made recommendations to improve quality and performance on project.
- Tracking requirement delivery, project management and reporting project status
- Directly interact with business to understand requirements and propose and implement solutions supporting marketing and analytics initiatives.
- Led the effort of developing the proof-of-concepts (POC) to build effective alternate solutions using DataStage where other OOTB (out of the box) solutions performed slower with lower than expected throughputs.
- Task allocation and performance management of team members
Environment: IBM AIX, IBM InfoSphere DataStage 8.5, CA ERwin, Oracle, DB2, DB2 Cubing Services, Autosys, Cognos, MS Office Suite, MS Project, MS Visio
Confidential, Duluth, GA
Lead Consultant
Responsibilities:
- Leading the Enhancement & Production support team from onshore.
- Analyzing the system and designing the solution specification documents.
- Facilitated & Involved in business requirements gathering meetings.
- Involved in preparation of Test Environment for the development team.
- Participated in Project Meetings & Knowledge Sharing Sessions.
Environment: IBM AIX, IBM InfoSphere DataStage 8.1, Teradata, ER/Studio, Oracle, DB2, Autosys, Cognos, MS Office Suite, MS Project, MS Visio
Confidential, Atlanta, GA
Application Lead Consultant
Responsibilities:
- Responsible for the end-to-end delivery of application development, testing and implementation that will/can affect the overall customer user experience.
- Supervise activities of leads & resources, ensuring status reporting & achieving delivery milestone.
- Responsible for preparing Change Request (CR) & statement of work (SOW)
- Responsible for coordinating and approving all change control activities
- Defining the roles of team members in Project Management Plan
- Task allocation and performance management of team members
- Management of risks & status reporting to management and client.
- Development of project as per Plans based on Implementation of SDLC & QMS in projects
- Led the Development, Enhancement & Production support team from onshore and offshore.
- Handled the tasks of providing technical direction for developing, designing and integrating systems.
- Facilitated & Involved in business requirements gathering meetings.
- Analyzing the system and designing the specification documents.
- Involved in extensive knowledge sharing sessions with client at client site
- Managed SDLC for all enhancements and defect fixes after go live.
- Served as a liaison between program manager and development staff.
Environment: IBM AIX, IBM InfoSphere DataStage & Quality Stage 8.1/8.0, Teradata Utilities on Mainframe (BTEQ, FEXP, FLOAD, MLOAD & TDM), MicroStrategy, CA ERwin, MVS OS/390, VS COBOL II, JCL, CICS, DB2, Teradata, Oracle, Datacom, Sybase, Xpediter, Endevor, Elips Librarian, SPUFI, VSAM, File Aid, Zeke, Zena, MS Office Suite, MS Project, MS Visio, Clarity
Confidential
Application Developer
Responsibilities:
- Handled the tasks of identifying system deficiencies and implementing effective solutions.
- Understanding the current business functionality, conduct Confidential analysis and requirements tracking
- Member of the pilot team to develop the prototype components.
- Develop and implement new COBOL modules, model procedure for the company.
- Preparation of Test Data and Test Plans
- Involved in unit, system testing & validation of changes made.
- Peer Reviews of the modules developed by team members
- Test Result analysis and status reporting
Environment: MVS OS/390, VS COBOL II, JCL, DB2, Xpediter, Endevor, VSAM, File Aid, PST, Platinum, Mapr, Natural, CICS
Confidential, San Bruno, CA
Application Developer
Responsibilities:
- Development & Enhancement of new & existing COBOL modules.
- Preparation & execution of test plans for the changes made.
- Involved in unit, system testing & validation of changes made.
- Peer Reviews of the modules developed by team members.
- Test Result analysis and status reporting
Environment: MVS OS/390, VS COBOL II, JCL, DB2, Oracle, Xpediter, QMF, VSAM, File Aid, Change Man, Control-M
Confidential
C++ Application Developer
Responsibilities:
- Development of software for digital coding and marking systems
- Development of software for different sensors & tailored to fit various product lines.
- Develop & configure networks on different platforms.
- Supporting the clients using DPIL coding and marking systems.
- Meeting the company standards by providing authentic solutions to the customers.
Environment: C/C++, Redhat Linux, Matlab, Makefile, MySQL