Sr. Big Data Developer Resume
OH
SUMMARY:
- Over (13) years of professional experience as Application Developer working in all phases of development life - cycle including requirements gathering, development, testing, implementation and production support.
- Extensive experience in Java/J2EE-related technologies including Spring Project, Spring MVC, Spring IO Platform, Spring Framework, Security, Integration, Batch, Enterprise Java Beans (EJB), Servlets, Struts and Java Server Faces (JSF) Framework, Hibernate, Ibatis, XML, Json and scripting.
- Solid experience on Oracle Database PL/SQL Development, database management with substantial development experience in creating stored procedures, packages, triggers, functions, views with data warehousing, dimensional modeling and ETL development background
- Over 4 years’ experience in Big Data technologies using Hortonworks and Cloudera Build with development experience using SPARK, SCALA, KAFKA, Avro, Streaming, MapReduce, PIG, Hive, HBase, Sqoop, Shell Scripting for automation, oozie with background in Administration and maintaining of Hadoop ecosystem in a multi node cluster.
- Experienced administering, Configured and implemented AWS EC2, EBS, S3, ELB, RDS MySQL, Route 53, DNS, EFS, Cloud Front, Cloud Watch and more. Architect VPC public and private subnet and NAT instances.
- Proven ability to work independently or cross functional teams to delivered sprint, scrum, agile, task and project on time.
TECHNICAL SKILLS:
Database: Oracle, SAP Hana, DB2, Teradata, Casandra, Netezza, SQLite, Microsoft Azure, Amazon Dynamo DB, HBASE, HIVE, MY SQL, PostgreSQL, MS Access, MS SQL Server
Language: Java/J2ee, Shell Scripting, Hive, Pig, Scala, Spark, MapReduce, oozie, sqoop, multithreading, sockets, collection, JSP, Servlet, EJB, Tags, JNDI, RMI, XA Transaction, Java Mail, JavaBeans, LDAP, security, annotation, IOC, XML, JAXP, SAX, DOM, Json, Digester, Stream, HTML, CSS, XSLT, XSL and Shell script.
Framework: Spring, Struts, MVC, ORM (Hibernate, Ibatis, Toplink, JDO, Entity Bean)
Web Server: (WebSphere Application Server, Web Logic Server (BEA), JBoss, Sun One, Tomcat, MQ Server (IBM MQ Server, ActiveMQ, MQSonic) Enterprise Service Bus (Mule, Spring Batch, Spring Integration). ETL (Data stage Ascential, SQL Server DTS. Control M), Web service (SOAP, JWS)
IDE: RAD, Eclipse, JDeveloper, NotePad++, MobExterm, TOAD, Squirrel, JBuilder, WebLogic Workspace, Visual Studio 8 and Visual Studio .NET, Macromedia
OS: Unix, Sun Solaris, Linux (UBUNTU, Suse Linux, Centos, RedHat), Window (XP, Vista, NT and DOS), Mac OS and VMWare.
PROFESSIONAL EXPERIENCE:
Confidential
Sr. Big Data Developer
Responsibilities:
- Created cloud network utilizing VPC, Security Groups and Network ACLs, installed and Deployed Hortonworks Hadoop Cluster on AWS for Big Data Analytics.
- Configured and implemented EC2, EBS, S3, ELB, RDS MySQL, Route 53 DNS, Glacier, EFS, Cloud Front, Cloud Watch, Assigned Roles and Policies to Users, Groups by employing IAM and Key Management
- Developed integration with S3, SQN and SNQ using python AWS CLI client, consume API integration with SOAP and REST API.
- Created Public and Private Subnets, Snapshots, Auto-Scaling groups, EC2, Lambda, ELB, VPC, Kinesis, SES, SQS, SNS, SWF, RDS, Dynamo DB. Integrated AWS HDP data to AWS Teradata repository and Macrostrategy.
- Developed Data Ingestion workflow using Sqoop, Hive, Spark SQL and Streaming, load data format and partitions into multiple format such as Avro and Orc. Developed data migration, analytic and optimization tools using sparks, participated in developing data governance and architecture to standardize the data storages layer and techniques.
- Developed Data Metrics, Big Data Processing, Data Quality Check using Spark, Scala. SQL, RDD and Dataframe, Hive2 on Tez and build custom user define function for hive.
- Migrated and converted Netizza data warehouse appliances, business reporting process into Big Data eco system, accelerating the extraction, transformation, and loading of massive structured and unstructured data. Created CA Workload Automation schedule and generated reports in Paxata.
Technology: Java, J2ee, Map Reduce, Scala, Json, Avro, Orc, Hive, Sqoop, Pig, Kafka, oozie, HBASE, Shell, YARN, Hortonworks Build, Apache Phoenix, Python, AWS CLI, SVN, Teradata and Teradata stored procedure and Paxata.
Confidential
Sr. Application Developer
Responsibilities:- Led the development of eATM middleware process by creating WS services, MQ Message broker, MQ Messaging, Data Services using Spring JAXWS and Spring JMS
- Create a utility to mock the end to end testing for web service by unmarshaling the WS request into an object using XML factory.
- Create a utility to upload, download, sent HTTP request and connectivity into Casandra.
Technology: Eclipse, JAX WS, REST, spring MVC, Oracle, Hadoop Cloudera eco system (Hive, Sqoop, Oozie), Casandra and UNIX scripting.
Confidential
Hadoop Big Data Application Developer
Responsibilities:- Create real-time data ingestion into Hadoop using SQOOP, HIVE, PIG, OOZIE and MAP REDUCE JOB from internal and external client from different Database Sources (Teradata, SAP Hana, DB2 and Oracle). Filter data in real-time during collection; using map reduce job and RegEx for high-level data for real-time analysis
- Proposed standard and establish a data governance to ensure that analytics are embraced across the organization. Maintain Metadata and Data profile to make sure that Data accessibility allowing the ingestion process to start with analysis of data types, amount of data and estimate ingestion time.
- Create Proof and Concept using Hadoop Big Data Tool to process complete workflow of ingestion and proposed possible solution how to stage/work, archive and manage file from Business to Public Data Layer.
- Optimize hive query to ingest and merge data using map reduce jobs and generate a report file to different landing zone and created a Datameer link and DELL Boomi Integration to Hadoop HDFS platform.
Technology: Java, Map Reduce, Eclipse, Hive, Sqoop, Pig, oozie, HBASE, Hadoop 2.1, Shell, YARN, Hortonworks Build, SVN and Datameer
Confidential
Sr. Application Developer
Responsibilities:- Maintained and Developer on Enterprise Middleware System team that handling 300+ web service on retail, credit card and more. 100M+ daily transactions. Propose Proof of concept to implement and use Hadoop Big Data Management process to replace the mainframe db2 architecture.
- Lead a team to maintain and developed Business Activity Monitoring (BAM) that creates a baseline and real-time monitoring alerts using Systar Business Bridge
- Designed and Developed Proof and Control System (PNC) that track transactions of check data, check images, and the ability to generate alerts and notifications.
Technology: Java, J2EE, Spring JMS, Spring JTS, Spring JMS, Spring Core, Spring MVC, Oracle, DB2, Struts, SOAP, Castor. Jenkins, SVN, Clear case, Agile, RAD, Eclipse, Spring SDT and more
Confidential,OH
Senior J2EE Developer
Responsibilities:- Enhanced NF eDelivery system leverages current technologies and with the wide acceptance of email among customers, the system can dramatically reduce the cost and overhead associated with older methodology (standard paper).
- Modified Handler, Domain, DAO, iBatis mappings for the enhanced development. Created UNIX shell scripts for executing batch job.
- Consumed web services for retrieving and maintaining eDelivery preferences and generated web service client code using Axis2 runtime environment and developed the client application for consuming web services.
Technology: Java, spring, iBatis, WebSphere6.1, Oracle, Eclipse, Harvest, DbVisualizer, SoapUI.
Confidential
Sr. Application Developer/PLSQL Developer
Responsibilities:- Designed and Developed (1) Residual Paper Control System that provides the remediation, balancing and forwarding of un-encoded larges deposits. (2) ATM DA Control System that monitors and control the point of entry through point of posting and confirming along the way what went into the ATM. (3) Proof and Control System PNC (PNC) that track transactions of check data, check images, and the ability to generate alerts and notifications.
- Individually developed the PNC Message Oriented architecture that asynchronously communicates with different sources, created a message container using Spring JMS, parse XML message using XStream and Digester, created Transactional Server and normalized XML data. Developed a distributed transaction using spring JTS that provide two phases commit using ATOMIKOS transactional Server that support (XA) transaction management.
- Designed PNC Database Structure, implemented and proposed the requirements of database data entries and enhancement, created Oracle PL/SQL Stored procedures, packages, triggers, views, fine tune, tables and indexes.
Technology: RAD 7, Eclipse, Exadel, Spring and Struts for user interface, Agile, Java, JSP, JavaScript, J2EE, JMS, JDBC, Tags, Hibernate, Servlet, SWT, JMS, JUNIT, J4Logs, XML, Digester, ATOMIKOS, XStream, SVS, Spring Integration, MULE, Toads 8, and SQL/PL SQL using Oracle 9i/10i, IBM WAS Server, C#.NET, IBM MQ Series 6 & Control M, Shell Script
Confidential
Software Engineer
Responsibilities:- Developed the (1) RS - Reporting Suite System for Corporate/Private Banking that extends monthly and daily reporting (2) ACS (Accounting Service and Sub Ledger) and LS2 (Loans System 2), a global systems used for loan products that adopts global chart of accounts. (3) Transaction Lifecycle Management System (TLM) and (4) Global Data Pooling (GDP) reconciliation tool of Summit and DWH cash flow/posting.
- Led the development of web user interface using Struts Framework, created a custom tags, hibernate mapping xml files, optimize hibernate relationship, create hibernate logs and statistics, single sign-on service that accesses LDAP and Active X directory using JOSSO API, created a security authentications to login on trusted center server, created a Service Oriented Architecture (SOA) using SOAP for file transformation service and connectivity.
- Converted the existing Strut Web UI front end component to JSF, utilize the use of JSF Tags and AJAX, beans and validation model, re-code all the event and listener that handle the event using JSF API, AJAX and DOJO.
- Created Oracle PL/SQL business process, stored procedures, packages, trigger, complex SQL statement, dynamic SQL Statement, optimized Oracle Database 8/9/10i using TOADS analyzer, HINTS and improved indexes and conditional statement.
- Developed, monitor and maintained ETL jobs using Data Stage Assential and optimized slow process existing Oracle Stored Procedure from 3 hour runtime to just 5 minutes on Global Data Pooling projects and Reporting Suite System projects
- Led the development of Business Reporting Requirements using Business Object (BO) by creating BO Universe using BO Designer and templates. Handled the Supervisory Management that maintains user profile, security group and categories in UAT and Test Environment.
Technology: Eclipse, Java/JSP,JSF, JavaScript, Ajax, J2EE,EJB Bean, Ant, Custom Tags, Struts Framework, Hibernate, Servlet, EJB,JMS, junit, Log4J,SOAP,XML,DTD,JAXP,CVS, Poseidon UML, Toads 8, SCRUM, Business Objects 6 and SQL/PL SQL using Oracle 9i/10i and Sun one Application Server 6/7 and Control M, Data Stage, Shell Script
Confidential
Sr. J2EE Developer
Responsibilities:- Designed and developed the ABS-CBN Payroll System, a distributed application to take care of calculations of salary as per Rules of the Company, Income-Tax calculation and various deductions to be done from salary, including statutory deductions like Income Tax and Provident Fund deductions.
- Individually developed Supplier Contact (SC), Purchasing Order (PO), Requests for Quotation (RFQ), Requests for Proposals (RFP), Requests for Information (RFI) Module using C# and ASP.NET using Infragistics, SOAP design Architecture and Web service
- Developed the (1) Report Central that generates more than 200+ periodical customizes reports and (2) Enhanced BANCO DE ORO online service for customer account balances, account history, statement, money transfer and online bill payments inquiries.
Technology: Eclipse, J2EE, Java, Struts Framework, Web focus, AJAX,SQL/PL, Ibatis framework and Hibernate Framework, junit, SWT, Log4J,SOAP,SWT,Ant, XML,DTD,JAXP,XLST,CVS, UML, Jasper, Tomcat 5.1, SOAP Web service, web logic, AS/400, and SQL/PL SQL,TOADS,C++,Shell Script, and Oracle 8/9i
Confidential
J2EE Developer Analyst/DWH Engineer
Responsibilities:- Developed the (1) Michelin Inventory planning system (MIPS) and (2) Demand Fluctuation module (DFM) for A Supply Chain Managements system that manages industrial stocks and calculate demand of supply. (3) Michelin Export Management System (MEMS) a Supply Chain Managements system that monitor the exportation and importation of supplying entities world wide and (4) Michelin Singapore Site B2C application system for an on-line customer directory system providing a single interface to multiple servers in all Asian countries.
- Individually designed and developed database mapping engine, Parse XML, digester and tags that automatically generates search criteria and entry screen. Created reusable objects, portlets, and class, back-end packages for Supply Chain data consolidation and complex business requirements using Oracle.
- Administered and designed Supply Chain Oracle Server system securities, database administration and created Data Stages job packages for data warehousing architecture and conduct on-site user training and technical in support.
- Responsible for day-to-day database maintenance including Installation, Tuning, backup, administered multiple remote Central Oracle Database and database design.
Environment: J2EE, JSP, WASAD 5, UML, IBM Web sphere Portal Application Server, XML, JavaScript, Portlet, Servlet, Clear Case, EJB and Rational Rose, Windows 2003 and Oracle Database.
Confidential
IT Head and Lead Software Architect
Responsibilities:- Successfully implemented enterprise system as follows: (1) Integrated Accounting System (BIAS), (2) Sales and Inventory Management System (SIMS), (2) Warehouse Management System (WMS), (3) Import Service Management System (ISMS), (4) Personnel Information System (PIS). (5) Asian Development Bank (ADB) Integrated Security.
Technology: J2EE/JAVA, SWT, JDBC, JSP, JavaScript, Tomcat, Crystal Reports and SQL Server & Oracle 7i.
Confidential
Owner/Lead Developer
Responsibilities:- Led IT development group that customized application software in banks, manufacturing, construction, sales and inventory, accounting that backed by highly trained professionals honed in applications of system development, networking and sub-contract large-scale application system
- Designed and developed the customized systems for Standard Chartered Bank: (1) Card-Tracking System (CTS) for card tracking, (2) Courier Monitoring System (CMS) for credit card inquires, (3) Privilege Account Management System (PAMS) for system privileged, (4) Fast Record Search System (FRSS) for fast inquiries, (5) Sales and Marketing Tracking System (SAMTS) that calculate agent commission, (6) Collection Agency Recoveries Monitoring System (CARMS) that handles delinquent accounts.
Technology: VB 5/6, ASP/COM, ADO, DCOM, Crystal Reports/MS SQL DB and Oracle database.