SUMMARY:

Big Data - Hadoop Engineer / Administrator, Azure Solution Architect / Administrator

TECHNOLOGY:

Cloud Platform: Microsoft Azure, AWS

OS: RedHat Enterprise Linux 7|6|5|4|3, CentOS 7|6, SUN Solaris 10|9|8, VMware ESX, Windows

Languages: Python, Perl, UNIX Korn/Bourne Shell

Software: Cloudbreak, Ambari, Confluent, JIRA, RedHat Satellite Server, RedHat Logical Volume Manager, Veritas Volume Manager, Veritas Cluster Server, Veritas Enterprise Administrator, Cisco UCS Manager, HP SIM, iLO, DRAC, Remedy, AssetExplorer, Sun Management Console, Veritas Netbackup, VMware Infrastructure Client, SRDF, SYMCLI, PowerPath, Centrify Direct Control, BMC Patrol, BMC ControlM, BMC Service-Now and BMC NetCool

Database: MySQL, PostgreSQL, Hive, HBase

Hardware:

MS Azure: D4s v3, D14 v2, DS5 v2, E4s v3, E16s v3, E32s v3, F8, L16s, L32s, NC6

AWS EC2: m4.4xlarge, d2.4xlarge, d2.8xlarge, r3.4xlarge, r3.8xlarge

Cisco C240-M3S, Fabric Extender: Nexus 2232PP, Fabric Interconnects 6296UP

Networking: NIS, NFS, LDAP, DNS, SMTP, TCP/IP, DHCP, VPN

Storage: IBM, EMC and 3PAR

EXPERIENCE:

Confidential, Long Island, NY

Director - Big Data Architect

Responsibilities:

• Build Hadoop cluster on Cloudbreak using MS Azure VMs
• Scale up/down using Cloudbreak CLI
• Manage Azure subscriptions
• Analyze resource utilization and consumption
• Manage resource groups
• Manage role based access control (RBAC) through IAM
• Implement and manage storage accounts
• Configure Azure backup and perform restore operations
• Deploy and manage Azure virtual machines
• Configure and manage Azure virtual networks, Kubernetes services, Azure Active Directory, Azure Application gateway, Azure SQL Database
• Install/configure Snowflake
• Snowsql to load data into s3 from Snowflake
• Install/Configure Alteryx and integrate into Hadoop
• Install/Configure H2O Driverless AI and puddle
• Involved in Hadoop architecture, strategy and design
• Research on tools that could integrate with Hadoop and work with vendor on POC process
• Install and configure Hadoop Eco-System components such as: HDFS, YARN, MapReduce 2, HBase, Hive, Kafka, Storm, Spark, Oozie, Tez, Pig and Sqoop
• Implement HA for HDFS, YARN, HIVE and HBase
• Upgrade Ambari and Hadoop stack version
• Test new changes in dev environment and create change control request to implement them in UAT and Production
• Performance tuning of Hadoop components
• Create case with Hortonworks support and work closely with them till resolution
• Work closely with developers to troubleshoot ongoing issues
• Deploy new application/code from release notes
• Working knowledge of Cloudera Manager

Confidential, Long Island, NY

Engineer - Big Data Platform

Responsibilities:

• Involved in Hadoop architecture, strategy and design
• Research on tools that could integrate with Hadoop and work with vendor on POC process
• Install, configuration, Manage and support of AWS and on premise Hadoop (Hortonworks) clusters
• Create new AWS instance from AMI
• Create/delete/attach/detach volumes for AWS instances
• Install and configure Hadoop Eco-System components such as: HDFS, YARN, MapReduce 2, HBase, Hive, Kafka, Storm, Flume, Spark, Oozie, Tez, Pig and Sqoop
• Implement HA for HDFS, YARN, HIVE and HBase
• Upgrade Ambari and Hadoop stack version
• Implement Kerberos, Ranger and Solr for security and audit purpose
• Test new changes in dev environment and create change control request to implement them in UAT and Production
• Performance tuning of Hadoop components
• Create case with Hortonworks support and work closely with them till resolution
• Work closely with developers to troubleshoot ongoing issues
• Deploy new application/code from release notes
• Working knowledge of Cloudera Manager
• Install, configure, manage and support Elasticsearch cluster
• Install, configure, manage and support Kibana, Marvel and Sense
• Secure Elasticsearch cluster with Shield

Confidential, New York, NY

Hadoop Engineer / Administrator

Responsibilities:

• Installation, configuration and maintenance of Hadoop (Hortonworks) cluster
• Install and configure Hadoop Eco-System components such as: HDFS, YARN, MapReduce 2, HBase, Hive, WebHCat, Falcon, Oozie, Ganglia, Nagios, Tez, Pig and Sqoop
• Upgraded Hadoop stack from 1.3.3 to 2.0.6 and 2.0.6 to 2.1.5
• Installation and configuration of Ambari
• Hadoop cluster monitoring through Ambari, Ganglia and Nagios
• Work with developers to debug and fine tune Hadoop parameters
• Architecture, build and administration of Cisco UCS C240-M3s three racks; Created service profiles, server policies, server pools and deployed 30 RHEL servers; Configured UCS to authenticate with LDAP
• Install and configure SAS Cluster (Metadata, Grid, Application and Compute nodes)
• Install and configure LSF, PM and RTM
• Installation and configuration of RedHat Satellite server and build/maintain package repository
• Deploy RedHat Enterprise Linux servers through Kickstart file
• Upgrade OS and deploy packages through yum
• Create/modify Veritas Cluster and LVM file systems
• Support Ab Initio ETL Veritas Cluster (10+ nodes) which includes clustered file system creation/modification/deletion, adding/removing nodes
• Installation and configuration of Micro Strategy iServer
• Work with Security team to mitigate server vulnerability
• Installation and configuration of HP SIM server to monitor HP hardware
• Fulfill end users request which came through Remedy
• Maintain server inventory in AssetExplorer
• Support off-hour/weekend on-call rotation

Confidential, New York, NY

UNIX/Linux Systems Administrator

Responsibilities:

• Troubleshoot hardware/software issues that might be affecting traders/business users and provide necessary recommendation/resolution to resolve it
• Work closely with engineering team and operations staff to resolve real-time issues
• Upgrade/install OS using Jumpstart and Kickstart on HP platform; build RHEL VMware hosts on ESX platform
• Veritas (SRDF/local) and LVM file system creation/modificaiton/deletion
• Install patch/rpm/perl module using PCA, YUM and CPAN
• Upgrade Kernel, Security patches and Veritas Volume Manager
• Upgrade/install EMC utilities such as SYMCLI, Powerpath, HBA firmware/drivers
• Install/upgrade PSP on HP hardware
• Troubleshoot HP h/w issues via HP SM console
• Participate in new system integration projects and support new technology implementations
• Participate in weekly Change Control call to discuss upcoming system changes and their impact on traders’/business users
• Interact with internal and external auditors, provide necessary compliance reports
• Maintain backup report to ensure optimal data recovery
• Update server inventory
• Support off-hour/weekend on-call rotation
• Provide support/documents to offshore L1 team

Confidential, Morristown, NJ

Tech Support / System Analyst

Responsibilities:

• 24x7 on/off site tech support
• Schedule jobs using CRON utility
• Monitor disk usage
• Modify user access rights
• Write/modify UNIX Korn Shell scripts to support daily work
• Analyze and propose system/code changes to rectify and/or prevent any issues
• Validate system/code changes put in production environment
• Create operation and management documents for releases
• Open/validate trouble tickets for system changes (for orders rejected due to incorrect business and/or mapping rules)
• Train new employees

Confidential, Brooklyn, NY

Jr. Systems Administrator

Responsibilities:

• Monitor and maintain Windows NT network
• Backup data
• Install/repair/troubleshoot PC/Laptop/MAC, Printer, Scanner
• Software / Hardware upgrade