Linux/unix Systems Administrator - Devops Engineer Resume
5.00/5 (Submit Your Rating)
New York, NY
OBJECTIVE
- To achieve high career growth through a continuous learning process that keeps me dynamic, visionary, and competitive alongside the changing scenario of the world that is cultivated through Information Technology. To utilize my creative/programmatic thinking to build automated processes and/or applications that assist in creating the most efficient, scalable, and simple solutions
PROFESSIONAL EXPERIENCE
Linux/Unix Systems Administrator - DevOps Engineer
Confidential - New York, NY
Responsibilities:
- Setup and configured Ambari in Development/Integration/QA/Staging and production.
- Deployed entire Hadoop ecosystem using ambari blueprints.
- Ensured all setups were identical by automation the entire process of deployment/configuration.
- Deployed Oozie Jobs.
- Tuned various settings such as Heap Size, Permissions, Thread allocation, Grid, etc. for most efficient use.
- Troubleshooted issues with different Hadoop components
- Worked with Hortonworks support to fix bugs and other anomalies
- Added/Removed nodes by Starting/Stopping diffierent infrastructural components to ensure no downtime.
- Created Checks and maintained health of the system.
- Upgraded Ambari and Hadoop/Components in various environments ensuring minimal downtime
- Created a method to rebalance the cluster after datanode addition/deletion which greatly reduced the time needed for rebalance.
- Manually moved data in the cluster
- Created Dir Structures/Permissions/Files within HDFS.
Confidential
Linux/Unix Systems Administrator
Responsibilities:
- Created Storm Cluster in all environments
- Configured Storm in each environment to include 3 nimbus node cluster
- Configured SupervisorD to control nimbus/zookeeper/storm-ui
- Automated the deployment of the cluster separating zookeeper nodes/nimbus nodes and workers by deploying different supervisor configs based on hostnames
- Added and removed storm nodes ensuring 0 downtimes
- Deployed Storm topologies
- Upgraded storm
- Monitored Storm Topology bolts/spouts and compared Emitted/Transferred/latency etc. to pinpoint problems
- Using monitored data from the Storm UI, parsed Storm topology logs to pinpoint a cause of issues.
- Fixed topology submission errors such as, two of the same topologies running where a killed topology did not die on all nodes.
Confidential
Linux/Unix Systems AdministratorResponsibilities:
- Created kafka cluster in all environments
- Configured Kafka and zookeeper to create cluster
- Configured Supervisord to control kafka and zookeeper processes
- Automated deployment of kafka/zookeeper/supervisored, configuration based on hostnames
- Tuned Kafka for optimal performance by tuning things such as, timeouts, queues, partitions, retention, max waits/bytes/messages/message size.
- Used kafka metrics, such as disk space used/topic lag to correlate storm consumption issues. Used these metrics to identify issues within a storm topology which may be the root cause of a growing lag within a topic.
- Worked with engineers to pinpoint and fix issues without any user-facing impact.
- Created Topics on kafka
- Troubleshooted R/W by using kafka cli to produce and consume a message on specific topic
Confidential
Apache Zookeeper
Responsibilities:
- Created Zookeeper Clusters for Storm/kafka
- Automated deployment of zookeeper based on hostnames
- Troubleshooted zookeeper problems with sync and transaction logs
- Created and configured MariaDB/MySQL
- Created Databases on Servers using CLI
- Created Tables on Databases using CLI
- Configured Users on Databases
- Locked down database by disallowing root logins etc.
- Configured Master/Master, Master/Slave Databases
- Configured replication for Entire DB/Specific Database to outside datacenters with their own Master/Slave Setup
- Configured Database replication over SSL by created and applying certificates.
- Used liquidbase to load data.
- Troubleshooted issues with replication such as a server going down and re-syncing it.
Confidential
Linux/Unix Systems AdministratorResponsibilities:
- Created and configured Galera Cluster in 3 Geographic locations
- Created Galera to MariaDB Master to MariaDB Slave replication
- Tuned Galera using parameters such as max connections/packet size,concat length.
- Configured Wrep provider options such as inactive check period, suspect/inactive timeout, and weight to ensure everything ran optimally.
- Automated the deployment of this process, coupled with the previous MariaDB/MySQL deployement.
Confidential
Couchbase
Responsibilities:
- Created an automated process to deploy a couchbase cluster
- Setup Replication and buckets on cluster
- Created Monitoring for cluster that fed data into splunk
- Added and removed nodes from cluster without any downtime
- Upgraded entire cluster's physical memory without any downtime
- Upgraded Couchbase version
- Troubleshooted couchbase
- Setup Backup jobs for couchbase buckets
- Updated couchbase documents
- Stress tested couchbase.
- Setup XDCR - Cross site data replication
Linux/Unix Systems Administrator
Confidential - Princeton, NJ
Responsibilities:
- Assisted in the acquisition of proper Confidential Servers best suited for Hadoop implementation in addition to deploying and configuring bios at Datacenter.
- Configured RAID volumes and backups to ensure crucial data was always available.
- Configured network directives such as properly defining hostnames, domainnames, subnets, and IP Routes.
- Provisioned servers using Kickstart and Cobbler with DNSMASQ using MACID based configurations with predefined variables created using bash scripts.
- Ensured connectivity between Hadoop cluster using password-less authentication and host directives.
- Created Bash scripts to simultaneously manage entire rack, monitor disk/cpu/ram usage and alerts with cooperation from CRON.
- Created Bash scripts for monitoring the log files for events such as failed ssh authentication and taking appropriate actions by adding offending IP's and hostnames to IPtables, TCPWrappers.
- Implemented security practices by base-lining the cluster by removing all but necessary services as well as base-lining the network for anomaly detection.
- Setup a security-onion based system, which consisted of the following levels.
- Troubleshooted Network/System issues to ensure servers were accessible yet secure in addition to ensuring that the required services were effectively running.
- Conducted tests using various open/closed-source tools such as Nmap and Nessus to rule out any additional vulnerabilities.
- On call for various unforeseen issues that arose in addition to making unscheduled but crucial visits to the datacenter.
Linux/Unix Systems Administrator
Confidential - Piscataway, NJ
Responsibilities:
- Built/Troubleshooted/Maintained/Updated and Backed up critical RHEL/CentOS systems to allow for maximum reliability and disaster recovery.
- Performed OS upgrades as well as deploying application updates and critical patches.
- Performed System Hardening using various kernel services in addition to implementing Intrusion Detection, Intrusion Prevention Systems and ACL's.
- Deployed/Tuned and provided support for system/web applications as well as providing escalation support for device issues.
- Monitored System/Network anomalies to isolate and resolve any foreseeable complications.
- Designed Scripts and CRON jobs to automate tasks such as synchronization, backup's, performance monitoring, usage monitoring, modifications, and other redundant procedures, in addition to creating scripts that could be executed directly by the DevOPs team thus helping to increase efficiency.
- Contributed to Risk analysis and contingency planning
Technical Assistant
Confidential - Jamaica, NY
Responsibilities:
- Maintained network, computers, automated systems and peripherals. Created technology based learning environments in classrooms and laboratories.
- Assisted faculty and staff in instructional laboratories. Provided technical assistance to administration, faculty and students.
- Assisted faculty and staff to effectively use state-of-the-art instructional technologies.
- Employed independent judgment in the implementation of administrative procedures in addition to Serving as an advocate for faculty and students in matters related to the application of technologies.