We provide IT Staff Augmentation Services!

Elk/aws Developer Resume

3.00/5 (Submit Your Rating)

Chicago, IL

PROFESSIONAL EXPERIENCE

Confidential, Chicago, IL

ELK/AWS Developer

Responsibilities:

  • Started with Amazon log agents (kinesis agent)to ship Apache logs to Kinesis stream where in kinesis firehose directly stream data to Amazon Elasticsearch
  • Also experimented on cloudwatch agents to ship server logsto Cloudwatch Service triggering them using Lamda function streamed to Elasticsearch.
  • Developed build and deployment scripts using ANT and MAVEN as build tools in Jenkins to move from one environment to other environments and create new jobs and branches through Jenkins.
  • Created Python Scripts to automate services on AWS.
  • Written ansible Script as a POC for ELK package to be installed, deployed and configured in aws cloud environment and also build CI/CD Pipeline with different Jenkins jobs running.
  • Configured AWS Identity and Access Management (IAM) Groups and Users for improved login authentication.
  • In addition to the above pipeline fetched server logs from kinesis stream through logstash and finally streamed to Amazon Elasticsearch.
  • As a conclusion tried researching on beats, used filebeat to ship sever logs to logstash which acted as a parser here where in it transformed and streamed logs to AmazonES (correlation taken place with all instance metrics, system metrics, apache server metrics)
  • Create and Configured the CI/CD pipeline for deploying ELK - Services and Lambda functions using Jenkins
  • Adding metricbeat to the above context also given the correlation.
  • Handled operations and maintenance support for AWS cloud resources which includes launching, maintaining and troubleshooting EC2 instances, S3 buckets, Virtual Private Clouds (VPC), Elastic Load Balancers (ELB)
  • Created and managed a Docker deployment pipeline for custom application images in the cloud using Jenkins.
  • Able to present Dynamic Dashboard in Kibana using python script with correlation let say Apache, System, Instance metrics.
  • Used Ansible Playbooks to setup Continuous Delivery Pipeline, including provisioning AWS environments using Ansible Playbooks.
  • Experimented on td-agent as a shipper and shipped logs to logstash after parsing streamed to Amazon Elasticsearch with all the metrics.
  • Locally started filebeat agent integrated with Kafka Queue fetching the data form Kafka through logstash, parsing it and streamed it to Elasticsearch with correlation.

Confidential, Boston, MA

ElasticSearch / DevOps Developer

Responsibilities:

  • Responsible for working on Elastic Search with indexing and querying via python & ElasticSearch REST API, Query DSL and write python library for python scripting.
  • Installed ElasticSearch client Confidential package-level and defined different modules Confidential high-level required for package-level.
  • Responsible for writing and updating library evaluated some test scripts to check the functionality of the package
  • Utilized Python libraries such as numpy and Pandas for processing tabular format data.
  • Writing scripts utilizing python mentioning different modules along with client module to develop programs that improve processing of access requests, uploading data, index documents.
  • Implemented different methods involving Multi-threading, Multi-processing to get parallezing for all kind of processes in ElasticSearch python client.
  • Working Confidential is challenging with the current task I have handled and also grown up as individual.
  • Written multiple python unit-tests for all the methods in the ESClient library tested them with JSON Data like uploading the data, getting all the queries with the data
  • Doing some experiments upon the queries like retrieving the data with distinct values with single request as well list of requests. Also, aggregating the data with multi-search functionality
  • Developed the Python Elasticsearch library upon client’s requirement and also debugging the code whenever one of my team member integrating code with pipeline and build with errors

Confidential, Framingham, MA

Elk/OpenStack Developer

Responsibilities:

  • Maintained puppet modules and manifests that automate deployment of configuration and software for OpenStack Control Plane.
  • Built and maintained Elasticsearch Logstash Kibana stack to centrally collect logs that are used to monitor applications.
  • Setup automated alerting of OpenStack Control Plane services using Zabbix triggers and templates.
  • Implemented Highly-Available ELK (Elasticsearch / Logstash / Kibana) stack for log management
  • Troubleshooting any build issue with ELK (Elasticsearch, Log stash, Kibana) and work towards the solution.
  • Utilized Elasticsearch, Log stash and Kibana (ELK) for maintaining system Logs and Bugzilla for tracking code bugs.
  • Implemented multi Node OpenStack KILO Architecture on KVM Using Latest Release of Ubuntu with Services like Horizon, Nova, Neutron, Glance, Cinder and Keystone
  • Utilized Kibana to build reliability and availability dashboards for cloud operations that helped monitor the performance of OpenStack components.
  • Used Nova commands to build and manage OpenStack VMs of different flavors and different images.
  • Create a custom dashboard using JSF replacing an existing Horizon dashboard using the Restful API provided by OpenStack.
  • Integrated various plug-in features with OpenStack to deploy various VNF's.
  • Experience in VNF instantiation, inventory, provisioning and configuration of virtual devices
  • Configuring and implemented an OpenStack SDN infrastructure to enable massive dynamic scaling of compute and storage resources.
  • Played an active role in hosting security, managing and maintain the system files.
  • Configured filebeat on OpenStack cluster and made up a standard kibana dashboard with elk test setup monitored for logs and designed them in a graphical interface.
  • Used kubernetes to deploy scale, load balance, scale and manage docker containers with multiple namespaced
  • Worked with Bitbucket to store the code repositories, good knowledge in using GIT.
  • Developed Ansible playbooks to configure, deploy and maintain software components of the existing/new infrastructure.
  • Developed Python scripts to help automate migration of applications and also monitor application health during this migration.
  • Utilized IPtable's and security groups to develop a logical firewall to ensure high security for OpenStackControl Plane applications.
  • Configured Networking Concepts DNS, NIS, NFS and DHCP, troubleshooting network problems such as TCP/IP, providing support for users in solving their problems.
  • Standardizing confluence documentation, rearranging pages and information on them.
  • Leveraged Keystone to create new users, grant user's privileges, create projects and also assign resource quotas to projects.
  • Created Subversion hooks for integration with JIRA like enforcing the use of ticket numbers in the commit message and for preventing accidental deletion of files by unauthorized users.
  • Develop CI/CD system with Jenkins on Google's kubernetes container environment, utilizing kubernetes and docker for the runtime environment
  • Hands on experience working with cluster mode RabbitMQ that is used as message queue in OpenStack.
  • Developed Python and Shell scripts to onboard additional VM capacity to OpenStack Nova.

Environment: nova, neutron, cinder, swift, keystone, horizon, RabbitMQ, Network ACL, Python, puppet, Elasticsearch, Jira, Bitbucket, Logstash and Kibana, Jenkins, ELK, SDN, Kubernetes, Confluence

Confidential

Ansible / OpenStack Engineer

Responsibilities:

  • Utilized Automation tools such as Chef, Puppet, and Ansible in production environments
  • Leveraged Ansible-playbook deploying the code to different docker containers and pushing it to git repositories for testing.
  • Installed and configured Linux/Unix and Windows operating systems on VMware server.
  • Responsible for orchestrating CI/CD processes by responding to GIT triggers and dependency chains and environment setup.
  • Worked with Red Hat OpenShift Container Platform for Docker and Kubernetes.
  • Hands on experience in continuous deployment of Micro-Services based applications using Docker and Kubernetes
  • Developed Ansible playbook to drive opssimple server to fully deploy OpenStack environment
  • Experience with container based deployments using Docker, working with Docker images, Docker Hub and Docker-registries and Kubernetes.
  • Used Jenkins and Ansible for Continuous Integration and continuous deployment in multiple environments.
  • Developed Networking policies for Docker containers. Worked on open source development tools like DockerContainers, Mesos and Kubernetes.
  • Developed automated testing scripts for backend services using PYTHON
  • Installed and Configured the Nexus repository manager for sharing the artifacts within the company.
  • Participated and supported implementation and the operation of DevOps tools. Such tools included Github, and CloudBees (Enterprise Jenkins).
  • Wrote Ansible Playbooks with PythonSSH as the Wrapper to Manage Configurations of OpenStack Nodes and Test Playbooks on AWS instances using Python.
  • Worked with installation and configuration of Docker environment (3.0) including docker registry hub for managing different docker images and deployment of applications inside the software containers.
  • Experience configuring and managing Puppet master server and experience in updating and creating modules and pushing them to puppet clients.
  • Managed kubernetes charts using Helm. Created reproducible builds of the applications, managed kubernetes manifest files and managed releases of Helm packages.
  • Used Maven dependency management system to deploy snapshot and release artifacts to Nexus to share artifacts across projects.
  • Wrote Python Scripts and Ansible Playbooks to scale tests for different scenarios based on several user configurations.
  • Have worked and set up monitoring tools have NewRelic, Splunk and Kibana on various cloud environments.
  • Knowledge on kubernetes and docker for the runtime environment of the CI/CD system to build, test & deploy.
  • Active participation in daily scrum call and backlog grooming along with team members upon different user stories.
  • Exposure to Mesos, Marathon cluster environment for application deployments and Docker Containers.
  • Utilized Shell, python, ruby, bash scripts to automate the infrastructure using Chef, Puppet.
  • Experience using Openshift enterprise and deployed applications using Docker containers in the cloud with Paas.

Environment: Ansible, Rally, Jenkins, Gerrit, OpenStack, Linux/Unix, docker, chef, puppet, Kubernetes, Cloudbees, Git, Python, AIC, Codecloud

Confidential, Irving, TX

AWS / DevOps Engineer

Responsibilities:

  • Performed DevOps migration/automation processes for build and deploy systems.
  • Implemented the Build automation process for all the assigned projects in Vertical Apps domain.
  • Monitored the UAT/Production Environments for any down time issues by performing regular Cron job updates in servers.
  • Built end to end CI/CD Pipelines in Jenkins to retrieve code, compile applications, perform tests and push build artifacts to JFrogArtifactory.
  • Managed a PaaS for deployments using Docker, Ansible and Mesos which reduced considerably deployment risks.
  • Created job chains with Jenkins Job Builder, Parameterized Triggers, and target host deployments. Utilized many Jenkins plugins and Jenkins API.
  • Build release of Cloud based products containing Linux and Windows environments, using Python Scripting.
  • Experience in architecting and configuring secure VPC through private and public networks in AWS.
  • Monitored AWS resources, set a notification alarm in case of trouble through CloudWatch
  • Managed a PaaS for deployments using Docker, Kubernetes and Puppet which reduced considerably deployment risks.
  • Involved in creating Puppet modules using manifests. Uploading desired run-list for the nodes (clients)
  • Developed build and deployment scripts using Maven as build tool in Jenkins to move from one environment to other environments.
  • Working knowledge of AWS technologies across the platform including S3, EC2, ELB, Security Groups, VPC, IAM and EBS.
  • Utilized Jenkins CloudBees for enterprise scale infrastructure configuration and application deployments checking out code from SVN/GIT and use ANT/Maven to Build war/jar artifacts.
  • Changing the AWS infrastructure Elasticbeanstack to Docker with Kubernetes.
  • Used Auto-scaling and Elastic Load Balancer features on EC2 instances to serve the end users using applications during unexpected traffic.
  • Developed PowerShell script to fetch necessary information from webpages according to the requirement
  • Developed scripts using Python, Ruby, BASH and BATCH files for Automation of Activities and builds
  • Written Maven scripts, Shell script for end to end build and deployment automation.
  • Used Jenkins for enterprise scale infrastructure configuration and application deployments into Artifactory.
  • Worked on installation and configuration of Puppet. Installed Puppet Master and configured multiple agents to Master.
  • Strong use of Shell scripting languages including BASH for Linux and PowerShell for Windows systems
  • Used Artifactory and Bitbucket (GIT) for resource and code organization purpose.
  • Developing procedures to unify, streamline and automate application development and deployment procedures with Linux container technology using Docker.

Environment: Java/J2EE, Subversion, Jenkins, JIRA, Ansible, OpenStack, Maven, GIT, SVN, Python, Ruby, WebLogic, Docker, UNIX Shell Scripting, Nagios, AngularJS, Cloudbees

We'd love your feedback!