Sr. Python Engineer Resume
Scottsdale, AZ
SUMMARY:
- 8+ Years of experience in Analysis, Design, Development, Testing, Customization, Bug fixes, Enhancement, Support and Implementation of various web, stand - alone, client-server enterprise applications using Python from Python v2.7 to v3.6.3, C, Django in various domains.
- Experience working in Java, JavaScript, and Python software development environments. Extensive experience in developing web applications implementing Model View Control architecture using Pyramid, and web application Autotest frameworks.
- Good understanding on Kafka related topics, publisher, consumer, partitions, consumer groups and offset management and good knowledge of Web Services with protocols SOAP, REST.
- Developed and maintained datacenter virtualization in Linux environment (CLI) using VMware ESXi, Xen Server and KVM
- Experienced in developing web-based applications using Python, Django, XML, CSS, HTML, JavaScript and JQuery. Experience with Matplotlib for data analysis.
- Strong command in JavaScript leading Autotest Frameworks Team like Angular.js, React.js, backbone.js, bootstrap.js, Node.Js and Projects UI Designing Team.
- Implementation of several OOPs concepts to achieve data encapsulation Hands on Experience developing Kafka, Spark batch and Spark streaming jobs using scala language
- Developed and supported ETL packages that extracted data from data sources like SQL server & flat files to create reports after applying transformations in Microsoft Business Intelligence and IBM Cognos suites.
- Experience on creating new React/React-Native components, containers, services, and APIs for prototypes and extensively worked on Spark SQL, Dataframes, RDD's to improve the performance of the application
- Experience in real-time configuration and management of MySQL, MongoDB, Cassandra and PostgreSQL databases on a large scale.
- Good experience in Shell Scripting, SQL Server, UNIX and Linux, Open stock and Expertise python scripting with focus on DevOps tools, CI/CD and AWS Cloud Architecture
- 3 years of experience as a Hadoop Developer in all phases of Hadoop and HDFS development.
- Primarily responsible for designing, implementing, Testing, and maintaining database solution for Azure and also strong analytical and problem-solving skills for Hadoop Data Architecture
- Deployed and maintained Kafka, Couchbase, Redis, MySQL, Mongo, and Elasticsearch database clusters as part of the data engineering team in a 250-person department of a human resources company
- Object Oriented Concepts(OOPS) like Collections, Multi-threading, Exception Handling, Reflection
- Hands on experience with HDFS, MapReduce and Hadoop Ecosystem (Pig, Hive, Oozie, Hbase, Zookeeper and Sqoop).
- Well versed with developing and implementing MapReduce jobs using Hadoop to work with Big Data.
- Architecture, size (Capacity planning), Data modeling, implementation and support CassandraClusters including install, configure and upgrade DSE v3/4 (Cassandra v 1/2.x) and OpsCenter v 4.x/5.x on Bare metal and Cloud including AWS (Amazon Web Services). Familiar with the front-end design of website application using HTML, CSS and Java script.
- Develop AngularJS website from front-end to back-end. (HTML5, CSS, JQuery, JavaScript) also familiar with JSON based REST, SOAP, and Amazon Web Services.
- Expertise in python scripting with focus on Develops tools, CI/CD and AWS Cloud Architecture and hands on Engineering
- Designed and developed a Python automated testing Autotest framework which can send, receive FIX Messages, test various interfaces including SOAP XML and also used Spark SQL and Hive SQL to process structured and un structured data.
- Uses Oracle library for database connection and customized library for calling SOAP and REST services and alsoAdministered and monitored multi Data center Cassandra cluster based on the understanding of the Cassandra Architecture
- Excellent knowledge of OOPS, Multi-Threading and Collections concepts and in Python Expertise in Production support and knowledge of deployment using AWS, Heroku and Jenkins and also Developed Spark scripts by using Scala IDE's as per the business requirement.
- Good experience in working with various Python 2.7Integrated Development Environments like PyCharm, PyScripter, Spyder, PyStudio, PyDev, NetBeans and Sublime Text.
- Experience of Build & Deployment phase and usage of Continuous Integration (CI/CD) tools, build configuration, change history for releases, Maintenance of build system, automation & smoke test processes, managing, configuring, and maintaining source control management systems
- Experience with Angular 2 and typescript as part of migration from Angular and vanilla javascript to Angular 2 and React.
- Experience in developing web-based applications using Python 2.7/2.6, Django 1.4/1.3, PHP, HTML/HTML5, DHTML, CSS/CSS3, JavaScript, JQuery, AngularJS, Node.JS, AJAX, XML and JSON.
- Involved in designing user interactive web pages as the front-end part of the web application using various web technologies like HTML, JavaScript, AngularJS, jQuery, AJAX and implemented CSS for better appearance.
- Proficient in writing Sub Queries, Join's, Stored Procedures, Triggers, Cursors and Functions in SQLite3, MySQL, PostgreSQL, Mongo DB and OracleDB. Also performed data analysis using PL/SQL.
- Developed web application for internal team to use using Django Rest Framework/AngularJS/ MYSQL to suffice their business needs
- Used Slack to communicate each other, and we discuss everyday via Slack what we did, and in what we are going to work.
- Experienced in MVW and Autotest frameworks like Django, JavaScript and also experience in working with Python ORM Libraries including Django ORM.
- Experience in Python 3.2 packages such as NumPy, matPlotlib, Pandas, SciPy, Pickling, JSON
- Enhanced by adding Python XML SOAP request/response handlers to add accounts, modify trades and security updates.
- Good understanding of Jingo ORM and SQLAlchemy .Good knowledge in CORE JAVA and OOPS concepts
- Pervasive experience on front end frame works like CSS Bootstrap and core developer for Ethernet line modules in a twenty two slot chassis, using Broadcom SDK.
PROFESSIONAL EXPERIENCE:
Sr. Python Engineer
Confidential, Scottsdale, AZ
Responsibilities:
- Developed Oozie workflows, Hive scripts for external tables in s3, Sqoop jobs to import data from Oracle DB2, AWS EMR configuration JSON files.
- Worked on connecting to MongoDb with pymongo module to perform CRUD operations
- Used AWS CLI from Redhat-7 machine to implement AWS Services and also developed SOAP client for testing MDM to SAP R/3 interoperation and extracted the data that are required for the segmentation using spark environment.
- Designed and configured Azure Virtual Networks (VNets), subnets, Azure network settings, DHCP address blocks, DNS settings, and security policies and routing.
- Developed Micro services using Go language and worked on test cases and also experience of various Python application development and CI/CD pipeline tools like GitHub, Jenkins, AWS and Unix shell scripting
- Worked under MapReduce Distribution and familiar with HDFS and installing and configuring Hortonworks distribution of hadoop and other ecosystem components YARN, MapReduce, Flume, HDFS, Sqoop, Zoo Keeper, Oozie, Hive, Pig, Kafka, Solr, Spark
- Performed different testing methods like Unit testing, Integration testing, web application testing and also experienced in migrate an On-premises VM or Azure Classic VM to Azure ARM Subscription with Azure Site Recovery
- Worked with various web-based software development tools (GitHub, JIRA, AWS)
- Created scripts for system administration and AWS using languages such as BASH and Python and experience in Streaming tools Spark, Spark Structure, Kafka Streaming.
- Experience in GoLang concepts like Slices, Maps, Structs, Interfaces, Go routines and Channels
- Developed a fully automated continuous integration system using Git, Gerrit, Jenkins, MySQL and custom tools developed in Python and Bash and also used Pymongo to perform CRUD operations on Mongodb
- Used AWS(Amazon Web services) in Redshift, EmR for improved efficiency of storage and Proficient in SQL databases MS SQL, MySQL, Oracle and no-SQL databases MongoDB, Cassandra.
- Automation (Ansible) and deploying on traditional Vmware, AWS environment and developed user interface using CSS, HTML, Bootstrap, JavaScript and JQuery.
- Documents are stored in MongoDb gridfs and vendor data stored in AWS S3 buckets in the source system
- Followed AGILE development methodology to develop the application and Used the GOProgramming Language to refactor and redesign the legacy databases
- Experience in agile environment using a CI/CD model methodology
- Experience with object oriented programming (OOPS) concepts using Python Actively participated in requirement gathering sessions and capability planning for multi data center Cassandra cluster.
- Deployed AWS VPC, Ingress and Egress rules, AWS EMR, S3 and many other inter connected components using cloud formation template which is auto generated by a python script.
- Designed and managed the PostgreSQL databases for a production Kubernetes cluster and also implemented user interface guidelines and standards throughout the development and maintenance of the website using the HTML5, CSS3, JavaScript, JQuery and Angular JS.
- Used F-Score, Precision, Recall, and A/B testing to evaluate Model performance and created RESTFUL API's for several of our Intranet applications using open source software and developed a variety of consultant reports: sending report options from Plone side to Django server, then
- Involved in a Docker deployment pipeline for custom application images in the private cloud using Jenkins
- Slice the received document with BeautifulSoup and load the data to Mongodb, MS SQL and HDFSDriven programming in Python and developed Spark Structured Streaming job using java to process data from Kafka into Impala tables in parquet format.
- ETL off-loading from Teradata to Hadoop in Architecture and worked on analyzing Hadoop cluster and different Big data analytic tools including Map Reduce, Hive and spark.
- Involved in Continuous Integration (CI) and Continuous Delivery (CD) process implementation using Jenkins along with Shell script
- Real time streaming the data using Spark with Kafka and performance tuning of hadoop eco-system tools (PIG, Hive, HBase, YARN, MapReduce)
- Automated Testing Framework has been built to comply with CI/CD pipeline using Nose Test and PyTest
- Used Python libraries to connect to Elasticsearch and retrieve data from NoSQL data store
- Followed AGILE development methodology to develop the application and also used the GOProgramming Language to refactor and redesign the legacy databases
- Team working and version control using Gerrit
- Programmed store settings form using React and also developed web page and form validation with team using Angular.JS, React.Js, Bootstrap.js, Node.js, Backbone.js, HTML5, CSS & JavaScript.
- Implemented CI/CD pipeline using Jenkins, Ansible Playbooks and Ansible Tower
- Experienced in architecting and implementing Big Data solutions in AWS using Redshift, EMR and AWS machine learning.
- Created a LFTP to copy data from windows to EMR and EMR to S3.
- Worked with data architects by creating scripts for transforming and loading data to Mongodb and MSSQL for their analysis
- Collaborate on and coordinated implementation of front end technical standards, processes, and documentation and created a Full-Service Catalog System which has a full workflow using Elasticsearch.
- For basic search used by different system via an API on top of the Elasticsearch
Environment: Python v3.0 to v3.6.3, Django, AWS, SDK, Slack, React, Gerrit, Hadoop, Bootstrap, Perl, Cassandra, TDD, CLI, SOAP, Azure, AngularJS, PostgreSQL, OSS, Jenkins, Docker, MySQL, MongoDB, HTML, GitHub, JavaScript, ElasticSearch, JSON, XML, JQuery, C & C++, Linux WSDL, UNIX, Restful, CSS, Postgre-SQL, Swagger, Git, JIRA, Apache Spark, Kafka
Sr. Python Engineer
Confidential, South San Francisco, CA
Responsibilities:
- Primarily involved in designing, developing the SDK and testing and implemented MAG SDK features considering usability, security aspects, proof of concepts, continuous integration and documentation.
- Wrote unit tests for the iOS SDK also provided Cordova/JS plugin for the MAG SDK. Rewrite existing Java application in Python 3.0 module to deliver certain format of data and also created User Interface (UI) using JavaScript, bootstrap, Cassandra with MySQL and HTML5/CSS.
- Followed AGILE development methodology to develop the application and Used the GOProgramming Language to refactor and redesign the legacy databases
- Involved in writing the Python script files for processing data and loading to HDFS, and writing CLI commands using HDFS shell commands and experience in Kafka Producer, Consumer, Brokers.
- Used React JS to create controllers to handle triggers and also created unit test/regressionAuto test framework for working/new code and worked with various Spark Actions and Transformations for faster analytics.
- Develop programs to automate the testing of controller in CI/CD environment using Python, Java, Bash script, Git, Linux command line, Java Script
- Private VPN using Ubuntu, Python, Django, CherryPy, Postgres, Redis, Bootstrap, Jquery, Mongo, Fabric, Git, Tenjin, Selenium, Sphinx, Nose
- Designed and implemented and also designed Cassandra schema for the APIs and also responsible for Data Ingestion like Flume and Kafka.
- Develop programs to automate the testing of controller in CI/CD environment using Python, Bash script, Git and Linux command line
- Automated data movement between different Hadoop systems using Apache NiFi.
- Wrote MapReduce programs in python using Hadoop Streaming API and initiated the benefits and values for customers with Big data as a service making the cost savings and agility for the customers and also faster time to insights to maintain the Architecture.
- Designed and developed jQuery components for the front end client side validation and also used spark parameters like number of executors, executor memory to execute the pipeline to increase the performance.
- Experience in writing Sub Queries, Stored Procedures, Triggers, Cursors, and Functions on MySQL and PostgreSQL database.
- Involved in development of Web Services using SOAP for sending and getting data from the external interface in the XML format and also monitor the Spark jobs in Spark URL and Involved in Unit test and debugging after development.
- Utilized ASR (Azure Site Recovery), PowerShell and MVMC (Microsoft Virtual Machine Convertor) for on-premise to cloud migrations and wrote Python modules to view and connect the Apache Cassandra instance.
- Good understanding in Javascript, Angular.js, Bootstrap, Ember.js, Jasmine, Karma, Backbone.js, React.js, MyBatis, require.js, node.js framework concepts and Responsive Design.
- Private VPN using Ubuntu, Python, Django, CherryPy, Postgres, Redis, Bootstrap, Jquery, Mongo, Fabric, Git, Tenjin, Selenium, Sphinx, Nose.
- Used React JS to create views to hook up models to the DOM and analysed the sql scripts and designed it by using Spark SQL for faster performance.
- Implemented AWS High-Availability using AWS Elastic Load Balancing (ELB), which performed a balance across instances in multiple Availability Zones.
- Performed Test Driven Development (TDD) and continuous integration to keep in line with Agile Software Methodology.
- Developed SQL Queries, Stored Procedures, and Triggers Using Oracle, SQL, PL/SQL.
- Responsible for debugging and troubleshooting the web application.
Environment: Python 2.7, Django 1.4, UNIX, Kafka, PYQT, Java, CLI, TDD, PostgreSQL, Hadoop, Cassandra, AWS, Bootstrap, React, Slack, Mongo, AngularJS, Github, OSS, C & C++, XML, EMR, JQuery, DOM, HTML, XHTML, CSS, AJAX, JavaScript, JSON, Rest, PHP, SVN, SDK, MY SQL, Azure, LINUX, Apache Spark
Python Developer
Confidential, Research Triangle Park, NC
Responsibilities:
- Used standard Python modules e.g. CSV, Robot parser, Iter tools, Pickle, Jinja2, Xml for development.
- Managed, developed, and designed a dashboard control panel for customers and Administrators using Django, HTML, CSS, JavaScript, Bootstrap, JQuery and RESTAPI calls.
- Query and set up employee registration and login using Python 2.7 PostgreSQL
- We use a multiple row data storage strategy called MVCC to make effective PostgreSQL responsive in Querying and storing in database.
- Design and develop the test cases for CLI automation using Python.
- Implemented Simpata virtual cloud infrastructure leveraging latest features of Azure portfolio, Microsoft Office 365, Azure Active Directory, Digital Ocean, AWS, and the Simpata dynamic data model.
- Involved in Unit testing, Integration testing, User-Acceptance testing, and Functional testing.
- Developed and tested many features in an Agile environment using Python, Django, HTML5, CSS, JavaScript, Bootstrap and AngularJS.
- Developed Autotest Framework in Selenium for UI Regression Test Automation and when necessary and potentially execute Unit Test automation (Java/Junit).
- Implemented/developed new features for Plone web site, such as Single Sign-On with CAS server/Java and also continuous Integration/Continuous Deployment (CI/CD) Pipeline using Jenkins
- Proficient in writing unit testing code using Unit Test/PyTest and integrating the test code with the build process.
- Created multipage web application forms and nested forms for user to customize the templates and order a print preview by using AngularJS.
- Developed the Command Line Interface (CLI) tool for Red hat Linux.
- Installed OS & libraries/packages; configured network and users/groups and all application servers, such as Mail server, ftp server, Zope ftp server, WebDAV, CAS server, PHP web server, etc.
- Used HTML, CSS, JQuery, JSON and Javascript for front end applications.
- Fixed/Debugged/Enhanced web server functionality for Plone sites on existing servers/instances, such as dynamically achieved dashboard contents for group users, resolving migration errors
- Used interactive data binding, filters and animation events using AngularJS
- Created an on premise CI/CD solution using Jenkins and the Pipeline plugin which uses pipeline as code.
- Responsible for creating efficient design and development of responsive UI using with HTML5, CSS3, JavaScript, MEAN stack (MongoDB, Express, Angular, and Node JS) and React JS.
- Automated RabbitMQ cluster installations and configuration using Python/Bash.
- Used Pandas API to put the data as time series and tabular format for east timestamp data manipulation and retrieval.
- Written shell and build CI/CD pipelines for application and service delivery into Cloud Foundry via Jenkins - build and release with GIT and JFrogArtifactorycripting for automation.
- Provided technical assistance for maintenance, integration and testing of software solutions during development and release processes.
- Created unit test/regression test framework for working/new code.
Environment: Python, Django, Linux, HTML, UNIX, React, Windows CSS, C & C++, OSS Shell Scripting, Bootstrap, AngularJS, SDK, PostgreSQL, MySQL, Python-Twitter Library, Flask, Web services, SVN, Pandas, FileZilla etc.
Java Developer
Confidential, El Segundo, CA
Responsibilities:
- Wrote Automation test cases using Selenium WebDriver using Python API.
- Sole engineer responsible for automated test design, front end and backend feature implementation, and any other improvements to the test automation framework.
- Wrote libraries and test scripts based on the requirements and test plan and good programming knowledge of C++ and HTML
- Managed, developed, and designed a dashboard control panel for customers and Administrators using Django, OracleDB, PostgreSQL, and VMWare API calls.
- Creating unit test/regression test framework for working/new code.
- Involved in UI refactoring that involved extensive use of PyQT and Tkinter.
- Developed Merge jobs in Python 2.0 to extract and load data into MySQL database.
- Used Test driven development (TDD) for developing services required for the application.
- Responsible for generating and delivering the complete test status reports.
- Debugging and solving complex technical networking issues.
- Worked with JSON based REST Web services.
- Creating unit test/regression test framework for working/new code.
- Actively participated in System Testing, production support and maintenance/patch deployments.
- Performed high level design/Detail design and data flow analysis.
- Worked on development of SQL and stored procedures on MySQL.
- Worked closely with database administrators and infrastructure teams to support day-to-day.
- Used Git for the version control.
Environment: Python, Django 1.4, MySQL, Windows, Linux, HTML, CSS, C & C++, JQuery, JavaScript, Apache, Linux.