Job Seekers, Please send resumes to resumes@hireitpeople.com

Detailed Job Description:

• 3 years of each: Python, PySpark, and Strong SQL.
• Ability to work in a UNIX environment.
• 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs).
• 3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work.
• Detail oriented. Excellent communication skills (verbal and written) this person might have a few hours of meetings per day.
• Must be able to manage multiple priorities and meet deadlines.
• Degree in Computer Science, Statistics, Economics, Business, Mathematics or related field.

Job Responsibilities:

• Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.
• Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.
• Be able to build Dashboards in R/Shiny for end user consumption.
• Manage and implement data processes (Data Quality reports).
• Develop data profiling, deduping logic, matching logic for analysis.
• Programming Languages experience in Python, PySpark and Spark for data ingestion.
• Programming experience in BigData platform using Hadoop platform.
• Present ideas and recommendations on Hadoop and other technologies best use to management.

Experience required: 5 Years