Job Seekers, Please send resumes to resumes@hireitpeople.com

Detailed Job Description:

• Extensive experience leveraging Python to build data transformation pipelines (ETL) and experience with libraries such as pandas and numpy.
• Extensive experience with Spark framework (PySpark) for writing complex data transformation logic using AWS EMR Jupyter notebooks.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience using AWS Glue and AWS EMR to construct data pipelines.
• Experience with AWS cloud services: EC2, EMR, Athena, StepFunctions, CloudWatch, EventBridge, Lambda.

The candidate should have a demonstrable track record of the following:

• Experience building and optimizing big data data pipelines, architectures, and datasets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets.
• Building processes supporting data transformation, data visualization, data structures, metadata, dependency, and workload management.
• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• We are looking for a candidate with 5+ years of experience in a Data Engineer role.
• Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field preferred.

They should also have experience using the following software/tools:

• Experience with relational SQL and NoSQL databases, including Postgres.
• Experience with data pipeline and workflow management tools: AWS Glue, Airflow,etc.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, etc.

Experience required: 5-6 Years