Job Seekers, Please send resumes to resumes@hireitpeople.com
Duties and Responsibilities:
- Designing, implementing, deploying and maintaining highly robust, scalable and flexible data pipelines using AWS Services Glue, Redshift, Lambda, RDS, S3, IAM, CloudFormation etc.
- Experience with development of ETL solutions on Spark framework.
- Automating workflows leveraging DevOps framework (CI/CD/CT) where applicable.
- Experience in understanding of Dimensional data models and Data mapping documents.
- Ensuring quality of technical solutions as data moves across Healthfirst environments.
- Working with solution and data architects to develop, construct, test and maintain architectures, prototypes and design solutions.
- Helping to maintain the integrity and security of the company data.
- Ensures managed analytic assets support Healthfirsts strategic goals by creating and verifying data acquisition requirements and strategy.
- Relentless focus on continuous improvement of solutions in to improve data reliability, efficiency, quality and more.
- Working with solution and enterprise architects to collaborate on research for industry best practices, new features and improvements to existing practices and design.
Minimum Qualifications:
- 6 - 8+ years of Data Engineering experience in a Production cloud infrastructure AWS services - Glue, Redshift, RDS, CloudWatch, CloudFormation, S3, IAM etc.
- 5+ years experience working in a Big Data ecosystem processing data; includes file systems, data structures/databases, automation, security, messaging, movement, etc.
- 4+ years of experience in development in Python.
- Experience in translation of Data mapping documents into PySpark ETL code compatible to be able to run on Glue.
- Hands on work with Amazon Web Services, including creating Redshift and PostgreSQL data structures, accessing them with Spectrum and storing data in S3.
- Proficiency in Python and SQL is a must.
Preferred Qualifications:
- Bachelors Degree or Masters degree from an accredited institution.
- Experience in a production cloud infrastructure AWS services - Lambda, EMR, SNS, SQS, Kinesis etc.
- Demonstrated experience working in an Agile environment as a Data Engineer using VersionOne Software and/or Kanban experience.
- Hands on experience in leading healthcare data transformation initiatives from on-premise to cloud deployment.
- Experience in ServiceNow for deployment of solutions for release in Production.
- Experience in Source Code management tools like Git, build and Deploy tools like Bamboo or Jenkins.
- Experience in Scheduling tools like Control-M.