Job Seekers, Please send resumes to resumes@hireitpeople.com

Summary:

Our client - a major media and entertainment firm located in NYC - has an immediate need for a Data Engineer.

Position Description:

The Data Engineer will be responsible for partnering with Revenue Analytics to onboard and optimize datasets which will be used in the Looker digital analytics platform. To be successful in the role you'll need to be intellectually curious, detail-oriented, open to new ideas, and possess a strong aptitude for quantitative methods. The role requires a strong statistical background, familiarity with modern data warehouses, experience with SQL-like tools, and knowledge of scripting languages (e.g., Python). Experience with predictive modeling or machine learning a plus.

Job Duties:

Create solutions to transform data from various sources and load it into platforms such as Hadoop to create a data lake
Create and maintain transformations to summarize/aggregate data and load these so users can consume this data using various BI/Analytics tools.
Develop and maintain standards for administration and operation including the scheduling, running, monitoring, logging, management of errors, recovery from failures, and validation of outputs.
Contribute to the project planning process by estimating tasks and deliverables.
Work closely with Revenue Analytics team members to understand user requirements.
Be at the cutting edge of utilizing data about consumers in the media industry to improve audience experience.
Help out with complex analytical tasks.

Required Skills:

4+ years solid experience as a database developer in OLAP environment.
BS in computer science, math, physics or equivalent education/training/experience.
Experience with ETL's & Data pipelines
Experience performing QC & cleaning up dirty data
Experience with a "big data” platform such as Hadoop, NoSQL DB's or cloud based tools such as Amazon Redshift.
Experience with Hive and HiveQL
Experienced and comfortable with Unix/Linux operating systems
Expert knowledge in SQL, Python and shell scripting
Ability to work independently and take on projects

Additional skills desired:

Knowledge of SparkQL and/or Postgress SQL would be ideal
Prior understanding and/or experience within a media and entertainment business, ad tech and related data.
Experience with media, Web analytics and consumer data systems is highly desired.

Key aspects of the position: