Data Science Production Platform Engineer
Cloud and Platform Engineering
At Netflix, we are building a big data analytics infrastructure
currently spanning Cloud and Data Center based technologies. We provide a
reliable platform for Data Science and Engineering teams to gain
product and consumer insights from a large volume of data generated from
our website and Netflix ready devices. Tens of billions of events are
processed daily and the volume is climbing as we gather more data from
our growing global subscriber base. This represents tremendous
opportunity to build a world-class big data pipeline for our global and
expanding service in the cloud.
The Position:
We are looking for a senior member on our team to contribute in the following areas:
- Manage and monitor Data Science production schedule which
includes jobs running on various platforms (Ab Initio, Teradata, Cloud
,Hive and Pig).
- Schedule and automate deployment of code running on our production platform
- Rapid response, trouble-shoot, and triage of platform specific production issues.
- Manage, improve and automate jobs on our scheduler, UC4.
- Query various metadata to improve alerting and notification of these production jobs.
- Design tools to help get better visibility into our production batch.
About you:
- You understand the overall platform infrastructure and technologies used by any data science team.
- You are passionate about automating processes to improve overall efficiency.
- You have exposure to at least one scheduler and how it works (UC4 preferred).
- You understand databases and can write SQL queries.
- You have experience doing production support for a production system.
- You work well in a cross-functional environment and excel in communicating with your peers to gather requirements.
- You thrive on working in a fast-paced, evolving, growing, dynamic environment.
Qualifications:
- 5+ years of relevant development/operations experience.
- Successful track record of providing production support for
large-scale distributed systems, with experience in creating
software/scripts to automate production systems with one of the
following: Python/ Shell
- Experience with UC4 a big plus.
- Experience with data science computing platforms like Teradata, Ab Initio, Amazon AWS, Pig, Hive, Python scripting etc.
- A bachelor's or equivalent degree.
No comments:
Post a Comment