Senior Software Engineer - Data Pipeline/Hadoop Infrastructure | Netflix, Inc. | Los Gatos, CA
Engineering
Senior Software Engineer - Data Pipeline/Hadoop Infrastructure
Cloud and Platform EngineeringLos Gatos, CA
At Netflix, we are building a big data analytics infrastructure in
the cloud by leveraging open source technologies like Hadoop, Hive, Pig
and more. We provide a reliable platform that powers search and
recommendations and surfaces product and consumer insights from a
petabyte scale data-warehouse. Tens of billions of events are processed
daily and the volume is climbing rapidly as we grow our global
subscriber base. This represents a tremendous opportunity to build a
world-class data pipeline and analytics platform in the cloud for our
global and expanding services.
Our big data analytics infrastructure in the cloud is built upon open source technologies like Hadoop, Hive, Pig, Genie, and Lipstick. Particularly, Genie and Lipstick are projects open sourced by the Data Platform team at Netflix.
As part of the big data infrastructure team, you will:
- Design and build best-of-class big data platform in the cloud.
- Become an expert of the Hadoop ecosystem.
- Contribute and work with various open source projects.
- Build tools to make our infrastructure more accessible for our Netflix engineers and data analysts.
- Help migrate business users and engineers from our traditional
data-warehouse stack to our big data-warehouse infrastructure in the
cloud.
- Do performance analysis and capacity planning for our growing clusters.
This is your dream job if you:
- Love to solve complex problems and provide simple elegant solutions.
- Have experience with distributed systems.
- Pride yourself as good coder and an expert in OO programming paradigm (you could be an advocate for either Java or Python).
- Love to work with open source technologies like Hadoop and love to build software in the cloud.
- Have a BS/MS/PhD in Computer Science or related field.
If tackling these kinds of challenges and working on a large scale
service enjoyed by millions of people around the world sound
interesting, we'd love to talk to you!
No comments:
Post a Comment