Senior Data Engineer
New York, NY
Engineering – Advertising R&D /
Remote
Our mission on the Advertising Product & Technology team is to build a next generation advertising platform that aligns with our unique value proposition for audio and video. We work to scale the user experience for hundreds of millions of fans and hundreds of thousands of advertisers. This scale brings unique challenges as well as tremendous opportunities for our artists and creators.
Within Spotify’s Advertising mission, the Audiences team is building products right in the heart of our business. We own Rolodex, a system that powers targeting and is key to respecting privacy and feeding other crucial systems. We are looking for a Senior Data Engineer, eager to work on critical data pipelines and infrastructure that power the current and next generation audience products ensuring they are reliable, scalable and deliver high-quality data.
What You'll Do
- Design, develop and maintain robust, scalable batch and streaming pipelines using Scio, GCP (BigQuery, Dataflow, GCS), and our orchestration stack including Flyte and Styx.
- Build and optimize high-throughput, low-latency pipelines for exciting projects such as Contextual Targeting, Custom Website (ie Pixel-based) Audiences, Artist Affinity audiences and more.
- Collaborate closely with Machine Learning and Staff engineers to design and build strategic products such as the ML-driven 1st party Audiences and the next generation of Lookalike Audiences.
- Take charge of the architecture and development of upcoming key projects such as Pre and Post Campaign Insights, and the creation of Audiences based on the unique data we have about our users.
- Champion scalability, testability, maintainability, reliability and high-quality code, ensuring we follow Spotify’s Golden Path technologies.
- Work in a T-shaped environment, collaborating with engineers, product managers, and other stakeholders, embracing learning and leadership opportunities daily.
- Lead on data architecture and design decisions when needed, while also being comfortable executing on plans, pair-programming and debugging with your teammates.
Who You Are
- Proven experience working with distributed, high-volume production data pipelines and services, and heterogeneous data and tools such as BigQuery and BigTable
- Strong programming skills in Java and/or Scala, with hands-on experience in frameworks like Scio
- Commitment to agile software processes, data-driven development, reliability, and responsible experimentation
- Hands-on experience with orchestration tools like Flyte and Styx
- Excellent problem-solving and communication skills
- Strong interest in, and ideally some experience with, either machine learning or backend development
Where You'll Be
- We offer you the flexibility to work where you work best! For this role, you can be within the North American region as long as we have a work location.
- This team operates within the EST time zone for collaboration.
The United States base range for this position is $160,091- $228,702 plus equity. The benefits available for this position include health insurance, six month paid parental leave, 401(k) retirement plan, monthly meal allowance, 23 paid days off, 13 paid flexible holidays, paid sick leave. These ranges may be modified in the future.
Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.
At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.
Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service.
