Backend Engineer - Data Platform

Spotify; London; Hybrid; GBP 50,000 - 90,000

Job description

We’re looking for a mid-level Backend Engineer to join Spotify’s Data Platform team. We in the Data Processing Product Area enable Spotify to solve complex and critical data engineering problems by providing a platform and tooling for the production, management, and consumption of high-quality data. We are an amplifier for efficiency, quality, and innovation across Spotify. You’ll design, build, and develop scalable infrastructure services and tools, and collaborate in a cross-functional team. In the DataEx squad, we are looking for a backend/data engineer to help us improve efficiency, optionality, and flexibility for data practitioners through scalable, portable, and reliable data processing platforms.

What You'll Do

• You’ll collaborate with product and engineering to build and support the infrastructure that empowers Spotify teams to process data to solve critical business needs.
• Increase developer productivity by building innovative tools that reduce overhead of working with data pipelines, help increase platform reliability, and are cost-efficient.
• Work with engineers with deep expertise in data and collaborate closely with squads in Spotify to drive improvements in the data processing ecosystem through support, best practices, and standards.
• Help the platform orchestrate data jobs in a seamless way, for the users not having to worry about what is happening “under the hood.”

Who You Are

• You are proficient in backend development using Java.
• You are comfortable working with big data using SQL and data analytics platforms such as BigQuery.
• You have experience with one or more higher-level JVM-based data processing frameworks such as Flink, Beam, Dataflow, Spark, etc.
• DevOps is part of your day-to-day work and you are used to working with cloud-based infrastructure and services, containerized applications.
• You have some experience working with Kubernetes and are familiar with its basic concepts.
• You have experience working with data engineering pipelines in Scala and/or Python.
• Quality is important to you and you know what it means to ship high-quality code.
• You appreciate agile software processes, and sound engineering practices like continuous delivery, defensive programming, and automated testing.
• You love working in an environment where you constantly experiment and iterate quickly. You are comfortable with ambiguity, enjoy working on open-ended problems, and believe data is the most powerful tool for informed decision-making.

Where You'll Be

• This role is based in London.
• We offer you the flexibility to work where you work best! There will be some in-person meetings but still allows for flexibility to work from home.