SoundCloud Logo

SoundCloud

Senior Data Engineer - Data Corpus

Posted 9 Days Ago
Be an Early Applicant
London, Greater London, England
Senior level
London, Greater London, England
Senior level
The Senior Data Engineer will build and maintain SoundCloud’s GCP data warehouse, Corpus, facilitating data access and reporting for diverse teams. Responsibilities include designing data architecture, building ETL pipelines with Airflow, and ensuring data quality for analytics and business KPIs.
The summary above was generated by AI

SoundCloud empowers artists and fans to connect and share through music. Founded in 2007, SoundCloud is an artist-first platform empowering artists to build and grow their careers by providing them with the most progressive tools, services, and resources. With over 400+ million tracks from 40+ million artists, the future of music is SoundCloud.

We are looking for an experienced Senior Data Engineer (Level 3) to join the Data Foundations department in our Data Corpus team. You will help us continue building our unified and standardized data warehouse, Corpus, which is used across SoundCloud for reporting, data science, and analytics, building data products, or simply answering questions. You will also help us build out our business-ready data layer to be used in dashboarding and for simplified data usage. You can read more about Data Corpus in our blog post.

About the role

The Data Corpus team is responsible for building and maintaining SoundCloud’s petabyte-scale GCP data warehouse. You will build and maintain the warehouse to abstract the complexity of SoundCloud’s vast data ecosystem to exploit and get value from data. You will work closely with business reporting, data science, and product teams. You will gather and refine requirements, design data architecture and solutions, and build ETL pipelines using Airflow to land data in BigQuery and beyond. You will model and build out the business-ready data layer, designed to feed dashboarding tools with KPIs and simplify data access for business and product stakeholders. You will have knowledge and passion for analytics engineering. You are a strong individual contributor who thrives in a dynamic environment and is motivated by solving challenging data problems.

About you

As a Senior individual contributor, you will be able to manage stakeholders, plan and lead technical projects, and identify and focus the business value of projects. 

Must have:

  • Senior Level Data Professional
    • +6 years experience ideal, +4 years minimum experience.
  • Experience working with Cloud technologies
    • GCP (required)
    • AWS/Azure is also nice to have
  • Experience working with BigQuery
  • Advanced SQL knowledge
  • Python experience
  • Airflow experience
  • Experience working with big data (terabyte/petabyte scale)
  • Experience in Data Architecture/solution design
  • Experience working in Agile methodology, ideally working with Jira.
  • Experience in data warehousing and analytical data modelling.
  • Experience working with CI/CD pipelines and code repositories (Git preferred)
  • Experiencing in building complex and high-reliability ETL pipelines
  • Experience building data for BI Tools (Looker preferred)
  • Experience building datasets for product and business KPIs
  • Knowledge of basic statistical concepts and methods
  • Experience producing high-quality technical documentation
  • Excellent English-speaking communicator and demonstrator

Nice to have:

  • Experience in basic QA engineering and testing methodologies
  • Experience with experimentation (A/B testing) tools and processes
  • Experience working with subscription-based businesses
  • Experience integrating third-party tools and systems
  • Data visualisation skills
  • Experience with terraform

About us

  • We are a multinational company with offices in the US (New York and Los Angeles), Germany (Berlin), and the UK (London)
  • We provide a flexible work culture that offers the opportunity to collaborate and connect in person at our offices as well as accommodating work from home
  • We are deeply committed to ensuring diversity, equity and inclusion at all levels of our organization and fostering a community where everyone’s voice, perspective and experience is respected and heard
  • We believe a strong team is made by investing in employees through mentorship, workshops and enrichment opportunities

Benefits

  • Not located in Berlin? No worries, we offer extensive relocation support including allowances, one way flights, temporary accommodation and, by partnering with Expath, on the ground support on arrival
  • Interested in a gym membership, photography course or book? We have a Creativity and Wellness benefit!
  • Employee Stock Ownership Plan
  • Generous professional development allowance
  • Fertility and Family Building program
  • Flexible vacation and public holiday policy where you can take up to 35 days of PTO annually
  • 16 paid weeks for all parents (birthing and non-birthing), regardless of gender, to welcome newborns, adopted and foster children
  • We offer free German courses at beginning, intermediate and advanced
  • Various snacks, goodies, and 2 free lunches weekly when at the office

Diversity, Equity and Inclusion at SoundCloud

SoundCloud is for everyone. Diversity and open expression are fundamental to our organization; they help us lead what’s next in music by understanding and empowering our creators and fans, no matter their identity. We acknowledge the challenges in the music industry, and strive to influence an inclusive culture where everyone can contribute respectfully and thrive, especially the historically marginalized communities that many of our creators, fans and SoundClouders identify with. We are dedicated to creating an inclusive environment at SoundCloud for everyone, regardless of gender identity, sexual orientation, race, ethnicity, migration background, national origin, age, disability status, or care-giver status.

At SoundCloud you can find your community or elevate your allyship by joining a Diversity Resource Group. Diversity Resource Groups are employee-organized groups focused on supporting and promoting the interests of a particular underrepresented community in order to build a more inclusive culture at SoundCloud. Anyone can join, whether you share the identity or strive to be an ally.


Top Skills

Python
SQL

Similar Jobs

Be an Early Applicant
3 Days Ago
Brentford, Middlesex, England, GBR
Hybrid
68,000 Employees
Junior
68,000 Employees
Junior
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
The Lead Data Engineer will develop and maintain data pipelines, enabling near real-time and batch data processing. Responsibilities include ensuring software reliability, improving the codebase, participating in agile ceremonies, collaborating on technical vision, and operationalizing systems with observability practices.
Be an Early Applicant
6 Days Ago
London, England, GBR
6,000 Employees
Senior level
6,000 Employees
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Senior Data Engineer at Capco, you will design and develop robust data pipelines, collaborate with clients to interpret requirements, and adhere to best engineering practices. You will work on data transformation projects for leading banks, optimizing data engineering processes, and broadening your skills through exposure to diverse technologies.
Be an Early Applicant
6 Days Ago
London, England, GBR
6,000 Employees
Senior level
6,000 Employees
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Senior Data Engineer at Capco, you will design and develop robust data pipelines while adhering to best engineering practices, supporting financial services clients. You will work on data transformation projects, utilizing both cloud and on-premise solutions, and automate data engineering processes across various technologies.

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account