Boson AI Logo

Boson AI

Site Reliability Engineer, AI/ML Infrastructure

Posted 2 Days Ago
In-Office
Santa Clara, CA
Senior level
In-Office
Santa Clara, CA
Senior level
As a Senior Site Reliability Engineer, you will manage HPC cluster operations, deploy infrastructure-as-code solutions, support research teams, and develop automation tools.
The summary above was generated by AI
About The Role

We're looking for a Senior Site Reliability Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers.

You'll be hands-on with the full lifecycle of HPC infrastructure: planning, building, testing, deploying, and keeping everything running smoothly. That means troubleshooting issues as they arise, monitoring performance, developing automation to make our lives easier, and working closely with engineering and science teams to ensure they have what they need. You'll also help us plan for future capacity and evaluate new technologies as we continue to scale.

Responsibilities

  • Manage and optimize HPC cluster operations
  • Deploy and maintain infrastructure-as-code solutions
  • Support ML/research teams with cluster usage optimization
  • Operate, troubleshoot and optimize Ceph storage clusters.
  • Develop automation and tooling

Minimum Qualifications

  • 5+ years of experience in SRE or HPC operations.
  • Proficiency in Linux systems administration (Ubuntu/Debian).
  • Experience with Kubernetes and container orchestration
  • Experience with Ceph >1PB deployments and maintenance
  • Knowledge of security best practices in multi-tenant environments.
  • Understanding of L2/L3 networking fundamentals
  • Skilled in Python and Bash scripting.

Preferred Qualifications

  • Experience with infrastructure-as-code tools (Ansible/Terraform).
  • Experience with GitOps (Helm, ArgoCD).
  • Strong grasp of RDMA, InfiniBand, and GPUDirect technologies
  • Familiarity with deep learning frameworks such as PyTorch and TensorFlow.
  • Familiarity in at least one cloud platform: AWS, Azure or GCP.

If you're a natural problem-solver with a passion for continuous learning, we'd love to hear from you.

Top Skills

Ansible
AWS
Azure
Bash
Ceph
GCP
Gitops
Gpudirect
Infiniband
Kubernetes
Linux
Python
Rdma
Terraform

Similar Jobs

2 Hours Ago
Hybrid
67 Locations
Senior level
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead the development of data solutions using Palantir Foundry, mentor junior staff, manage client accounts, and uphold project standards.
Top Skills: Palantir FoundryPythonTypescript
Expert/Leader
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Manage testing and quality assurance within the banking domain, engage with clients, develop diverse teams, and uphold ethical standards while driving project success.
Top Skills: Ci/Cd PipelinesDevOpsOracle Finance And Financials CloudOracle FinancialsSeleniumSQL
2 Hours Ago
Hybrid
23 Locations
Senior level
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead CCaaS workstreams by managing entire delivery lifecycle, client partnerships, and cross-functional teams to ensure operational excellence and project success.
Top Skills: Bi/Analytics ToolsCcaas PlatformsPower BITelephony MigrationsWfm Tools

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account