Lead GPU-edge inference systems, ensuring compliance and performance through design and monitoring. Manage global infrastructure for AI deployment.
Full-time | Remote | Infrastructure | Reports to CTO
About Elloe
Elloe is the trust layer for AI.
We sit between the world’s most powerful language models and the institutions that can't afford to get it wrong — hospitals, banks, regulators. We trace and block failures in real time. That’s not marketing — we’re deployed at the European Commission, with NIH clinical trials, and inside a Top-5 EU bank catching GDPR violations live.
This is the enforcement layer GenAI has been missing. We're not visualizing problems — we're fixing them.
About the Role
You’ll lead our GPU-edge inference systems. From chaos-resilient deployment to SHAP-driven compliance metrics, you’ll own global infra that makes AI safe and performant.
What You’ll Own
1. Global Edge Routing
- Design zone-routing that ensures <50ms SLA in 10+ regions
- Build fallback orchestration to handle compliance-aware rollbacks
2. GPU Infra Ops
- Maximize utilization across 100K+ GPUs via mesh & load prediction
- Integrate compliance overlays with VaultChain and SHAP triggers
3. Reliability Telemetry
- Ship `/vault/audit`, `/inference/predict`, `/compliance/log` endpoints
- Trace every edge request across governance and model layers
Who You Are
- Senior systems engineer with GPU fleet experience (KubeRay, Istio, Envoy)
- Operated real-time AI infra with 10M+ QPS loads
- Comfortable with compliance observability and infra governance
Why This Matters
Our competitive edge isn’t just AI — it’s defensible enforcement. This role turns that into product.
You’ll Leave This Role With
- Referenceable contributions to enforcement infra that’s live in EU and US institutions
- First-hand product work across legal, engineering, and GTM teams
- Influence over how regulatory primitives become systems people trust
Logistics & Application
- Start Date: Flexible (Q3–Q4 ideal)
- Location: Remote-first; timezone overlap with NY or EU preferred
- Compensation: Top of market salary + equity
- To Apply: Send your resume and a sentence on the hardest infra problem you'd want to own at scale.
Similar Jobs
Professional Services
Provide customer support through phone, chat, and email; build customer relationships; protect sensitive data; meet support KPIs; research and resolve issues; learn client tools; and collaborate with developers and cross-functional teams. The role requires fluent C1 English, customer support experience, travel-industry experience, analytical skills, and a reliable remote-work setup.
Top Skills:
Internet ConnectivityPersonal Computer
Information Technology • Professional Services • Social Impact • Financial Services
Lead enterprise change initiatives by developing change strategies, stakeholder engagement plans, communication and training approaches, adoption dashboards, and sustainment actions. Coach leaders and agility ambassadors, facilitate alignment and feedback, monitor adoption metrics, identify risks and lessons learned, and contribute to the Foundation’s change enablement operating model and capability building. The role requires collaboration across enterprise teams and travel to country offices in Africa and Canada as needed.
Top Skills:
Agile Change MethodologiesAsanaKotterLewinExcelMicrosoft PowerpointMicrosoft ProjectMicrosoft WordProsci Adkar
Information Technology • Mobile • Software
Designs and governs the architecture of M-PESA’s Super App, mini-app ecosystem, SDKs, digital payment channels, and partner integrations across six markets. Establishes architecture standards, security and governance frameworks, scalable cloud-native patterns, and payment channel interoperability. Leads SDK lifecycle management, developer ecosystem enablement, resilience and performance architecture, vendor evaluations, and cross-functional architecture reviews while mentoring architects and advising senior technology stakeholders.
Top Skills:
AdrsAndroidApache KafkaApi GatewayAWSAzureBackend-For-Frontend (Bff)C4 ModelComposable UiEmvcoGCPGraphQLHceHeadless ArchitectureiOSMermaidMicro-FrontendsMtlsNfcOauth2Openid ConnectOwasp MasvsQr PaymentsRestWebview
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
