Perplexity Logo

Perplexity

AI Inference Engineer

Reposted 6 Days Ago
Be an Early Applicant
Easy Apply
In-Office
London, England
Mid level
Easy Apply
In-Office
London, England
Mid level
Develop APIs for AI inference, optimize LLM models, improve system reliability, and handle distributed real-time deployments.
The summary above was generated by AI

Perplexity is an AI-powered answer engine founded in December 2022 and growing rapidly as one of the world’s leading AI platforms. Perplexity has raised over $1B in venture investment from some of the world’s most visionary and successful leaders, including Elad Gil, Daniel Gross, Jeff Bezos, Accel, IVP, NEA, NVIDIA, Samsung, and many more. Our objective is to build accurate, trustworthy AI that powers decision-making for people and assistive AI wherever decisions are being made. Throughout human history, change and innovation have always been driven by curious people. Today, curious people use Perplexity to answer more than 780 million queries every month–a number that’s growing rapidly for one simple reason: everyone can be curious. 

We are looking for an AI Inference engineer to join our growing team. Our current stack is Python, Rust, C++, PyTorch, Triton, CUDA, Kubernetes. You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference.

Responsibilities

  • Develop APIs for AI inference that will be used by both internal and external customers
  • Benchmark and address bottlenecks throughout our inference stack
  • Improve the reliability and observability of our systems and respond to system outages
  • Explore novel research and implement LLM inference optimizations

Qualifications

  • Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
  • Experience with deploying reliable, distributed, real-time model serving at scale
  • (Optional) Understanding of GPU architectures or experience with GPU kernel programming using CUDA
At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe.

To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion.
Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals.
 
Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
 
Equity: In addition to the base salary, equity may be part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.
 
 

Top Skills

C++
Cuda
Kubernetes
Python
PyTorch
Rust
Triton

Similar Jobs

2 Hours Ago
In-Office
West Bromwich, Sandwell, West Midlands, England, GBR
Senior level
Senior level
Aerospace • Information Technology • Cybersecurity • Defense • Manufacturing
Manage Aircraft Maintenance and Modification Operations, overseeing maintenance technicians, ensuring safe and efficient execution of aircraft production, and driving successful project delivery.
Top Skills: Aviation Quality AssuranceCaaEasaFaaMaa RegulationSafety Management System
2 Hours Ago
In-Office or Remote
West Bromwich, Sandwell, West Midlands, England, GBR
Mid level
Mid level
Aerospace • Information Technology • Cybersecurity • Defense • Manufacturing
The Supplier Quality Specialist will manage a portfolio of suppliers, oversee quality processes, and ensure compliance with standards through inspections and metrics presentations.
Top Skills: 2D Manufacturing Drawings3D Manufacturing DrawingsFaa Type Certificate Process
6 Hours Ago
Hybrid
Birmingham, West Midlands, England, GBR
Mid level
Mid level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Manage project planning, execution, and risk management while leading teams and ensuring quality standards for FMCG sector projects.
Top Skills: AsanaMicrosoft Office SuiteMs ProjectTrello

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account