ML Inference Engineer
Back to Jobs
ReactorGet Smart Job AI Coach in the appFree on iOS and Android Google
Google
Google
Google
Google


ML Inference Engineer
Location
San Francisco
Experience
Mid
Posted
Jul 14, 2026
Apply by
August 13, 2026
Applicants
0
Early applicantEasy applyFull-timeWork from Office
Job Description
We're looking for an ML Inference Engineer with deep expertise in high-performance ML engineering. This is a highly technical, high-impact role focused on squeezing every drop of performance from generative media models.
You'll work across the inference stack, designing novel frameworks, optimizing inference performance, and shaping Reactor's competitive edge in ultra-low-latency, high-throughput environments.
### What You'll Do
- Drive our frontier position on model performance for diffusion models
- Design and implement a high-performance in-house inference runtime
- Implement optimizations using torch.compile, custom CUDA kernels, and specialized inference frameworks
- Optimize neural network models through quantization, pruning, and architectural modifications
- Profile and benchmark model performance to identify computational bottlenecks
- Collaborate directly with model partner teams to integrate their models into our platform
### Required Skills
- Bachelor's degree in Computer Science, Electrical Engineering, or a related technical field (or equivalent practical experience)
- Strong foundation in systems programming, with a track record of identifying and resolving bottlenecks
- Deep expertise in PyTorch, TensorRT, TransformerEngine, Nsight, ONNX Runtime
- Model compilation, quantization (INT8/FP16), and advanced serving architectures
- Working knowledge of GPU hardware (NVIDIA)
- Strong understanding of transformer architectures and modern ML optimization techniques
### Benefits
- Competitive SF salary and meaningful early equity
- Visa sponsorship and relocation support
- Generous health, dental, and vision coverage
Key Responsibilities
- Drive frontier position on model performance for diffusion models
- Design and implement a high-performance in-house inference runtime
- Implement optimizations using torch.compile, custom CUDA kernels, and specialized inference frameworks
- Optimize neural network models through quantization, pruning, and architectural modifications
- Profile and benchmark model performance to identify computational bottlenecks
- Collaborate with model partner teams to integrate their models into the platform
Requirements
- Bachelor's degree in Computer Science
- Electrical Engineering
- or a related technical field
Skills Required
PyTorchTensorRTTransformerEngineNsightONNX RuntimeCUDAINT8 quantizationFP16 quantizationGPU hardwareTransformer architecturesSystems programmingCollaboration
Benefits
- Competitive salary
- Early equity
- Visa sponsorship
- Relocation support
- Health insurance
- Dental insurance
- Vision insurance
App exclusive · Free
Smart Job AI Coach
Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.
Interview readiness
See how prepared you are and what to improve for each role.
Personalized tips
Actionable suggestions based on your profile and the job.
After you apply
Keep coaching momentum from job detail through application success.
Similar roles for you
Matched using this role's title and skills. Open the job search anytime to see every listing.
Staff Software Engineer, AI/ML, Google Public Sector
207,000–301,000 / Year
Full-timeEasy applyWork from Office
RestonSenior
Software Engineer, On-Device Machine Learning
174,000–253,000 / Year
Full-timeEasy applyWork from Office
SunnyvaleMid
Staff Software Engineer, Machine Learning Compilers, Edge TPU
207,000–301,000 / Year
Full-timeEasy applyWork from Office
Mountain ViewSenior
Senior Staff Software Engineer, TPU Performance
262,000–365,000 / Year
Full-timeEasy applyWork from Office
SunnyvaleSenior
Senior Software Engineer, Networking
Full-timeEasy applyWork from Office
BengaluruSenior

Data Scientist
BlueConic
Full-timeEasy applyWork from Office
India - PuneMid