Forward Deployed Engineer - AI/ML Platforms
Back to Jobs
AnyscaleGet Smart Job AI Coach in the appFree on iOS and Android 






Forward Deployed Engineer - AI/ML Platforms
266,970–287,043 / Year
Location
San Francisco
Experience
Mid
Posted
Jul 7, 2026
Apply by
August 6, 2026
Applicants
0
Early applicantFull-timeWork from Office
Job Description
At [Anyscale](https://www.anyscale.com/), we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing [Ray](https://docs.ray.io/en/latest/), a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like [OpenAI](https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/), [Uber](https://www.uber.com/blog/horovod-ray/), [Spotify](https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/), [Instacart](https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB), [Cruise](https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB), and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by [Andreessen Horowitz, NEA, and Addition](https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200) with $250+ million raised to date.
**About the role:**
As a **Forward Deployed Engineer - AI/ML Platforms** at Anyscale, you’ll partner with some of the world’s most sophisticated AI organizations to design, deploy, and operate the infrastructure powering their production AI workloads.
In this role you will work directly with customer platform, infrastructure, and ML engineering teams to solve complex technical challenges. You will help customers build scalable AI platforms, modernize ML infrastructure, and operationalize distributed AI applications on Ray and the Anyscale platform.
You will combine deep cloud infrastructure expertise with strong customer engagement skills, serving as both a trusted technical advisor and a hands-on engineer. You will work closely with customer teams throughout implementation, from architecture and deployment through production operations. Your work will provide feedback that directly influences the evolution of the Anyscale platform.
**In this role, you will:**
- Design and implement production-grade AI platform architectures on Kubernetes and public cloud infrastructure (AWS, Azure, and GCP).
- Partner directly with customer platform, infrastructure, and ML engineering teams to deploy, operate, and optimize distributed AI workloads.
- Lead implementation engagements that include platform installation, networking, security, observability, scaling, upgrades, and operational readiness.
- Troubleshoot complex distributed systems issues spanning infrastructure, Kubernetes, networking, storage, and AI applications.
- Develop automation, tooling, reference implementations, and infrastructure-as-code that accelerate customer success and improve repeatability.
- Build trusted relationships with technical leaders, platform teams, and executive stakeholders, translating business objectives into robust technical solutions.
- Collaborate closely with Product and Engineering to communicate customer requirements, identify product improvements, and shape future platform capabilities.
- Share best practices through technical documentation, architecture guidance, workshops, and enablement.
**We'd love to hear from you if you have:**
- 5+ years of experience in cloud infrastructure, platform engineering, DevOps, Site Reliability Engineering, or software engineering.
- Experience building, deploying, or operating ML/AI platforms that support model training, inference, or large-scale data processing workloads.
- Strong expertise with Kubernetes and containerized production environments.
- Experience operating cloud infrastructure on AWS, Azure, or GCP, including networking, security, IAM, storage, and infrastructure automation.
- Experience with Infrastructure as Code and modern DevOps tooling such as Terraform, Helm, GitOps, CI/CD pipelines, or similar technologies.
- Strong software engineering skills in Python, Go, Java, or a comparable language, with experience building automation or production services.
- Experience working directly with enterprise customers in consulting, professional services, field engineering, solutions architecture, or another customer-facing engineering role.
- Excellent communication skills and the ability to work effectively with both executive and deeply technical stakeholders.
- Familiarity with distributed computing frameworks such as Ray, Spark, Dask, or Kubernetes-native distributed systems is a strong plus.
- A passion for solving difficult customer problems and building reusable technical solutions.
- Willingness to travel as needed to work alongside strategic customers.
Key Responsibilities
- Design and implement production-grade AI platform architectures on Kubernetes and public cloud infrastructure.
- Partner with customer platform, infrastructure, and ML engineering teams to deploy and optimize distributed AI workloads.
- Lead implementation engagements including platform installation, networking, security, and operational readiness.
- Troubleshoot complex distributed systems issues spanning infrastructure, Kubernetes, networking, and AI applications.
- Develop automation, tooling, and infrastructure-as-code to accelerate customer success.
- Build trusted relationships with technical leaders and executive stakeholders.
- Collaborate with Product and Engineering to communicate customer requirements and shape platform capabilities.
- Share best practices through technical documentation, architecture guidance, and workshops.
Skills Required
KubernetesAWSAzureGCPPythonGoJavaTerraformHelmGitOpsCI/CDInfrastructure as CodeDevOpsSite Reliability EngineeringPlatform EngineeringCommunicationCustomer engagementProblem solvingStakeholder managementRaySparkDaskKubernetes-native distributed systems
App exclusive · Free
Smart Job AI Coach
Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.
Interview readiness
See how prepared you are and what to improve for each role.
Personalized tips
Actionable suggestions based on your profile and the job.
After you apply
Keep coaching momentum from job detail through application success.
Similar roles for you
Matched using this role's title and skills. Open the job search anytime to see every listing.

Applied AI Engineer, ML Infrastructure Engineer / Devops - EMEA
Mistral
Full-timeEasy applyWork from Office
MunichMid

Dynamo AI — Forward Deployed Engineer
David Joseph & Company
150,000–200,000 / Year
Full-timeEasy applyWork from Home
New YorkMid

Lead Forward Deployed Engineer (FDE)
LTS
Full-timeWork from Home
United States - RemoteSenior

Forward Deployed AI Engineer
Deeplearning.ai
175,000–225,000 / Year
Full-timeHybrid
Mountain ViewMid

Senior Manager, Forward Deployed AI Engineer
Baringa Partners
Full-timeWork from Office
LondonSenior

Enterprise AI Engineer
Customers Bank
Full-timeEasy applyWork from Office
MalvernSenior