AI Platform Engineer
Back to Jobs
eBayGet Smart Job AI Coach in the appFree on iOS and Android 






AI Platform Engineer
Location
Bengaluru, India
Experience
Senior
Posted
Jul 10, 2026
Apply by
August 9, 2026
Applicants
0
Early applicantEasy applyFull-timeWork from Office
Job Description
At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.
Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.
Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.
### About eBay AI Platform
At eBay, we are building a next-generation AI platform to power intelligent, AI-driven experiences across our global marketplace. Our platform runs on large-scale Kubernetes-based compute infrastructure spanning on-premise GPU clusters, high-performance training environments, and hybrid cloud bursting to deliver GPU capacity at scale.
We focus on building resilient, high-performance Kubernetes-native infrastructure—spanning Custom Resource Definitions and operators, a custom AI-aware GPU scheduler, multi-NIC RDMA networking, GPU pool management, and distributed Ray compute via KubeRay—deployed across multiple availability zones with a global dispatcher for unified workload placement across training and inference pools.
### About the Role
We are looking for an experienced Software Engineer specializing in Kubernetes and GPU Infrastructure to design and operate the foundational systems that power eBay's AI platform. You will own critical layers of our infrastructure—from Kubernetes CRD-based automation and a custom AI-aware GPU scheduler to RDMA-optimized multi-NIC GPU clusters and large-scale training environments—enabling our ML teams to train and serve AI models at eBay scale.
You will work on Kubernetes operator development, Gateway API and hybrid cloud networking, multi-NIC RDMA fabric design, a global GPU scheduler with cross-availability-zone dispatch, GPU pool management with provisioned throughput integration, topology-aware workload placement, and KubeRay infrastructure—partnering closely with ML Platform, AI Research, and Networking teams.
### Key Responsibilities
- Design and build Kubernetes Custom Resource Definitions (CRDs) and operators for ML workloads, GPU node pools, and RayService CRDs.
- Architect and operate Kubernetes networking layers including Gateway API, Service Load Balancers, and API gateways for hybrid cloud connectivity.
- Design, deploy, and operate multi-NIC Kubernetes clusters with RDMA-enabled networking.
- Implement and optimize RDMA networking using GPUDirect RDMA, RoCE, and InfiniBand for distributed GPU workloads.
- Build and operate a custom AI-aware GPU scheduler with topology-aware placement, preemption, and GPU defragmentation.
- Design and manage GPU pool management systems across on-premise and cloud-burst GPU environments.
- Deploy and operate KubeRay infrastructure for distributed Ray clusters supporting training and inference workloads.
- Implement cloud bursting and spot or preemptible GPU scheduling to improve utilization.
- Automate GPU asset provisioning, node configuration, and cluster lifecycle management using Infrastructure-as-Code and GitOps.
- Implement networking policies, multi-tenant isolation, RBAC, and security controls across the Kubernetes environment.
- Build observability for GPU utilization, NCCL communication, scheduler decisions, and network throughput.
- Collaborate with ML Platform, AI Research, and Networking teams to optimize infrastructure for training and online inference.
### What We’re Looking For
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience building distributed systems or infrastructure platforms with deep Kubernetes expertise.
- Strong programming skills in Go and/or Python.
- Familiarity with Kubernetes controller development frameworks such as Kubebuilder, Operator SDK, or controller-runtime.
- Deep understanding of Kubernetes internals including the API server, etcd, scheduler, controller manager, and kubelet.
- Hands-on experience designing Kubernetes networking including Gateway API, CNI plugins, service load balancing, and hybrid cloud architectures.
- Experience designing and operating multi-NIC Kubernetes clusters using NVIDIA Network Operator, SR-IOV device plugins, or equivalent tooling.
- Strong understanding of RDMA networking protocols and NCCL configuration for distributed GPU workloads.
- Experience with Kubernetes GPU scheduler frameworks and GPU pool management, including MIG partitioning and preemption policies.
- Hands-on experience deploying and operating KubeRay for distributed Ray workloads.
- Experience with GPU asset lifecycle management, bare-metal provisioning automation, and GitOps-based CD tooling such as Argo CD.
- Familiarity with GPU technologies including NVIDIA CUDA, NVLink, NVSwitch, device plugins, and the GPU Operator ecosystem.
- Experience with observability tooling such as Prometheus, Grafana, and OpenTelemetry.
- Strong debugging and performance optimization skills across GPU driver stacks, RDMA networking, and distributed Kubernetes infrastructure.
**Additional Details**
eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at talent@ebay.com. We will make every effort to respond to your request for accommodation as soon as possible. View our [accessibility statement](https://ebayinc.com/accessibility/) to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.
We use cookies to enhance your experience and may use AI tools for administrative tasks in the hiring process. To learn how we handle your personal data and use AI responsibly, please visit our [Talent Privacy Notice](https://jobs.ebayinc.com/us/en/talent-privacy-notice),[Privacy Center](https://www.ebayinc.com/company/privacy-center/), and [AI Hiring Guidelines](https://jobs.ebayinc.com/us/en/how-we-hire).
Key Responsibilities
- Design and build Kubernetes Custom Resource Definitions and operators for ML workloads and GPU node pools.
- Architect and operate Kubernetes networking layers including Gateway API and hybrid cloud connectivity.
- Design and deploy multi-NIC Kubernetes clusters with RDMA-enabled networking.
- Implement and optimize RDMA networking using GPUDirect RDMA, RoCE, and InfiniBand.
- Build and operate a custom AI-aware GPU scheduler with topology-aware placement and preemption.
- Manage GPU pool management systems across on-premise and cloud-burst environments.
- Deploy and operate KubeRay infrastructure for distributed Ray clusters.
- Automate GPU asset provisioning and cluster lifecycle management using Infrastructure-as-Code and GitOps.
- Implement networking policies, multi-tenant isolation, and security controls.
- Build observability for GPU utilization and network throughput.
- Collaborate with ML Platform, AI Research, and Networking teams to optimize infrastructure.
Requirements
- Bachelor's or Master's degree in Computer Science
- Engineering
- or a related field
Skills Required
KubernetesGoPythonKubebuilderOperator SDKcontroller-runtimeGateway APICNI pluginsNVIDIA Network OperatorSR-IOVRDMAGPUDirect RDMARoCEInfiniBandNCCLKubeRayArgo CDPrometheusGrafanaOpenTelemetryNVIDIA CUDANVLinkNVSwitchDebuggingPerformance optimizationCollaboration
App exclusive · Free
Smart Job AI Coach
Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.
Interview readiness
See how prepared you are and what to improve for each role.
Personalized tips
Actionable suggestions based on your profile and the job.
After you apply
Keep coaching momentum from job detail through application success.
Similar roles for you
Matched using this role's title and skills. Open the job search anytime to see every listing.

Senior AI Infrastructure & Platform Operations Engineer (remote in the EU)
Mirantis
90,000–105,000 / Year
Full-timeEasy applyWork from Home
SofiaSenior

Senior AI Infrastructure & Platform Operations Engineer (remote in the EU)
Mirantis
90,000–105,000 / Year
Full-timeEasy applyWork from Home
BarcelonaSenior

Senior AI Infrastructure & Platform Operations Engineer (remote in the EU)
Mirantis
90,000–105,000 / Year
Full-timeEasy applyWork from Home
PoznańSenior

AI Infrastructure & Platform Operations Engineer (remote in the EU)
Mirantis
60,000–67,000 / Year
Full-timeEasy applyWork from Home
BarcelonaMid

Senior Software Engineer - AI Platform
Tekion
Full-timeEasy applyWork from Office
Bangalore HQSenior

MLOps & AI Platform Engineer
Datamatics Technologies
Full-timeHybrid
KarachiSenior