Principal Software Engineer
Back to Jobs
Weekday AIGet Smart Job AI Coach in the appFree on iOS and Android 






Principal Software Engineer
55,00,000–90,00,000 / Year
Location
Bengaluru, Karnataka, India
Experience
Senior
Posted
Jul 10, 2026
Apply by
August 9, 2026
Applicants
0
Early applicantEasy applyFull-timeWork from Office
Job Description
This role is for one of the Weekday's clients
Salary range: Rs 5500000 - Rs 9000000 (ie INR 55-90 LPA)
Experience: 10+ yrs
Location: Bengaluru, Karnataka
Job Type: Full-Time
We are looking for a highly skilled AI Engineer to design, build, and optimize scalable backend systems and intelligent agentic frameworks that power advanced AI applications. In this role, you will work at the intersection of backend engineering, distributed systems, and Generative AI, enabling the deployment of high-performance AI services and intelligent workflows across production environments.
As an AI Engineer, you will collaborate with machine learning engineers, platform teams, and infrastructure specialists to build robust AI platforms, integrate large language models into production, and develop scalable inference pipelines. This role is ideal for professionals who are passionate about distributed AI systems, agentic architectures, and building reliable, production-ready AI solutions.
### Key Responsibilities
- Design and develop scalable backend systems, microservices, and APIs using Python for AI-driven applications.
- Architect distributed infrastructure capable of supporting high-throughput AI workloads and intelligent agent coordination.
- Collaborate with machine learning teams to integrate and deploy trained models into production environments.
- Build and maintain real-time and batch inference pipelines for AI-powered applications and services.
- Develop and optimize AI agent frameworks using modern orchestration technologies and large language models.
- Implement and manage Model Context Protocol (MCP) servers to enable seamless communication between AI agents and external tools.
- Design and optimize Retrieval-Augmented Generation (RAG) pipelines using vector databases and knowledge retrieval systems.
- Contribute to MLOps and DevOps initiatives by implementing CI/CD pipelines, monitoring, observability, autoscaling, and infrastructure automation.
- Optimize system performance, scalability, reliability, and security across AI infrastructure and model-serving environments.
- Collaborate with cross-functional engineering teams to continuously improve AI platform architecture and operational efficiency.
### What Makes You a Great Fit
- Strong professional experience building production-grade applications using Python.
- Expertise in Large Language Models (LLMs) and Generative AI technologies with hands-on experience deploying AI-powered solutions.
- Deep understanding of distributed systems, system design, asynchronous programming, and network architecture.
- Experience building AI agents using frameworks such as LangChain or similar agent orchestration platforms.
- Strong knowledge of Model Context Protocol (MCP) and building interoperable AI agent ecosystems.
- Hands-on experience with vector databases such as FAISS, Pinecone, or Weaviate for knowledge retrieval and RAG implementations.
- Familiarity with machine learning frameworks such as PyTorch, TensorFlow, or JAX and model-serving platforms including Triton Inference Server, TorchServe, ONNX Runtime, or Ray Serve.
- Proficiency with Docker, Kubernetes, cloud platforms (AWS, Azure, or GCP), Infrastructure as Code, and modern CI/CD practices.
- Experience working with SQL/NoSQL databases, Redis, Kafka, RabbitMQ, and scalable backend architectures.
- Strong analytical, problem-solving, and collaboration skills with a passion for building secure, scalable, and production-ready AI systems.
- Exposure to multi-agent systems, AI safety, advanced LLM architectures, or open-source AI projects is an added advantage.
Key Responsibilities
- Design and develop scalable backend systems, microservices, and APIs using Python.
- Architect distributed infrastructure for high-throughput AI workloads and agent coordination.
- Collaborate with ML teams to integrate and deploy trained models into production.
- Build and maintain real-time and batch inference pipelines.
- Develop and optimize AI agent frameworks using orchestration technologies and LLMs.
- Implement and manage Model Context Protocol (MCP) servers.
- Design and optimize Retrieval-Augmented Generation (RAG) pipelines.
- Contribute to MLOps and DevOps initiatives including CI/CD and observability.
- Optimize system performance, scalability, reliability, and security.
- Collaborate with cross-functional teams to improve AI platform architecture.
Skills Required
PythonLarge Language ModelsGenerative AIDistributed SystemsSystem DesignAsynchronous ProgrammingNetwork ArchitectureLangChainModel Context ProtocolFAISSPineconeWeaviatePyTorchTensorFlowJAXTriton Inference ServerTorchServeONNX RuntimeRay ServeDockerKubernetesAWSAzureGCPInfrastructure as CodeCI/CDSQLNoSQLRedisKafkaRabbitMQAnalytical skillsProblem-solvingCollaborationMulti-agent systemsAI safetyAdvanced LLM architecturesOpen-source AI projects
App exclusive · Free
Smart Job AI Coach
Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.
Interview readiness
See how prepared you are and what to improve for each role.
Personalized tips
Actionable suggestions based on your profile and the job.
After you apply
Keep coaching momentum from job detail through application success.
Similar roles for you
Matched using this role's title and skills. Open the job search anytime to see every listing.

Principal Software Engineer (Java Full Stack)
DTCC
Full-timeEasy applyHybrid
ChennaiSenior

Software Engineer / Principal Software Engineer (AHT)
Northrop Grumman
75,100–139,900 / Year
Full-timeEasy applyWork from Office
United States-Oklahoma-Oklahoma CitySenior

Principal Software Engineer
ABB
Full-timeEasy applyWork from Office
BangaloreSenior

Senior Software Systems Engineer
Trident Systems
Full-timeEasy applyWork from Home
USSenior

Principal Software Engineer/Developer
Fidelity Bank
Full-timeEasy applyWork from Office
WestlakeSenior

Systems Analyst (DevOps), School of Continuing Education
Hong Kong Baptist University
Full-timeEasy applyWork from Office
Hong KongSenior