Lead Software Engineer - Machine Learning
Back to Jobs
FreshworksGet Smart Job AI Coach in the appFree on iOS and Android 





Lead Software Engineer - Machine Learning
Location
Bengaluru, , India
Experience
Senior
Posted
Jul 7, 2026
Apply by
August 6, 2026
Applicants
0
Early applicantFull-timeWork from Office
Job Description
## Company Description
Organizations everywhere struggle under the crushing costs and complexities of “solutions” that promise to simplify their lives. To create a better experience for their customers and employees. To help them grow. Software is a choice that can make or break a business. Create better or worse experiences. Propel or throttle growth. Business software has become a blocker instead of ways to get work done.
**There’s another option. Freshworks. With a fresh vision for how the world works.**
At Freshworks, we build uncomplicated service software that delivers exceptional customer and employee experiences. Our enterprise-grade solutions are powerful, yet easy to use, and quick to deliver results. Our people-first approach to AI eliminates friction, making employees more effective and organizations more productive. Over 72,000 companies, including Bridgestone, New Balance, Nucor, S&P Global, and Sony Music, trust Freshworks’ customer experience (CX) and employee experience (EX) software to fuel customer loyalty and service efficiency. And, over 4,500 Freshworks employees make this possible, all around the world.
***Fresh vision. Real impact. Come build it with us.***
## Job Description
As a Machine Learning Engineer in the Agentic AI team, you will be at the forefront of the next paradigm shift in artificial intelligence. You will transition from static models to building autonomous, goal-driven intelligent agents capable of dynamic reasoning, tool execution, and complex workflow orchestration. Your role is to bridge the gap between bleeding-edge generative AI research and enterprise-scale, production-ready agentic systems.
**Impact You Will Create**
- **Productionize Autonomous Systems:** Serve as the critical link translating advanced research in LLMs, multi-agent frameworks, and cognitive architectures into highly reliable, product-ready, enterprise-scale implementations.
- **Scale Multi-Agent Workflows:** Build and deploy robust ML infrastructures, runtime environments, and data pipelines engineered to orchestrate and execute millions of autonomous agent decisions with low latency, high efficiency, and safety guardrails.
- **Architect Next-Gen AI Frameworks:** Drive technical alignment by designing scalable agentic frameworks from the ground up, establishing best practices for prompt engineering frameworks, memory systems, and tool-use integration across the organization.
**Roles & Responsibilities**
- **Agentic Framework Implementation:** Collaborate with AI Researchers and Data Scientists to translate complex reasoning loops (e.g., ReAct, Reflection, Tree of Thoughts) and experimental algorithms into clean, production-grade code.
- **End-to-End Agent Architecture:** Design, build, and manage comprehensive agent pipelines, including state management, long/short-term vector memory systems, automated tool-calling integrations, and dynamic feedback loops.
- **High-Performance Service Delivery:** Develop and deploy extensible, scalable API microservices optimized to minimize latency during heavy token generation, parallel agent execution, and high-concurrency traffic loads.
- **Operational Telemetry & Evaluation:** Design and implement robust tracking frameworks to monitor agent drift, hallucination rates, cost/token efficiency, and multi-step execution accuracy to ensure systemic reliability.
- **Strategic Ecosystem Collaboration:** Architect foundational AI primitives from scratch and liaise with cross-product architects to ensure seamless integration of agentic capabilities into existing product ecosystems.
- **Prototyping & LLM Benchmarking:** Lead Proof of Concept (POC) initiatives utilizing diverse tech stacks, open-source orchestrators (e.g., LangGraph, AutoGen, CrewAI), and custom vector infrastructures to validate optimal solutions for complex business workflows.
- **Lifecycle Ownership:** Independently own the full lifecycle of feature delivery—from alignment with product teams on agent objectives to final production deployment, guardrail reinforcement, and continuous optimization.
## Qualifications
**Skills & Competencies**
- **Production Agentic Engineering:** Proven capability in translating raw LLMs/LMMs into reliable, stateful, and autonomous software applications with deterministic guardrails.
- **LLMOps & Agent Evaluation:** Deep expertise in lifecycle management for generative models, including fine-tuning, retrieval-augmented generation (RAG) optimization, prompt versioning, and routing architectures.
- **Distributed State & API Design:** Strong distributed systems architecture skills, specifically in managing asynchronous workflows, message queues, and low-latency API microservices required for multi-agent coordination.
- **Cognitive Telemetry:** Proficiency in establishing monitoring frameworks for tracking agent reasoning paths, tool execution success rates, API cost metrics, and user-intent alignment.
- **Technical AI Leadership:** Ability to execute rapid prototyping with emerging AI stacks, benchmark foundation models, evaluate vector databases, and drive cross-functional alignment.
**Qualifications**
- **Experience:** 6–9 years of professional experience in software engineering and machine learning development, with recent hands-on experience deploying LLM-based or agentic systems into production.
- **Track Record:** A proven history of successfully building, productionizing, and maintaining large-scale Machine Learning solutions and scalable backend architectures.
- **Education:** Degree in Computer Science, Artificial Intelligence, Data Science, or a related quantitative field.
## Additional Information
At Freshworks, we have fostered an environment that enables everyone to find their true potential, purpose, and passion, welcoming colleagues of all backgrounds, genders, sexual orientations, religions, and ethnicities. We are committed to providing equal opportunity and believe that diversity in the workplace creates a more vibrant, richer environment that boosts the goals of our employees, communities, and business. **Fresh vision. Real impact. Come build it with us.**
Key Responsibilities
- Translate complex reasoning loops and experimental algorithms into production-grade code.
- Design and manage comprehensive agent pipelines including state management and vector memory systems.
- Develop and deploy scalable API microservices optimized for low latency and high concurrency.
- Implement tracking frameworks to monitor agent drift, hallucination rates, and execution accuracy.
- Architect foundational AI primitives and integrate agentic capabilities into product ecosystems.
- Lead Proof of Concept initiatives using open-source orchestrators and custom vector infrastructures.
- Own the full lifecycle of feature delivery from alignment to production deployment.
Requirements
- Degree in Computer Science
- Artificial Intelligence
- Data Science
- or a related quantitative field
Skills Required
LLMsLMMsAgentic SystemsLLMOpsAgent EvaluationFine-tuningRAGPrompt EngineeringDistributed SystemsAPI DesignMessage QueuesVector DatabasesLangGraphAutoGenCrewAITechnical AI LeadershipCross-functional collaborationStrategic thinking
App exclusive · Free
Smart Job AI Coach
Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.
Interview readiness
See how prepared you are and what to improve for each role.
Personalized tips
Actionable suggestions based on your profile and the job.
After you apply
Keep coaching momentum from job detail through application success.
Similar roles for you
Matched using this role's title and skills. Open the job search anytime to see every listing.

Machine Learning Engineer III - AI Agent Engineer - Digital and Technology Partners - Onsite/Hybrid
Mount Sinai Health System
132,000–198,065 / Year
Full-timeEasy applyHybrid
United StatesSenior

Lead Forward Deployed Engineer (FDE)
LTS
Full-timeWork from Home
United States - RemoteSenior

Advanced Industrial Software Engineer
Honeywell
Full-timeEasy applyHybrid
Fort WashingtonSenior

Senior Manager, Forward Deployed AI Engineer
Baringa Partners
Full-timeWork from Office
LondonSenior

Lead Machine Learning Scientist
New York Times
166,000–205,000 / Year
Full-timeEasy applyHybrid
New YorkSenior
AI/ML Engineer
Wipro
₹18,00,000–₹35,00,000 / Year
Full-timeEasy applyWork from Office
Bengaluru