Agentic AI Architect
Back to Jobs
KyndrylGet Smart Job AI Coach in the appFree on iOS and Android 





Agentic AI Architect
Location
Bangalore, Karnataka, India • Hyderabad, Telangana, India • INDLFCHE CHENNAI - DLF IT PARK • Greater Noida, Uttar Pradesh, India
Experience
Senior
Posted
Jul 14, 2026
Apply by
August 13, 2026
Applicants
0
Early applicantEasy applyFull-timeHybrid
Job Description
Who We Are
At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.
The Role
Your role Defines Agentic AI solution architecture, platform patterns, integration strategy, governance, security controls, and scalable multi-agent design. Ensures alignment with enterprise standards and production readiness.
AI Strategy & Architecture
- Define enterprise Agentic AI architecture and technology roadmap.
- Design scalable, modular, and reusable AI agent frameworks.
- Establish architectural standards, governance, and best practices for AI solutions.
- Evaluate emerging AI technologies and recommend adoption strategies.
- Drive AI modernization initiatives across business units.
Agentic AI Solution Design
- Design autonomous AI agents capable of planning, reasoning, memory management, tool usage, and task execution.
- Architect multi-agent collaboration patterns for complex workflows.
- Design orchestration mechanisms for agent communication and coordination.
- Define agent lifecycle management including planning, execution, reflection, and optimization.
- Build reusable AI capabilities across multiple enterprise use cases.
LLM & GenAI Architecture
- Architect solutions leveraging foundation models such as GPT, Claude, Gemini, Llama, Mistral, and enterprise-hosted models.
- Design Retrieval-Augmented Generation (RAG) architectures.
- Develop prompt engineering and prompt management strategies.
- Design semantic search using vector databases.
- Optimize AI inference performance, latency, and operational costs.
AI Platform & Engineering
- Architect scalable AI platforms on Azure, AWS, or Google Cloud.
- Design APIs and microservices supporting AI workloads.
- Integrate AI agents with enterprise systems such as SAP, ServiceNow, Salesforce, Microsoft 365, Jira, Slack, and internal applications.
- Build reusable AI accelerators and reference architectures.
- Define CI/CD pipelines for AI applications (LLMOps/MLOps).
Data & Knowledge Architecture
- Design enterprise knowledge ingestion pipelines.
- Architect document processing, embeddings, vector indexing, and metadata management.
- Define strategies for structured and unstructured data integration.
- Design knowledge graphs and semantic retrieval architectures where appropriate.
Governance, Security & Responsible AI
- Establish Responsible AI guidelines and governance.
- Ensure compliance with enterprise security policies and regulatory standards.
- Implement guardrails against hallucinations, prompt injection, and data leakage.
- Design authentication, authorization, audit logging, and AI monitoring frameworks.
- Ensure explainability, transparency, and ethical AI practices.
Leadership & Collaboration
- Lead architecture reviews and technical design sessions.
- Mentor architects, AI engineers, and development teams.
- Partner with business leaders to identify AI transformation opportunities.
- Drive proof-of-concepts through production deployment.
Required Technical Skills
Artificial Intelligence
- Large Language Models (LLMs)
- Agentic AI
- Multi-Agent Systems
- Autonomous AI Agents
- Retrieval-Augmented Generation (RAG)
- Prompt Engineering
- AI Reasoning & Planning
- AI Memory Architectures
- AI Evaluation Frameworks
Frameworks
- LangChain
- LangGraph
- Microsoft AutoGen
- CrewAI
- LlamaIndex
- OpenAI SDK
Cloud Platforms
- Microsoft Azure
- Azure OpenAI Service
- AWS Bedrock
- Google Vertex AI
- Kubernetes
- Docker
Programming
- Python
- Java
- C#
- JavaScript/TypeScript
- REST APIs
- FastAPI
- .NET
Data Technologies
- SQL
- NoSQL
- Vector Databases (Pinecone, Milvus, Weaviate, Azure AI Search, ChromaDB)
- Elasticsearch
- Cosmos DB
DevOps & AI Operations
- GitHub
- Azure DevOps
- Jenkins
- Terraform
- CI/CD
- MLflow
- LangSmith
- Azure AI Foundry
- PromptFlow
- AI Monitoring and Observability
Your Future at Kyndryl
Every position at Kyndryl offers a way forward to grow your career. We have opportunities that you won’t find anywhere else, including hands-on experience, learning opportunities, and the chance to certify in all four major platforms. Whether you want to broaden your knowledge base or narrow your scope and specialize in a specific sector, you can find your opportunity here.
Who You Are
You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others.
Experience
12–18+ years in Software Engineering, AI/ML, Cloud Architecture, or Enterprise Solution Architecture, with at least 3–5 years designing and implementing Generative AI solutions.
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, Information Technology, or related field.
- 12–18+ years of software engineering or architecture experience.
- 5+ years in AI/ML or Generative AI architecture.
- Experience delivering enterprise-scale AI solutions.
- Strong understanding of cloud-native architectures.
- Experience with enterprise integration patterns.
- Excellent communication, stakeholder management, and leadership skills.
Preferred Certifications (not mandatory)
- Microsoft Certified: Azure AI Engineer Associate
- Microsoft Certified: Azure Solutions Architect Expert
- Microsoft Certified: Azure OpenAI Service (if applicable)
- AWS Certified Machine Learning – Specialty
- Google Professional Machine Learning Engineer
- TOGAF
- Kubernetes Certification (CKA/CKAD)
Success Metrics
- Successful deployment of production-grade Agentic AI solutions.
- Reduction in manual effort through autonomous AI workflows.
- Improved business productivity and operational efficiency.
- High AI reliability, security, and governance compliance.
- Reusable enterprise AI architecture and accelerators.
- Positive stakeholder adoption and measurable business outcomes.
Being You
The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.
What You Can Expect
Your career with us isn’t just a job—it’s an adventure with purpose. We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best.
From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here—and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.
Get Referred!
If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.
Key Responsibilities
- Define enterprise Agentic AI architecture and technology roadmap.
- Design scalable, modular, and reusable AI agent frameworks.
- Establish architectural standards, governance, and best practices for AI solutions.
- Design autonomous AI agents capable of planning, reasoning, memory management, and task execution.
- Architect multi-agent collaboration patterns for complex workflows.
- Design orchestration mechanisms for agent communication and coordination.
- Architect solutions leveraging foundation models such as GPT, Claude, Gemini, Llama, and Mistral.
- Design Retrieval-Augmented Generation (RAG) architectures.
- Develop prompt engineering and prompt management strategies.
- Design semantic search using vector databases.
- Optimize AI inference performance, latency, and operational costs.
- Architect scalable AI platforms on Azure, AWS, or Google Cloud.
- Design APIs and microservices supporting AI workloads.
- Integrate AI agents with enterprise systems such as SAP, ServiceNow, Salesforce, and Microsoft 365.
- Build reusable AI accelerators and reference architectures.
- Define CI/CD pipelines for AI applications (LLMOps/MLOps).
- Design enterprise knowledge ingestion pipelines.
- Architect document processing, embeddings, vector indexing, and metadata management.
- Establish Responsible AI guidelines and governance.
- Ensure compliance with enterprise security policies and regulatory standards.
- Implement guardrails against hallucinations, prompt injection, and data leakage.
- Lead architecture reviews and technical design sessions.
- Mentor architects, AI engineers, and development teams.
Requirements
- Bachelor's degree in Computer Science
- Engineering
- Information Technology
- or related field
Skills Required
Large Language Models (LLMs)Agentic AIMulti-Agent SystemsAutonomous AI AgentsRetrieval-Augmented Generation (RAG)Prompt EngineeringAI Reasoning & PlanningAI Memory ArchitecturesAI Evaluation FrameworksLangChainLangGraphMicrosoft AutoGenCrewAILlamaIndexOpenAI SDKMicrosoft AzureAzure OpenAI ServiceAWS BedrockGoogle Vertex AIKubernetesDockerPythonJavaC#JavaScript/TypeScriptREST APIsFastAPI.NETSQLNoSQLVector DatabasesPineconeMilvusWeaviateAzure AI SearchChromaDBElasticsearchCosmos DBGitHubAzure DevOpsJenkinsTerraformCI/CDMLflowLangSmithAzure AI FoundryPromptFlowAI Monitoring and ObservabilityCommunicationStakeholder managementLeadershipGrowth mindsetCustomer focusInclusivity
Benefits
- Flexible work environment
- Career growth opportunities
- Certification support
- Learning opportunities
- Well-being programs
- Inclusive culture
App exclusive · Free
Smart Job AI Coach
Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.
Interview readiness
See how prepared you are and what to improve for each role.
Personalized tips
Actionable suggestions based on your profile and the job.
After you apply
Keep coaching momentum from job detail through application success.
Similar roles for you
Matched using this role's title and skills. Open the job search anytime to see every listing.

Agentic AI Architect
Kyndryl
Full-timeEasy applyHybrid
BangaloreSenior

Associate Distinguished Engineer (Agentic AI Architect)
Nagarro SE
Full-timeEasy applyWork from Office
IndiaSenior

Principal Data Engineer
Springbrook Software
Full-timeEasy applyWork from Home
United StatesSenior
Generative AI Engineer
Technipros LLC
$60–$120 / Hour
ContractEasy applyWork from Office
New York City

Lead Forward Deployed Engineer (FDE)
LTS
Full-timeWork from Home
United States - RemoteSenior

Snowflake AI Engineer
OmegaHires
ContractEasy applyWork from Home
RemoteEntry