AI Evaluation Engineer
Back to JobsVisionyle Get Smart Job AI Coach in the appFree on iOS and Android
AI Evaluation Engineer
₹12,00,000–₹18,00,000 / Year
Location
Mumbai, India
Experience
—
Posted
Jul 16, 2026
Apply by
December 31, 2027
Applicants
1
Early applicantEasy applyFull-timeWork from Officeengineering
Job Description
AI Evaluation Engineer to design, build, and maintain evaluation frameworks for LLM applications, including LLM-as-a-Judge and D-Evals pipelines, guardrails, bias testing, observability, and Responsible AI practices.
Skills Required
Prompt EngineeringPythonGuardrailsAI EvaluationD-evalsLangSmithLLM
App exclusive · Free
Smart Job AI Coach
Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.
Interview readiness
See how prepared you are and what to improve for each role.
Personalized tips
Actionable suggestions based on your profile and the job.
After you apply
Keep coaching momentum from job detail through application success.
Similar roles for you
Matched using this role's title and skills. Open the job search anytime to see every listing.
AI Engineer
Wise Skulls
$65–$95 / Hour
ContractEasy applyHybrid
Austin
AI Engineer
Apptad Inc
$130,000–$170,000 / Year
Full-timeEasy applyWork from Office
Frisco
Principal AI Engineer
Tek Dallas Inc
$90–$120 / Hour
ContractEasy applyWork from Home
Remote
AI Safety & Evaluation Engineer
Diligent Tec, Inc.
$130,000–$170,000 / Year
Full-timeEasy applyWork from Home
Remote
AI Platform Engineer
Diligent Tec, Inc.
$130,000–$175,000 / Year
Full-timeEasy applyWork from Home
Remote
AI/ML Engineer
B2 Tech Services Private Limited
₹15,00,000–₹30,00,000 / Year
Full-timeEasy applyWork from Office
Bangalore