Key Responsibilities

• Design, build, and maintain automated test suites using Playwright (JavaScript/TypeScript)
• Perform GenAI and LLM evaluation testing, assessing outputs for accuracy and quality
• Evaluate AI models against metrics such as hallucination rate, bias, toxicity, and semantic similarity
• Integrate AI-assisted development and testing tools such as Cursor, GitHub Copilot, and Playwright MCP servers into workflows
• Execute and maintain UI and API automation testing across the product
• Collaborate with engineering teams to identify, document, and track defects

Requirements

• 5+ years of software testing experience
• 2+ years of hands-on experience with Playwright (JavaScript/TypeScript)
• 1–2 years of experience in GenAI/LLM evaluation testing
• Familiarity with AI evaluation metrics: hallucination, bias, toxicity, semantic similarity
• Hands-on experience with Cursor, GitHub Copilot, Playwright MCP servers, or similar AI tools
• Strong background in UI and API automation testing

Skills Required