Sr. AI QA Engineer
Back to JobsMagicforce (eapps Tech LLC Dba Magicforce) Get Smart Job AI Coach in the appFree on iOS and Android
Sr. AI QA Engineer
$75–$95 / Hour
Location
Eden Prairie, Minnesota, USA
Experience
—
Posted
Jul 11, 2026
Apply by
August 10, 2026
Applicants
0
Early applicantEasy applyContractWork from Officequality-assurance
Job Description
Urgent contract requirement for a Senior AI QA Engineer to join a technology team in Eden Prairie, MN. The role focuses on quality assurance for LLM-based systems, covering test strategy, automation, and validation of AI/ML pipelines built on OpenAI and Azure, including RAG pipelines and agentic AI workflows. Only local candidates to the Eden Prairie, MN area will be considered.
Key Responsibilities
- Design and execute quality assurance strategies for LLM-based applications
- Test and validate RAG (Retrieval-Augmented Generation) pipelines built in Python
- Evaluate outputs and performance of OpenAI and Azure AI/ML models
- Build and maintain test automation frameworks for Agentic AI systems
- Identify, document, and track defects across AI/ML pipelines
- Collaborate with AI/ML engineering teams to define quality benchmarks
Requirements
- 12+ years of overall QA/engineering experience
- Hands-on experience testing LLM-based and Generative AI systems
- Strong Python skills for test automation and pipeline validation
- Experience with OpenAI and Azure AI/ML services
- Experience with RAG (Retrieval-Augmented Generation) pipelines
- Experience with Agentic AI systems and frameworks
- Must be local to Eden Prairie, MN and available to start ASAP
Skills Required
RAG PipelinePythonAgentic AIAzureQA AutomationLLM TestingAI/ML Quality AssuranceOpenAI
App exclusive · Free
Smart Job AI Coach
Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.
Interview readiness
See how prepared you are and what to improve for each role.
Personalized tips
Actionable suggestions based on your profile and the job.
After you apply
Keep coaching momentum from job detail through application success.