Key Responsibilities

• Build datasets and evaluation frameworks for AI coding agents
• Design real-world coding, debugging, and refactoring tasks
• Identify failure modes, unsafe behaviors, and security vulnerabilities in AI systems
• Develop scalable data pipelines for AI evaluation and training
• Work on AI safety, robustness, and model evaluation alongside frontier AI research teams

Requirements

• 3-5 years of experience in Applied AI/ML Engineering or Software Engineering with ML exposure
• Hands-on experience with LLMs, AI coding assistants, or agentic AI systems
• Strong software engineering and problem-solving skills
• Experience with AI evaluation, benchmarking, or LLM training pipelines is highly preferred
• Bonus: experience with AI safety, security, or adversarial testing
• Bonus: knowledge of secure coding and common vulnerability patterns
• Bonus: experience with RLHF, SFT, or large-scale data pipelines

Skills Required