Job Title: Lead AI QA (GenAI / LLM Systems)

Role Summary:

We are looking for a Lead AI QA to drive quality strategy for Generative AI pipelines, LLM-based applications, and AI agents.

The ideal candidate must have hands-on experience testing GenAI systems, leading QA teams, and ensuring robust, scalable, and responsible AI deployments.

Key Responsibilities:

• Define and lead QA strategy for GenAI pipelines, RAG systems, and multi-agent workflows

• Validate LLM outputs for accuracy, safety, bias, and performance

• Oversee testing of Azure AI Foundry-based solutions

• Ensure quality across LangGraph orchestration and LangSmith evaluation workflows

• Establish automated testing frameworks and evaluation metrics for AI systems