Is there an AI quality Lead in your Dev/AI team?

Every day I speak with AI teams building with LLM-powered applications and something is changing.

I see a new role is quietly forming:

The AI Quality lead as the quality owner.

Not always in title, but increasingly in function.

Why? Because quality in AI products is no longer optional. We see Product managers, data scientist fulfilling this role and are stepping up to define what “good” looks like, which evals to run, and how to act on the results.

We see this is the biggest challenge:

Teams know they need evaluations, but which ones? How often? And how do you make them actionable?

That’s the gap we are filling at @LangWatch :
We guide AI teams to define their own quality standards, implement the right evaluations, and turn a vague goal into a repeatable, structured process.

I think we’ll soon see the rise of the AI Quality PM—or maybe even a dedicated AI Quality Lead.

What do you think? Will this become its own function?

I’d love to hear your take or guide you through what evals you actually need before going to production and in production.