Why AI Is Never Really Done ft. Maria Vechtomova
Getting your AI system into production isn’t the finish line. It’s the point where the real work begins.
In this episode of Bringing Data and AI to Life, host Nick Dobbins sits down with Maria Vechtomova, Co-Founder of Cauchy, MLOps expert and O’Reilly author, to unpack what it really takes to make AI reliable beyond the experimentation phase. She breaks down the four principles underpinning MLOps as well as the challenges of evaluating GenAI outputs, governing agentic systems and integrating AI across complex enterprise environments.
The conversation makes one thing clear: AI cannot be treated like static software. Because when the outputs, failure modes and evaluation criteria keep changing, the work is never really “done.”
Not every AI experiment should make it to production, and even when one does, deployment is far from the end of the story.
In this episode of Bringing Data and AI to Life, host Nick Dobbins sits down with Maria Vechtomova, Co-Founder of Cauchy, MLOps expert and O’Reilly author, to explore what happens after AI leaves the experimentation phase.
Maria breaks down the principles that have made MLOps more mature and repeatable, including traceability right through reproducibility as well as reliability and observability.
What You’ll Learn
- Why some AI experiments should never reach production
- The four foundational principles behind strong MLOps practices
- How Generative AI and agentic systems change traditional deployment patterns
- Why evaluating AI output is harder when the definition of “good” keeps changing
- How the acceptable level of AI reliability depends on the cost of getting something wrong
- Why code-based evaluators, LLM-based judges, and human review all have a role in monitoring
- Why treating AI as “finished” after deployment creates long-term problems
- How enablement teams and better integration practices can help enterprises scale AI faster
If you enjoyed this episode, make sure to subscribe, rate, and review it on Apple Podcasts and Spotify. Instructions on how to do this are
here.
Links: