From the course: Agentic AI Economics: Business Models and Pricing Strategies
Join today to access over 24,900 courses taught by industry experts.
The hidden runtime costs
From the course: Agentic AI Economics: Business Models and Pricing Strategies
The hidden runtime costs
- [Tutor] So far, you have seen how intelligent agents operate non-deterministically, making decisions at runtime and adapting on the fly. Once these agents go live, handling real user input and ambiguity, they start to evolve. They in fill gaps, work through tools, implement retries, and improvise, yes, that improvisation is what makes them intelligent, but it also introduces hidden cost, behavior-triggered runtime cost, that only show up in production. Let's start with the first of these costs, Reasoning Loops and Retry Drift. Imagine an agent trying to trigger a refund policy engine, but running into vague errors. After a couple of retries, it might rephrase the original request to the model. to see if it helps, or maybe add more metadata or summarize all prior context. or even try switching tools entirely. But these multiple prompt cycles, multiple API calls. are adding cost in the background, and increasing wait times, AKS latency. that degrades the user experience. Next…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.