Architectural patterns to build applications with models’ APIs
The rise of GenAI and LLMs paved the way for a revolution in the field of software development. In fact, from “modern applications” – referring to microservices-based architectures and rapid innovation with CI/CD – we now talk about “intelligent applications” that are infused with GenAI models defined by natural language interaction, data-driven experience, and velocity of adaptation to new models’ releases.
An intelligent app can be described with the following illustration:
Figure 10.3: Anatomy of an intelligent application powered by an LLM
In the above architecture, we depict the anatomy of an intelligent application with the following features:
- It has a natural language interface (it might be text- or voice-based).
- It is powered by an LLM that acts as the “brain” of the app.
- It has a knowledge base that the...