Building a Web Scraping Agent with an LLM
The French philosopher Denis Diderot said, “If they find a parrot who could answer to everything, I would claim it to be an intelligent being without hesitation.” Diderot was referring to a parrot, but an LLM could be defined as a sophisticated parrot. There is a difference between answering a question and understanding a question. Therefore, today, we do not define LLMs as intelligent beings. They can though answer almost any question amazingly well. Despite such answering abilities, LLMs cannot perform an action. Therefore, attempts have been made to solve this main limitation with the use of agents.
An AI agent is an extension of an LLM, taking it from a language model toward a system that possesses capabilities such as autonomy, reactivity, pro-activeness, and social ability. This research has focused, on the one hand, on specific applications (such as mastering games such as chess or Go), and on the other, on more general...