Popular ROS 2 AI agent projects
In this section, we will briefly explore some existing ROS 2 AI agent projects.
ROSA
ROSA [11] is an AI agent by NASA designed to interact with ROS 1 and ROS 2-based robot systems using natural language queries. It helps robot developers inspect, diagnose, understand, and control robots. It is based on the LangChain framework and has many custom tools.
Figure 14.13 shows the ROSA project banner.

Figure 14.13: ROSA project banner (source: https://github.com/nasa-jpl/rosa)
Developers can create their own ROS 1 and 2-based agents using their APIs. Here are the instructions to configure ROSA with the OpenAI API key: [15].
RAI
RAI [12] is like ROSA, which was created using LangChain and ROS 2. It has more capabilities than ROSA. It has interfaced with LLMs and VLMs and is vision- and voice-enabled. It has interfaced with Nav2 and MoveIt2, which makes it ideal for controlling any kind of robot.
Figure 14.14 shows the block...