Raspberry Pi AI HAT+ 2

The Raspberry Pi AI HAT+ 2 is an add-on board based on the Hailo-10H AI accelerator that brings generative AI capability to Raspberry Pi 5. With 8GB of dedicated on-board RAM, the AI HAT+ 2 is ideal for running large language models (LLMs) and vision-language models (VLMs) locally, leaving the host Raspberry Pi 5 free to handle other tasks. The AI HAT+ 2 delivers reliable, low-latency, accelerated generative AI at the edge, making it the perfect choice for applications including offline process control, secure data analysis, facilities management, and robotics

The AI HAT+ 2 delivers 40 tera-operations per second (TOPS) of INT4 inferencing performance, with computer vision performance equivalent to the 26 TOPS AI HAT+. A set of sample models is provided by Hailo; users can also train custom models to suit their application, such as speech to text, translation, or visual scene analysis.

Like the original Raspberry Pi AI HAT+, the AI HAT+ 2 communicates using Raspberry Pi 5’s PCI Express interface. When the host Raspberry Pi 5 is running an up-to-date Raspberry Pi OS image, it automatically detects the on-board Hailo accelerator and makes it available for AI computing tasks. The built-in rpicam-apps camera applications in Raspberry Pi OS natively support the AI module, automatically using the accelerator to run compatible post-processing tasks.

All of the software for compatible generative AI models can be found in Hailo’s applications GitHub repo.