SQLite-AI

SQLite-AI is an extension for SQLite that brings artificial intelligence capabilities directly into the database. It enables developers to run, fine-tune, and serve AI models from within SQLite using simple SQL queries — ideal for on-device and edge applications where low-latency and offline inference are critical. The extension is actively developed by SQLite AI, some API and features are still evolving.

Features

• Embedded AI Inference: Run transformer models directly from SQL queries.
• Streaming I/O: Token-by-token streaming via SQL aggregate functions.
• Fine-tuning & Embedding: On-device model customization and vector embedding.
• Full On-Device Support: Works on iOS, Android, Linux, macOS, and Windows.
• Offline-First: No server dependencies or internet connection required.
• Composable SQL Interface: AI + relational logic in a single unified layer.
• Audio Transcription: Speech-to-text via Whisper models (WAV, MP3, FLAC).
• Vision / Multimodal: Analyze images via multimodal models (JPG, PNG, BMP, GIF).
• Supports any GGUF model: available on Huggingface; Qwen, Gemma, Llama, DeepSeek and more

SQLite-AI supports text embedding generation for search and classification, a chat-like interface with history and token streaming, automatic context save and restore across sessions, audio transcription via Whisper models, and vision/multimodal image understanding — making it ideal for building conversational agents, memory-aware assistants, and voice-enabled applications.