Codelabs
Build something that runs on the device
Hands-on, step-by-step guides for running language models inside a Flutter app, ordered from first run to full pipelines. Start with the quickstart; the ones marked "Coming soon" are still being written.
Getting Started with On-Device LLMs in Flutter
Install flutter_gemma, pick and download a model, and stream your first reply — then have the app open on the chat, not the download screen.
Start codelab →Package Skills in Flutter: Teach Your Coding Assistant flutter_gemma
flutter_gemma ships agent skills inside the package. Install them for your assistant with one command, ask it for an offline chat and a tool call, and check its code against the traps the skills exist to prevent.
Start codelab →Inference Engines in Flutter: From a Downloaded Model to Built-in AI
LiteRT-LM runs a .litertlm file you ship or download. Built-in AI runs Gemini Nano and Apple Foundation Models with nothing to download at all — the OS owns the weights. Register either engine at startup; the inference code never changes.
Start codelab →Multimodal Inference in Flutter: Vision and Audio on Device
Start seeing on a 0.36 GB vision model, then pay once for a 2.59 GB one that also hears. A modality is a session flag on weights that have the encoder — so the real question is what this platform lets you switch on, and how the app says so.
Start codelab →Function Calling with On-Device Models in Flutter
Declare Dart functions the model can call, drive the call/response loop, and watch it reason first with thinking mode.
On-Device RAG in Flutter: Embeddings and Vector Search
Embed your own documents with EmbeddingGemma, store the vectors in sqlite-vec, and ground the answers — no network at any step.
Building an Offline Voice Assistant in Flutter: STT, LLM, and TTS
Wire speech-to-text, the model, and text-to-speech into one loop that runs in airplane mode — including barge-in.
Hybrid AI in Flutter: From Cloud to On-Device with Genkit Dart
Build an offline travel guide that routes each message between Gemini and on-device Gemma — five policies, images, and RAG.
Start codelab →