Chat App Example

Path: example/chat_app

Flutter app showing production-style local chat UX with runtime controls.

Live demo: https://leehack-llamadart.static.hf.space

Run#

cd example/chat_app
flutter pub get
flutter run

If you run this example on iOS, set the project deployment target to 16.4 or newer before building.

Test#

cd example/chat_app
flutter test

What it demonstrates#

• Real-time streaming chat UI.
• Model selection and download flow.
• Runtime backend preference and GPU layer controls.
• Persistent settings and split Dart/native logging controls.
• Tool-calling toggles and model capability badges.
• Runtime-verified multimodal capability gating after mmproj load. The app hides unsupported attachment types even if a model family advertises broader multimodal support.

Gemma 4 note#

The download library includes a Gemma 4 E2B GGUF + projector pair. On the current llama.cpp mtmd path used by llamadart, that projector exposes vision support but not audio support, so the app keeps image input enabled and audio input disabled for that model.

Web notes#

On web, this example prefers local bridge assets on localhost for development validation and otherwise prefers CDN assets with local fallback.

Android notes#

• Qwen3.5 0.8B and 2B currently default to CPU on Android because that was the fastest verified path on the maintainer Pixel test device.
• Runtime chips expose native llama.cpp timing breakdowns (p_eval, eval, sample, reuse) so Android CPU vs Vulkan comparisons are visible in-app.
• For general model/backend tuning workflow, use Performance Tuning rather than treating these example defaults as universal rules.