WebGPU Bridge
On this page
Web mode uses an external JavaScript bridge runtime consumed by llamadart.
Ownership#
- Bridge source and build:
leehack/llama-web-bridge - Published bridge assets:
leehack/llama-web-bridge-assets - This repository consumes those artifacts
Runtime load order#
example/chat_app/web/index.html follows local-first loading:
- Local asset (generated via fetch script):
./webgpu_bridge/llama_webgpu_bridge.js - CDN fallback (jsDelivr)
Fetch pinned local assets with:
WEBGPU_BRIDGE_ASSETS_TAG=v0.1.4 ./scripts/fetch_webgpu_bridge_assets.shCompatibility and safeguards#
- Web backend remains experimental.
- CPU fallback is available through bridge runtime routing.
- Safari compatibility guard and fallback behavior are integrated in this repo.
- Legacy bridge assets may be forced to CPU in Safari when GPU layers are requested.
Runtime overrides#
You can override bridge asset source/version before loader startup:
<script>
window.__llamadartBridgeAssetsRepo = 'leehack/llama-web-bridge-assets';
window.__llamadartBridgeAssetsTag = 'v0.1.4';
</script>Contract reference#
Bridge contract details (global shape, required methods, compatibility targets):