litert-lm

On-device, real-time multimodal AI with features similar to GPT-Live

The most advanced, fully offline client-side AI suite on Android today.

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

Chit-chat with an AI

Cross-platform on-device LLM inference for Dart & Flutter: GGUF via llama.cpp and LiteRT-LM on Android, iOS, macOS, Windows, Linux and web.

🚀 Zero-backend, 100% client-side local AI assistant starter template. Powered by WebGPU and Google LiteRT-LM (Gemma 4). Offline-first PWA with multi-language TTS, customizable personas, and GitHub Pages deployment in 5 minutes.

Run ml models with tflite & litert & executorch runtimes on edge devices

Swift package for running LiteRT-LM models on iOS. Wraps Google's C API in a clean, async/await Swift interface.

An AI agent you build, not just prompt. Local-first Android agent with on-device inference (LiteRT-LM), pipelines you assemble yourself, MCP tool calling, and your confirmation before any risky action.

Custom converter: open-weight Hugging Face LLMs/VLMs -> on-device LiteRT-LM (.litertlm), with one-command reproduction

Private. Local. Yours. Cross-platform On-device LLM & Agent Client powered by LiteRT-LM & Compose Multiplatform.

Fully offline Unity sample for Android: describe camera photos and answer typed questions on-device with Gemma via LiteRT-LM. No network, model bundled in the APK.

Unofficial .NET bindings for Google's LiteRT-LM — on-device LLM inference (Gemma) for Windows, Linux, Android, macOS & MAUI

Rust bindings for LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization

Run LLM inference in an Android app with llama.cpp, ExecuTorch, LiteRT, ONNX, and more.

Edge Agent Lab is an Android testing platform for evaluating small language model (SLM) agents directly on mobile devices.

Cross-platform LiteRT-LM bindings for Unity & .NET apps.

Curated resources for Google's LiteRT on-device ML stack — runtime, LiteRT-LM, conversion tooling, models, bindings, and engineering notes. Weekly-updated by an automated radar.

Unofficial Swift SDK for Google's LiteRT-LM — run Gemma 4 on-device with text, vision, audio, and tool calling. CPU + GPU (Metal). iOS 17+ / macOS 14+.