Beacon
iOS app to download open models from Hugging Face and chat with them on-device. No API keys, no terminal, no subscription.
Related builds
LocalVisionAI for Unity
On-device LLM image understanding in Unity. Offline OCR by describing the target in natural language.
Flutter-QNN
On-device LLMs in Flutter on Snapdragon. Gemma and Qwen via Qualcomm QNN, Hexagon NPU, local streaming.
laya-apple
Same Laya weights on MLX GPU and Apple Neural Engine at once. P99 1593ms to 80ms on M4 Max.
Halo
Post-training framework for open-source models. Up to 2.8x TRL throughput, less peak memory, weights stay HuggingFace-native.