← Back to all builds
28.9M Parameter AI on ESP32
Tiny open-source AI model running fully offline on a few-dollar ESP32-S3 chip at ~9.5 tokens/s. No cloud needed.
I love this opensource project! Someone just put a 28.9M parameter AI model on an ESP32-S3. A chip that costs only a few dollars. No cloud. No API. No internet. It runs locally at ~9.5 tokens/s and can generate stories on a tiny screen. This changes the way we think about AI Show more