← Back to all builds
ds4 – DeepSeek V4 Inference
Native inference engine optimized for DeepSeek V4 and GLM models with support for Metal, CUDA and ROCm.
Related builds
Halo
Post-training framework for open-source models. Up to 2.8x TRL throughput, less peak memory, weights stay HuggingFace-native.
MetalML
scikit-learn workflows on Apple Metal GPU. Change the import, keep fit/predict. Falls back to CPU when it has to.
SeaCat
A system one model like Jev. Typed answers with probabilities, no generated text. pip install seacat or npm install seacat-ai.
spring-ai-agents-md
Zero-config Spring Boot starter that adds AGENTS.md support to Spring AI apps. First-party.
