ds4

About

DwarfStar 4 (ds4) is a narrow C inference engine from Salvatore Sanfilippo (antirez) for running DeepSeek V4/V4.1 Flash, GLM 5.x and Qwen3.8 Flash Next locally on high-memory Mac, CUDA and ROCm machines. It uses asymmetric quantization on routed experts and a KV cache that persists to SSD and survives restarts. Ships a CLI, OpenAI/Anthropic-compatible local APIs, and a native coding agent sharing the same model state. MIT licensed. Benchmark: 34.4 t/s generation on M5 Max 128GB.

Discovery history

1. Product Hunt 新品

   Oct 7, 2026 · 1 observations