spinfinc /

spinf-serve

语言Python原始batch-inference原始classification原始content-moderation原始decision-model原始extraction原始fp8原始gemma原始inference-engine原始llm原始openai-compatible原始scoring原始self-hosted

GitHub ↗官网 ↗来源 ↗

关于

Bulk classification and decision inference on one GPU: the content is read once, every question about it is scored in the same pass. OpenAI-compatible, Apache 2.0

收录记录

Show HN
2026年10月31日 · 1 次收录

spinf-serve

关于

收录记录

讨论这个产品