DevTrendsDeveloper trends
Accent color

spinfinc /

spinf-serve

LanguagePythonOriginalbatch-inferenceOriginalclassificationOriginalcontent-moderationOriginaldecision-modelOriginalextractionOriginalfp8OriginalgemmaOriginalinference-engineOriginalllmOriginalopenai-compatibleOriginalscoringOriginalself-hosted
GitHub ↗Website ↗Source ↗

About

Bulk classification and decision inference on one GPU: the content is read once, every question about it is scored in the same pass. OpenAI-compatible, Apache 2.0

Discovery history

  1. Show HN

    Oct 31, 2026 · 1 observations

Discuss this product