GitHub Trending
jundot /
omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
About the project
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Descriptions are drawn from collected community sources.
Discovery history
Dates refer to DevTrends reports. Metrics reflect the snapshot collected at the time.
- ↗
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
DEV TRENDS / COMMUNITY
Discuss this project
Sign in with GitHub to share experience, questions, or useful project updates.