产品
VernLLM
VernLLM is a lightweight resilience layer for LLM clients that handles retries, timeouts, circuit breakers, caching, rate limiting, observability and cross provider fallbacks for your calls. Works with OpenAI, Anthropic,…
关于
VernLLM is a lightweight resilience layer for LLM clients that handles retries, timeouts, circuit breakers, caching, rate limiting, observability and cross provider fallbacks for your calls. Works with OpenAI, Anthropic, Bedrock, Gemini, and 30+ providers. Get schema-validated outputs, cache coalescing, tool calling, and streaming too. Framework agnostic and adapter-based, so you can swap providers easily. Built to save teams the sprints and incidents of maintaining LLM infrastructure.
收录记录
- Product Hunt 新品
讨论这个产品