DevTrendsDeveloper trends
Accent color
GitHub Trending

kvcache-ai /

ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

DTLibrary / SDKLanguagePython

About the project

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

Descriptions are drawn from collected community sources.

Discovery history

Dates refer to DevTrends reports. Metrics reflect the snapshot collected at the time.

  1. A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

DEV TRENDS / COMMUNITY

Discuss this project

Sign in with GitHub to share experience, questions, or useful project updates.

Open discussions ↗