huawei-csl/KVarN Python

🌐 KVarN

KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.

🌐 KVarN是代理的原生vLLM KV缓存量化后端:上下文多3-5倍,吞吐量高于FP16 , FP16级别的准确性。免校准,一面旗帜。

⭐ 348Stars
🍴 17Forks
🐛 2Issues
🕐 2026-06-04Updated
agentic-aikv-cachellmllm-inferencelong-contextquantizationvllm
Project Insight

Why It Is Worth Watching

From the project description, tags and public data, huawei-csl/KVarN is worth looking at first. It solves problems around the needs of AI applications, agents or large model toolchains. Related tags include agentic-ai, kv-cache, llm, llm-inference, mainly using Python. The most direct message in the project description is: "KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP1...". I will put it in the observation list not because of the Star number itself, but because of its intersection with the recent popularity: about 11 Stars were added in the recent day, recently updated on 2026-06-04, 348 Stars and 17 Fork brought about the accumulation of attention; the most recent code update was on 2026-06-04, this time the statistic was added about 11 Stars relative to the historical benchmark. If it can continue to grow in the next few days, at the same time, Issue, PR, and submission records are also relatively active, indicating that it may not only be forwarded for a short time, but actually stepped on the recent needs of developers. It is more suitable for AI product developers, independent developers and large model landing teams, especially positive

📈 Trend History (2 points)