[tag]

#compression

2 stories

[tooling]Aug 17, 2026By ByteBulletin Editor

UL-SMF: A Hardware-Software Fabric That Squeezes KV Cache Down to 2.6% of Its Size

A new open-source memory compression fabric claims up to 384x KV-cache reduction with >94% semantic retention, aiming to unblock long-context inference.

[research]Jul 14, 2026By ByteBulletin Editor

KV Cache Compression Study Shows Potential for Dramatically Faster LLM Inference

New research on compressing the key-value cache in transformer models could reduce memory usage and latency, enabling longer context windows and cheaper deployment.