[tag]

#llm-training

2 stories

[research]Aug 25, 2026By ByteBulletin Editor

Entropymoe: A New Entropy-Based MoE Framework Promises More Efficient Sparse Model Training

Researchers propose an entropy-driven routing mechanism for mixture-of-experts models that could reduce compute overhead while maintaining accuracy.

[research]Aug 20, 2026By ByteBulletin Editor

The Quiet Revolution in LLM Data Selection: Curating Quality Over Quantity

New research highlights how smarter data selection — not just more data — is becoming the key lever for training more capable and efficient language models.