[research]By ByteBulletin Editor
ExpertCache lets a 120B Mixture-of-Experts model run on a 16GB Mac — slowly, but surprisingly intact
Amos Labs' experimental Metal runtime proves oversized sparse MoE checkpoints can fit in constrained Apple Silicon memory without sacrificing functional capability, even if interactive speeds remain out of reach.
