[tag]

#inference

5 stories

[launches]Nov 1, 2026By ByteBulletin Editor

Google Suncatcher satellite runs Gemma 4 in orbit

Google's prototype space data center is online, executing inference tasks with a 20-minute power constraint that highlights the engineering hurdles of orbital AI.

[models]Oct 17, 2026By ByteBulletin Editor

DeepSeek releases V4.1-Flash-1017 model

The new release targets high-throughput inference, marking the latest step in DeepSeek's rapid iteration of open-weight models.

[research]Sep 1, 2026By ByteBulletin Editor

Low-Precision Data Types: A New Frontier for Efficient AI Inference

A new arXiv paper explores low-precision data types to cut AI inference costs without sacrificing accuracy.

[research]Aug 3, 2026By ByteBulletin Editor

Inference Disaggregation: A Practical Path to Per-Request GPU Cost Attribution

A new framework separates the 'prefill' and 'decode' phases of LLM inference to give teams granular, fair cost accounting per request.

[funding]Jul 17, 2026By ByteBulletin Editor

General Compute Lands $400M Loan for Inference Chips, Signaling Shift in AI Infrastructure Financing

The inference cloud startup uses SambaNova chips as collateral in what may be the first large-scale loan tied to non-Nvidia inference silicon.