Semiconductor Engineering

Workload-Driven HBF Substrate For Capacity-Scalable LLM Inference (Huawei, ETH Zurich, HUST)

Researchers at Huawei, ETH Zürich, and HUST published a technical paper titled “FLINT: Efficiently Leveraging High Bandwidth Flash for Capacity-Scalable LLM Inference Acceleration.” “LLM inference is ...
Semiconductor Engineering

HBF for High-Throughput LLM Serving (UC Berkeley, FuriosaAI)

Researchers at the UC Berkeley and FuriosaAI published a technical paper titled “Characterizing High Bandwidth Flash for LLM ...
VentureBeat

Google's new neural-net LLM architecture separates memory components to control exploding costs of capacity and compute

A new neural-network architecture developed by researchers at Google might solve one of the great challenges for large language models (LLMs): extending their memory at inference time without ...
SiliconANGLE

LLM developer Mistral AI raises $830M in debt financing to add data center capacity

Mistral AI SAS today disclosed that it has raised $830 million in debt financing from a group of banks. The consortium included Bpifrance, BNP Paribas, Crédit Agricole CIB, HSBC, La Banque Postale, ...