Now available in preview, DeepSeek V4 cuts inference costs to a fraction of R1

Chinese AI darling DeepSeek is back with a new open weights large language model that promises performance to rival the best ...

Inference pushes AI out of the data center

How a controversial tech from the 2000s could transform AI to make it cheaper, faster and almost indestructible.

Two new TPUs to power the next wave of AI training and inference at Google

Google LLC introduced two new custom silicon chips for artificial intelligence today at Google Cloud Next 2026, unveiling two ...

General Compute Launches ASIC-First Inference Cloud for Autonomous AI Agents

General Compute today announced its inference cloud platform built for AI agents, working with early partners now ahead ...

Novita AI Ranked as the Best Performing & Reliable Inference Layer

As demand for open-source AI infrastructure grows, Novita AI is establishing itself as the inference provider for developers and engineering teams that need fast and affordable inference for ...
Forbes

The Rise Of The AI Inference Economy

Forbes contributors publish independent expert analyses and insights. I write about the economics of AI. When OpenAI’s ChatGPT first exploded onto the scene in late 2022, it sparked a global obsession ...
SDxCentral

DDN, Google Cloud claim Lustre KV cache trick boosts AI inference throughput by 75%

Unveiled at Google’s annual Next event, the pair showcased using Managed Lustre as a shared cache layer across inference ...

I/ONX Shatters the Host Tax: New Symphony SixtyFour Architecture Delivers 50% TCO Savings Across AI Inference and Fine-Tuning Lifecycle

Eliminating infrastructure overhead of legacy designs, I/ONX debuts a scaled AI inference and fine-tuning stack that cuts ...