Crypto Briefing

DeepSeek open-sources DeepInfer, the inference engine behind its production models

DeepSeek open-sourced DeepInfer, its Apache-2.0 inference framework for V4.1-Flash, with support for NVIDIA SM100 and Huawei ...
Tech Times on MSN

DeepSeek open-sources its inference engine, withholds cost-saving components

DeepSeek open-sources DeepInfer, its production AI inference framework for V4.1-Flash, under Apache 2.0 - but withholds ...
TMCnet

Ready Server Launches ReadyServer LLM API, Giving Every VPS Customer Private AI Inference at No Extra Cost

Instead of metering tokens, ReadyServer LLM API runs on a fair-share policy that keeps any single workload from crowding out ...
VentureBeat

Lambda launches 'inference-as-a-service' API claiming lowest costs in AI industry

Lambda is a 12-year-old San Francisco company best known for offering graphics processing units (GPUs) on demand as a service to machine learning researchers and AI model builders and trainers. But ...
Tech Times

Open-Source llm-d 1.0 Hits Production: IBM Research Confirms 11.5× AI Inference Cost Drop

LLM inference hit version 1.0 today at PyTorch Conference, with IBM Research reporting $0.11 per million tokens at production ...
Unite.AI

Fortytwo Launches Engine API, Reporting 24.7% Fewer Tokens on Coding Tasks

Fortytwo has launched Fortytwo Engine, an inference API that uses cooperating AI models to improve reasoning while reducing ...
Yahoo Finance

OpenRouter raises $40 million to scale up multi-model inference for enterprise

NEW YORK, June 25, 2025 (GLOBE NEWSWIRE) -- OpenRouter, the unified interface for large-language-model (LLM) inference, today announced that it has closed a combined Seed and Series A financing of $40 ...
VentureBeat

Nous Research just launched an API that gives developers access to AI models that OpenAI and Anthropic won't build

Nous Research, the New York-based AI collective known for developing what it calls "personalized, unrestricted" language models, has launched a new Inference API that makes its models more accessible ...
Nasdaq

Elasticsearch Open Inference API Extends Support for Hugging Face Models with Semantic Text

Applications using Hugging Face embeddings on Elasticsearch now benefit from native chunking “Developers are at the heart of our business, and extending more of our GenAI and search primitives to ...
InfoWorld

Meta will offer its Llama AI model as an API too

Enterprises will be able to access Llama models hosted by Meta, instead of downloading and running the models for themselves. Meta has unveiled a preview version of an API for its Llama large language ...
Unite.AI

Physical Intelligence Opens Pi API Beta for Robot Foundation Models

Physical Intelligence announced the Pi API beta on October 13, 2026, making its latest robotic foundation models available to ...
Business Wire

Elasticsearch Open Inference API now Supports Jina AI Embeddings and Rerank Model

Developers using Elastic to build search and RAG applications can now use the latest Jina AI embedding and reranking models without additional integration or development costs SAN FRANCISCO--(BUSINESS ...