Blog

Inference engineering

All Model performance AI engineering Infrastructure News Community AI models Product Foundations Research

News

Announcing Baseten’s $75M Series C

Tuhin Srivastava

Tuhin Srivastava

Baseten raised a $75M Series C round

Research

Resurrecting the salmon: seeing clearer inside LLMs with domain-specific SAEs

Charles O'Neill

2 others

Model performance

How multi-node inference works for massive LLMs like DeepSeek-R1

Phil Howes

Philip Kiely

Phil Howes

1 other

Multi-node inference

Infrastructure

Testing Llama 3.3 70B inference performance on NVIDIA GH200 in Lambda Cloud

Pankaj Gupta

Philip Kiely

Pankaj Gupta

1 other

Testing GH200 GPUs

News

Baseten Chains is now GA for production compound AI systems

Marius Killinger

Tyron Jung

Marius Killinger

2 others

Baseten Chains

AI engineering

Private, secure DeepSeek-R1 in production in US & EU data centers

Amir Haghighat

Philip Kiely

Yineng Zhang

2 others

DeepSeek R1

Research

Why mechanistic interpretability needs a paradigm inversion

Charles O'Neill

2 others

Model performance

Driving model performance optimization: 2024 highlights

Pankaj Gupta

Pankaj Gupta

MP 2024 highlights

News

New observability features: activity logging, LLM metrics, and metrics dashboard customization

Aaron Relph

Marius Killinger

Sid Shanker

Suren Atoyan

4 others

Observability

1...19 20 21...30