Blog

Inference engineering

All Model performance AI engineering Infrastructure News Community AI models Product Foundations Research

AI engineering

Harnesses are everything. Here's how to optimize yours.

Alex Ker

Zak Keener

Alex Ker

1 other

Three things you can do right now to optimize your harness

Model performance

How to train custom EAGLE-3 heads for speculative decoding

Baseten symbol

Model Performance Team

eagle 3

Infrastructure

How the Baseten Delivery Network (BDN) makes cold starts fast

Gregory Kofman

2 others

How the Baseten Delivery Network (BDN) makes cold starts fast

Model performance

Sub-3 millisecond named entity recognition (NER) inference

Michael Feil

Michael Feil

1 other

Sub-3 millisecond named entity recognition (NER) inference

Foundations

Open-source LLM training is a mess. Here is how it all works.

Paras Stefanopoulos

Product

Baseten Training: an autoresearch substrate

Raymond Cano

Raymond Cano

autoresearch

Model performance

I spent 31 hours on the math behind TurboQuant so you don't have to

Ali Taha

Ali Taha

Turboquant

News

Welcome, Sameer Paranjpye!

Amir Haghighat

Amir Haghighat

photo of sameer paranjpye

Infrastructure

Introducing the Baseten Delivery Network: Fast cold starts for big models

Stephen Day

3 others

Introducing the Baseten Delivery Network: Fast cold starts for big models

1...9 10 11...30