Blog

Inference engineering

All Model performance AI engineering Infrastructure News Community AI models Product Foundations Research

Model performance

The fastest, lowest-cost batch transcription with Qwen3-ASR

Ansel Erol, Forward Deployed Engineer - VoiceAI

Hasan Khan

1 other

How Baseten gets 7x throughput on Qwen3-ASR batch transcription

Model performance

What makes a high-quality NVFP4 quantization?

Chloe Florit

NVFP4 quantization

Model performance

Agentic inference optimization: 50-90% faster engines

Shawn Rushefsky

Baseten engineers leverage agentic inference optimization techniques for up to 90% faster inference

Model performance

How Baseten makes pyannote’s diarization models 9.6x faster

Ansel Erol, Forward Deployed Engineer - VoiceAI

Matte Lim

1 other

How Baseten makes pyannote’s diarization models 9.6x faster

Model performance

Optimizing delta weight syncs for managed RL rollouts

Paras Stefanopoulos

Optimizing delta weight syncs for managed RL rollouts

Model performance

Baseten leads Coval’s voice AI benchmark

Ansel Erol, Forward Deployed Engineer - VoiceAI

Alina Weinstein

Ansel Erol

1 other

leads covals voice ai benchmark

Model performance

The efficient frontier of LLM inference

Philip Kiely

Philip Kiely

The efficient frontier of LLM inference

Model performance

Agentic kernels in production

Faraz Shahsavan

Pankaj Gupta

Brian Li

2 others

Agentic kernels in production

Model performance

Inference engineering for DeepSeek V4 Pro 0813

Baseten symbol

Model Performance Team

Inference engineering for DeepSeek V4 Pro 0813

1 2 3...8