Blog

Inference engineering

All Model performance AI engineering Infrastructure News Community AI models Product Foundations Research

News

Introducing Baseten Hybrid: control and flexibility in your cloud and ours

Phil Howes

Mike Bilodeau

Phil Howes

2 others

A GIF showing Baseten Hybrid: inference is run in your VPC, with optional spillover to Baseten Cloud.

News

Introducing function calling and structured output for open-source and fine-tuned LLMs

Bryce Dubayah

Philip Kiely

Bryce Dubayah

1 other

Function calling + JSON Mode

News

Introducing Baseten Self-hosted

Anupreet Walia

1 other

Baseten Self-hosted workflow with inference running in a customer's VPC

News

Introducing automatic LLM optimization with TensorRT-LLM Engine Builder

Abu Qader

Philip Kiely

Abu Qader

1 other

TensorRT-LLM Engine Creation

News

Introducing Baseten Chains

Bola Malek

Marius Killinger

Sid Shanker

Mike Bilodeau

Bola Malek

4 others

Introducing Baseten Chains

News

Announcing our Series B

Tuhin Srivastava

Tuhin Srivastava

Baseten co-founders Amir, Tuhin, Phil, and Pankaj

News

Model autoscaling features on Baseten

Jesse Mostipak

Autoscaling

News

Baseten announces HIPAA compliance

The Baseten Team

HIPAA compliance

News

How we achieved SOC 2 and HIPAA compliance as an early-stage company

The Baseten Team

SOC 2 Type II and HIPAA

1...4 5 6