Blog

Inference engineering

All Model performance AI engineering Infrastructure News Community AI models Product Foundations Research

News

Baseten partners with Google Cloud to deliver high-performance AI infrastructure to a broader audience

Mike Bilodeau

Mike Bilodeau

1 other

Google Cloud + Baseten

News

Introducing Baseten Hybrid: control and flexibility in your cloud and ours

Phil Howes

Mike Bilodeau

Phil Howes

2 others

A GIF showing Baseten Hybrid: inference is run in your VPC, with optional spillover to Baseten Cloud.

Community

Building high-performance compound AI applications with MongoDB Atlas and Baseten

Philip Kiely

Philip Kiely

MongoDB + Baseten

Model performance

How to build function calling and JSON mode for open-source and fine-tuned LLMs

Bryce Dubayah

Philip Kiely

Bryce Dubayah

1 other

JSON Mode

News

Introducing function calling and structured output for open-source and fine-tuned LLMs

Bryce Dubayah

Philip Kiely

Bryce Dubayah

1 other

Function calling + JSON Mode

AI engineering

The best open-source image generation model

Philip Kiely

Philip Kiely

Best image generation models

Model performance

How to double tokens per second for Llama 3 with Medusa

Abu Qader

Philip Kiely

Abu Qader

1 other

Double Llama TPS with Medusa

Community

SPC hackathon winners build with Llama 3.1 on Baseten

Philip Kiely

Philip Kiely

SPC Hackathon winners

News

Introducing Baseten Self-hosted

Anupreet Walia

1 other

Baseten Self-hosted workflow with inference running in a customer's VPC

1...21 22 23...30