Model APIs made for products, not toys
On-demand frontier models running on the Baseten Inference Stack that won’t ruin launch day.
With Baseten, we now support open-source models like DeepSeek and Llama in Retool, giving users more flexibility for what they can build. Our customers are creating AI apps and workflows, and Baseten's Model APIs deliver the enterprise-grade performance and reliability they need to ship to production.
With Baseten, we now support open-source models like DeepSeek and Llama in Retool, giving users more flexibility for what they can build. Our customers are creating AI apps and workflows, and Baseten's Model APIs deliver the enterprise-grade performance and reliability they need to ship to production.
Build your product with pre-optimized frontier models
Baseten Model APIs are built for production first, with the performance and reliability that only the Baseten Inference Stack can enable.
Ship faster
Use our Model APIs as drop-in replacements for closed models with comprehensive observability, logging, and budgeting built in.
Scale further
Run leading open-source models on our optimized infra with the fastest runtime available, all on the latest-generation GPUs.
Spend less
Spend 5-10x less than closed alternatives with our optimized multi-cloud infrastructure and efficient frontier open models.
Fast inference that scales with you
Try out new models, integrate them into your product, and launch to the top of Hacker News and Product Hunt—all in a single day.
OpenAI compatible
Migrate from closed models to open-source by swapping a URL. We’re fully OpenAI compatible with support for function calling and more.
Pre-optimized performance
We ship leading models optimized from the bottom up with the Baseten Inference Stack, so every Model API is ultra-fast out of the box.
Seamless scaling
Go from Model API to dedicated deployments on the hardware of your choosing in two clicks from the Baseten UI.
Four nines of uptime
We achieve reliability that only active-active redundancy can provide with our cloud-agnostic, multi-cluster autoscaling.
Secure and compliant
We take extensive security measures, never store inference inputs or outputs, and are SOC 2 Type II certified and HIPAA compliant.
Featureful inference
Structured outputs and tool use are baked into our Model APIs as part of the Baseten Inference Stack.
Instant access to leading models
Model library
joey-1
A 2B decision model that turns structured context into calibrated choice, yes/no, and scoring probabilities in a single forward pass.
elephant-1
A 9B decision model that turns structured context into calibrated choice, yes/no, and scoring probabilities in a single forward pass.
mammoth-1
A 27B decision model from Base Labs that returns probabilities over predefined options without generating text, built for classification, routing, and scoring.
DeepSeek V4.1 Flash 1017
Multimodal MoE with 552B backbone parameters, 8B active during prefill and 16B during decoding, and a 1M-token context for agentic workloads.
DeepSeek V4.1 Flash 1017 Fast
Multimodal MoE with a 1M-token context, built for faster coding agents and interactive workflows. The Fast API reports 611 tokens/s, about 2× standard speed.
Kimi K3
The open frontier model. 2.8T parameters, 1M-token context, top benchmarks scores.
GLM-5.3
GLM-5.3 is Z.AI's latest model for agentic engineering, with stronger coding, long-horizon agentic capabilities, and emergent cybersecurity analysis.
GLM-5.3-Flash
GLM-5.3-Flash is Z.AI’s first natively multimodal GLM-5 model, delivering frontier coding and agentic intelligence.
Nemotron 3.5 Super VL
An open 120B-A12B MoE model built for agent workflows across text, images, and video.
Pricing
Price per
1M tokens
Model
Input
Cache Input
Output
Built for every stage in your inference journey
Explore resourcesRime's state-of-the-art p99 latency and 100% uptime is driven by our shared laser focus on fundamentals, and we're excited to push the frontier even further with Baseten.
Rime's state-of-the-art p99 latency and 100% uptime is driven by our shared laser focus on fundamentals, and we're excited to push the frontier even further with Baseten.
