Mercury-Decide
Mercury-DecideFast structured decisions from Inception. Pass JSON state and a set of questions; Mercury-Decide returns choices, scores, and checks in one call.
Model details
Mercury-Decide is Inception's purpose-built decision model. Instead of generating free-form text, it answers structured questions about your data and returns machine-readable decisions, so your application gets a choice, a score or a check it can act on directly, with no parsing of chat output.
You send a JSON state (the record, event or context to evaluate) and a set of named questions. Mercury-Decide answers each one in a single call:
Choice: pick one option from a defined set of criteria (for example, route a ticket to billing, technical or sales)
Score: select a level on an ordered scale you define (for example, a 0–2 rating)
Checks: yes/no-style questions about the state (for example, whether a field is present or null)
Key capabilities:
Multimodal input: provide both text and image in your request call.
Multiple decisions per request: ask several questions about the same state in one call
Probabilities, not just answers: returns per-option log-probabilities, so you can set confidence thresholds or route low-confidence cases for review
64K-token context for long records, documents or conversation histories
Mercury-Decide uses a dedicated Decisions API (/v1/decisions) rather than the chat completions format. It's best suited to high-volume, latency-sensitive classification and judgment tasks where answers need to be structured and auditable, such as content and policy moderation, ticket triage and routing, data validation and extraction QA, eligibility and compliance checks, and LLM-as-judge evaluation.
Here's an example calling it via the API:
1import json
2import os
3import urllib.request
4
5payload = {
6 "model": "mercury-decide",
7 "state": {"message": "Please refund the duplicate charge on my account."},
8 "questions": {
9 "billing": {"type": "noul", "instructions": "Is this request about billing?"},
10 "team": {
11 "type": "choice",
12 "criteria": {
13 "billing": "Payments, charges, and refunds",
14 "support": "Technical support and other requests",
15 },
16 },
17 "urgency": {
18 "type": "score",
19 "instructions": "How urgent is this request?",
20 "criteria": ["Can wait", "Needs attention soon", "Needs immediate attention"],
21 },
22 },
23}
24request = urllib.request.Request(
25 "https://inference.baseten.co/v1/decisions",
26 data=json.dumps(payload).encode(),
27 headers={"Authorization": f"Api-Key {os.environ['BASETEN_API_KEY']}"},
28 method="POST",
29)
30with urllib.request.urlopen(request, timeout=60) as response:
31 decision = json.load(response)
32print(decision["answers"])1{
2 "model": "mercury-decide",
3 "answers": {
4 "billing": {
5 "type": "noul",
6 "noul": 0.97
7 }
8 },
9 "usage": {
10 "input_tokens": 48,
11 "output_tokens": 1
12 }
13}
