curl --request POST \
  --url https://api.moonbounce.ai/v1/decisions/{decision_id}/runs \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data @- <<EOF
{
  "structure_hash": "sha256:bdad6e5b1b879209305f1555b43ec62666a4d74a925280c66e54cc4dc07bb1ae",
  "dry_run": true,
  "items": [
    {
      "item_id": "t-001",
      "state": {
        "message": "My tent showed up two weeks late, I used it once on the trip it was for, and now it's day 39. Can I still return it?"
      },
      "attribute_values": {
        "days_since_delivery": 39
      },
      "expected": "escalate",
      "label_source": "human"
    },
    {
      "item_id": "t-002",
      "state": {
        "message": "The zipper broke the first time I opened the bag. It arrived four days ago."
      },
      "attribute_values": {
        "days_since_delivery": 4
      },
      "expected": "grant",
      "label_source": "human"
    }
  ]
}
EOF

{
  "run_id": "evr_0199f2c4-1a2b-7c3d-8e4f-5a6b7c8d9e20",
  "expires_at": "2026-11-07T10:00:00.000Z",
  "dry_run": true,
  "environment": "test",
  "decision_id": "refund-exception",
  "version": {
    "structure_hash": "sha256:bdad6e5b1b879209305f1555b43ec62666a4d74a925280c66e54cc4dc07bb1ae",
    "number": 1
  },
  "model": {
    "id": "jev-1.14.0",
    "resolved_model": "jev-1.14.0",
    "revision": 1,
    "profile": "defective=jev:jev-1.14.0@jev@0.1.0,item_used=jev:jev-1.14.0@jev@0.1.0"
  },
  "counts": {
    "total": 2,
    "decided": 2,
    "computed": 0,
    "abstained": 0,
    "failed": 0,
    "labeled": 2
  },
  "cost": {
    "model_calls": 2,
    "questions": 4,
    "input_tokens": 1040,
    "output_tokens": 8,
    "usd_micros": 42
  },
  "results": [
    {
      "item_id": "t-001",
      "id": "dry_0199f2c4-1a2b-7c3d-8e4f-5a6b7c8d9e21",
      "status": "decided",
      "outcome": "escalate",
      "cost": {
        "model_calls": 1,
        "questions": 2,
        "input_tokens": 520,
        "output_tokens": 4,
        "usd_micros": 21
      }
    },
    {
      "item_id": "t-002",
      "id": "dry_0199f2c4-1a2b-7c3d-8e4f-5a6b7c8d9e22",
      "status": "decided",
      "outcome": "grant",
      "cost": {
        "model_calls": 1,
        "questions": 2,
        "input_tokens": 520,
        "output_tokens": 4,
        "usd_micros": 21
      }
    }
  ]
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

evaluate

Run a version over many items

Evaluates up to 200 items under one version, each exactly as one evaluate would, and keeps the results under a run_id for loss_report and sweep_cut. The body is flat, as import_examples’ is: the structure inline (questions, attributes, aggregations, result) or a registered one’s structure_hash, never both; then items or cases, dry_run and include. The decision is the path’s. Items: each {item_id, state, attribute_values?, expected?, label_source?}, item_id unique in the run. Each is stored as an evaluation, or with dry_run: true is a dry run that stores only usage; each result carries its id (evl_ or dry_). Score versions with dry runs: a stored run’s evaluations are real traffic. expected (an outcome) and label_source (human, synthetic or unknown) are the item’s label, kept with the run for loss_report, never used to evaluate and never recorded as feedback. Every item’s content is checked before any model call: content the structure refuses is 400 CONTENT_INVALID naming items.<i>. An item whose model calls fail is that item’s result (status failed, with an error whose code says why and retryable whether sending it again may help); the call fails only on an invalid request, auth, admission or a store error. An outage of any kind (unavailable, rate limited, timeout, auth) is retryable; only the content’s own failure is not. Stored cases: send cases in place of items to evaluate the decision’s labeled cases (the ones list_cases lists; this needs the decisions:develop scope): {evaluation_ids}, or list_cases’ filters (outcomes, structure_hash, label_source, since, until) with limit (default 200) and cursor (cases.next_cursor from the previous run). They are always dry runs: each case is replayed as a preview replays it, reusing the answer it stored for a question that hasn’t changed (same model) and asking the rest; refresh names questions to ask afresh. Each result carries the case’s evaluation_id, and the run keeps its label, label source and answer corrections, so a preview equals a case run under the base (refreshing the questions the candidate changed or dropped), one under the candidate, and loss_report over the two, when both runs set cases.outcomes to the outcomes either version can produce and cover the same cases (a preview judges the newest 500: page both runs through them while no label changes; a page is not a snapshot), and both versions can read every case’s stored content. The run reports version and model as evaluate does. It is kept until expires_at: pass its run_id to loss_report to judge it, so the results never pass through your context; a stored run’s evaluations stay after it expires, and it can’t be read back by id. include adds each result’s answers, attributes, or evaluation (everything one evaluate returns for that item). Each item that succeeded is billed as one evaluate or dry run would be; a failed item’s spend is recorded and shown as its cost. A run has a 60 s budget and takes no model; items it could not start fail with NOT_STARTED, and a case it ran out of time for with ENGINE_UNAVAILABLE (both retryable): send them in a new run with a new Idempotency-Key. 201 with the run; an Idempotency-Key replays the first response without spending again.

POST

decisions

{decision_id}

runs

curl --request POST \
  --url https://api.moonbounce.ai/v1/decisions/{decision_id}/runs \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data @- <<EOF
{
  "structure_hash": "sha256:bdad6e5b1b879209305f1555b43ec62666a4d74a925280c66e54cc4dc07bb1ae",
  "dry_run": true,
  "items": [
    {
      "item_id": "t-001",
      "state": {
        "message": "My tent showed up two weeks late, I used it once on the trip it was for, and now it's day 39. Can I still return it?"
      },
      "attribute_values": {
        "days_since_delivery": 39
      },
      "expected": "escalate",
      "label_source": "human"
    },
    {
      "item_id": "t-002",
      "state": {
        "message": "The zipper broke the first time I opened the bag. It arrived four days ago."
      },
      "attribute_values": {
        "days_since_delivery": 4
      },
      "expected": "grant",
      "label_source": "human"
    }
  ]
}
EOF

{
  "run_id": "evr_0199f2c4-1a2b-7c3d-8e4f-5a6b7c8d9e20",
  "expires_at": "2026-11-07T10:00:00.000Z",
  "dry_run": true,
  "environment": "test",
  "decision_id": "refund-exception",
  "version": {
    "structure_hash": "sha256:bdad6e5b1b879209305f1555b43ec62666a4d74a925280c66e54cc4dc07bb1ae",
    "number": 1
  },
  "model": {
    "id": "jev-1.14.0",
    "resolved_model": "jev-1.14.0",
    "revision": 1,
    "profile": "defective=jev:jev-1.14.0@jev@0.1.0,item_used=jev:jev-1.14.0@jev@0.1.0"
  },
  "counts": {
    "total": 2,
    "decided": 2,
    "computed": 0,
    "abstained": 0,
    "failed": 0,
    "labeled": 2
  },
  "cost": {
    "model_calls": 2,
    "questions": 4,
    "input_tokens": 1040,
    "output_tokens": 8,
    "usd_micros": 42
  },
  "results": [
    {
      "item_id": "t-001",
      "id": "dry_0199f2c4-1a2b-7c3d-8e4f-5a6b7c8d9e21",
      "status": "decided",
      "outcome": "escalate",
      "cost": {
        "model_calls": 1,
        "questions": 2,
        "input_tokens": 520,
        "output_tokens": 4,
        "usd_micros": 21
      }
    },
    {
      "item_id": "t-002",
      "id": "dry_0199f2c4-1a2b-7c3d-8e4f-5a6b7c8d9e22",
      "status": "decided",
      "outcome": "grant",
      "cost": {
        "model_calls": 1,
        "questions": 2,
        "input_tokens": 520,
        "output_tokens": 4,
        "usd_micros": 21
      }
    }
  ]
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

{
  "error": {
    "type": "invalid_request",
    "message": "<string>",
    "reason": "<string>",
    "param": "<string>",
    "details": {
      "issues": [
        {
          "param": "<string>",
          "code": "<string>",
          "message": "<string>"
        }
      ]
    }
  }
}

Authorizations

Authorization

string

header

required

An API key, sent as Authorization: Bearer <key>. Each operation lists the scope its key needs: decisions:evaluate (evaluate and read evaluations), decisions:feedback (your app's feedback) or decisions:develop (everything else, including owner feedback and the review queue). An operation listing no scope takes any scoped key. A key with no scope, or without the operation's, gets 403 INSUFFICIENT_SCOPE.

Headers

idempotency-key

string

Makes a retry safe. For 24 hours, the same key with the same request returns the first stored result (with Idempotent-Replayed: true); the same key with a different request is a 422 IDEMPOTENCY_KEY_REUSED. Keys are scoped to the organization and environment across every operation, so use a fresh key per request. A request that failed before its result was stored runs again when retried with its key.

Required string length: 1 - 255

Pattern: ^[\x20-\x7e]+$

Path Parameters

decision_id

string

required

A name you choose for this decision, such as refund-exception: a lowercase letter, then up to 127 of a-z 0-9 _ . -. Unique in your organization and shared by its test and production keys. The first registration or evaluation under a new one creates the decision.

Pattern: ^[a-z][a-z0-9_.-]{0,127}$

Body

application/json

Option 1
Option 2

questions

object

required

System One questions, keyed by name.

Show child attributes

result

string

required

The final feature's path, such as aggregations.band.

Required string length: 1 - 80

Examples:

"questions.asks_for_refund"

"aggregations.band"

attributes

object

Values your app supplies with each call in attribute_values. The model never sees them.

Show child attributes

aggregations

object

Show child attributes

items

object[]

The items to evaluate under the same version, each exactly as one evaluate would. Send items or cases.

Required array length: 1 - 200 elements

Show child attributes

cases

object

The decision's labeled cases to evaluate, in place of items: by evaluation_ids, or by the filters list_cases takes (the same cases, newest label first, limit per run; pass cases.next_cursor back for the next page). Always dry runs. Each case is replayed: a question unchanged since the case ran reuses the answer it stored (the same model), the rest are asked. Its label, label source and answer corrections go with the run for loss_report.

Option 1
Option 2

Show child attributes

refresh

string[]

With cases: questions that get fresh answers instead of the ones the cases stored (as a preview refreshes the base questions a candidate changed or dropped).

Minimum array length: 1

Pattern: ^[a-z][a-z0-9_]{0,63}$

include

enum<string>[]

Add to each result its answers, its attributes (as resolved, defaults applied), or its evaluation: everything evaluate returns for that item on its own. Default: none.

Available options:

answers,

attributes,

evaluation

dry_run

boolean

true: every item is a dry run, storing no evaluation (only usage, and the run's results for a day). Absent or false: each item is stored as an evaluation, real traffic. A run of cases is always a dry run.

structure_hash

any

Must be absent: send the structure inline or by its hash, not both.

Response

The run

run_id

string

required

Pass it to loss_report; kept until expires_at. A stored run's evaluations stay after it expires.

Pattern: ^evr_[0-9a-f]{8}-[0-9a-f]{4}-7[0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$

expires_at

string<date-time>

required

dry_run

boolean

required

Whether the items were dry runs (nothing stored) or stored as evaluations.

environment

enum<string>

required

The environment of the key that made the call: production or test. Evaluations, feedback, reviews and suggestions are separate per environment; decisions and their versions belong to the whole organization.

Available options:

production,

test

decision_id

string

required

Pattern: ^[a-z][a-z0-9_.-]{0,127}$

version

object

required

The version that ran.

Show child attributes

model

object

required

The model that answered.

Show child attributes

counts

object

required

Show child attributes

cost

object

required

Show child attributes

results

object[]

required

One per item, in item order (cases: newest label first).

Show child attributes

cases

object

With cases: which cases the run took.

Show child attributes

Overview

Endpoints

Run a version over many items

Authorizations

Headers

Path Parameters

Body

Response