Replays a spec change over past cases with feedback: it spends engine calls, stores a run, and burns the held-out cases it lists. Not a dry run of evaluate. Replays a local spec (with its weights pin and cut points) and its base over the decision’s reviewed and seeded cases in the key’s environment (a test key previews against test cases only), and returns fixes, breaks, the action mix at the cut points and an evidence label. Writes an eval run only: never an evaluation, never traffic, never acceptance. A preview does not register the candidate: before evaluating by its structure hash, register the spec with POST /v1/decisions//structures (or send the spec inline on evaluate once). Holdout cases it lists individually (fixes and breaks) are burned (they count as training from then on); unlisted holdout cases are only scored. evidence.by_split.holdout.holdout_uses counts preview runs that scored held-out cases, not burns. The base, in order: the base of suggestion_id when it is sent (then base is ignored), else base, else the version serving primary traffic in the key’s environment, else the latest version seeded there, else none. With suggestion_id, hashes_match says whether the spec is that suggestion’s candidate; another environment’s suggestion is 404. The evidence replays only cases with an outcome from the owner, reviewers or seeds; the action mix replays a sample of the environment’s recent primary traffic. For features the candidate changes, before is a fresh re-run of the base feature (the fair baseline), so engine nondeterminism can move it between previews; unchanged features replay cached answers when available. noise_rate measures outcome flips from that re-run against the cached baseline, not score drift. Holdout burns and use counts are per environment, and a test key’s preview neither reads nor fills the shared cache of engine answers. A decision nothing was registered, evaluated or seeded under is 404.
An API key, sent as Authorization: Bearer <key>. Each operation lists the scope its key needs: decisions:evaluate (evaluate and read evaluations), decisions:feedback (your app's feedback) or decisions:develop (everything else, including owner feedback and the review queue). An operation listing no scope takes any scoped key. A key with no scope, or without the operation's, gets 403 INSUFFICIENT_SCOPE.
Makes a retry safe. For 24 hours, the same key with the same request returns the first stored result (with Idempotent-Replayed: true); the same key with a different request is a 422 IDEMPOTENCY_KEY_REUSED. Keys are scoped to the organization and environment across every operation, so use a fresh key per request. A request that failed before its result was stored runs again when retried with its key.
The environment of the key that made the call: production or test. Evaluations, feedback, reviews and suggestions are separate per environment; registered structures are shared.
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"Moonbounce Decisions API","colors":{"primary":"#4f46e5"},"banner":{"content":"Looking for the Clavata policy and labeling API? Those docs are at [docs.clavata.ai](https://docs.clavata.ai). You are on the docs for the Moonbounce decisions platform.","dismissible":true,"type":"info"},"styling":{"latex":false},"navigation":{"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"moonbounce","hasAudioNarration":false,"actualSubdomain":"moonbounce","customDomains":[],"gitSource":{"type":"github","owner":"clavataai","repo":"decisions-platform","deployBranch":"main","contentDirectory":"docs/site","isPrivate":true,"mountPath":"","label":"","_id":"6ae8f7a905e268646b31d443"},"chroma":{"latestBuiltDeploymentHistoryId":"6ae8f896f8277f19c7cc79c9","collectionId":"f756780d-07b6-4802-bb88-e6a9d392f388","liveDeploymentHistoryId":"6ae8f896f8277f19c7cc79c9","schemaVersion":"v3"},"entitlements":{},"buildId":"6ae8f896f8277f19c7cc79c9","clientVersion":"0.0.4045","searchFilterCounts":[{"language":"default","tag":"API reference","count":34},{"language":"default","tag":"Endpoints","count":33},{"language":"default","tag":"Guides","count":14},{"language":"default","tag":"review","count":9},{"language":"default","tag":"suggestions","count":6},{"language":"default","tag":"specs","count":5},{"language":"default","tag":"Improve a decision","count":4},{"language":"default","tag":"feedback","count":4},{"language":"default","tag":"Get started","count":3},{"language":"default","tag":"engines","count":3}]},"assistantConfig":{"enableAskAiButton":false,"enableStarterQuestions":false,"enableContextualStarterQuestions":false,"enableAskAiSearchBar":true},"basePath":"","hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"byok-sep-25","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"vite-origin","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-updated-9-15","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":false},"customCss":[],"page":{"pagePath":"api-reference/suggestions/preview-a-spec-change-against-past-feedback","slug":"/api-reference/suggestions/preview-a-spec-change-against-past-feedback","pageMetadata":{"title":"Preview a spec change against past feedback","description":"Replays a spec change over past cases with feedback: it spends engine calls, stores a run, and burns the held-out cases it lists. Not a dry run of evaluate. Replays a local spec (with its weights pin and cut points) and its base over the decision's reviewed and seeded cases in the key's environment (a test key previews against test cases only), and returns fixes, breaks, the action mix at the cut points and an evidence label. Writes an eval run only: never an evaluation, never traffic, never acceptance. A preview does not register the candidate: before evaluating by its structure hash, register the spec with POST /v1/decisions/{decision_id}/structures (or send the spec inline on evaluate once). Holdout cases it lists individually (fixes and breaks) are burned (they count as training from then on); unlisted holdout cases are only scored. `evidence.by_split.holdout.holdout_uses` counts preview runs that scored held-out cases, not burns. The base, in order: the base of `suggestion_id` when it is sent (then `base` is ignored), else `base`, else the version serving primary traffic in the key's environment, else the latest version seeded there, else none. With `suggestion_id`, `hashes_match` says whether the spec is that suggestion's candidate; another environment's suggestion is 404. The evidence replays only cases with an outcome from the owner, reviewers or seeds; the action mix replays a sample of the environment's recent primary traffic. For features the candidate changes, `before` is a fresh re-run of the base feature (the fair baseline), so engine nondeterminism can move it between previews; unchanged features replay cached answers when available. `noise_rate` measures outcome flips from that re-run against the cached baseline, not score drift. Holdout burns and use counts are per environment, and a test key's preview neither reads nor fills the shared cache of engine answers. A decision nothing was registered, evaluated or seeded under is 404.","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/decisions/{decision_id}/previews","href":"/api-reference/suggestions/preview-a-spec-change-against-past-feedback","autogeneratedByOpenApi":true},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx, jsxs: _jsxs} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n code: \"code\",\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsxs(_components.p, {\n children: [\"Replays a spec change over past cases with feedback: it spends engine calls, stores a run, and burns the held-out cases it lists. Not a dry run of evaluate. Replays a local spec (with its weights pin and cut points) and its base over the decision’s reviewed and seeded cases in the key’s environment (a test key previews against test cases only), and returns fixes, breaks, the action mix at the cut points and an evidence label. Writes an eval run only: never an evaluation, never traffic, never acceptance. A preview does not register the candidate: before evaluating by its structure hash, register the spec with POST /v1/decisions/\", \"/structures (or send the spec inline on evaluate once). Holdout cases it lists individually (fixes and breaks) are burned (they count as training from then on); unlisted holdout cases are only scored. \", _jsx(_components.code, {\n children: \"evidence.by_split.holdout.holdout_uses\"\n }), \" counts preview runs that scored held-out cases, not burns. The base, in order: the base of \", _jsx(_components.code, {\n children: \"suggestion_id\"\n }), \" when it is sent (then \", _jsx(_components.code, {\n children: \"base\"\n }), \" is ignored), else \", _jsx(_components.code, {\n children: \"base\"\n }), \", else the version serving primary traffic in the key’s environment, else the latest version seeded there, else none. With \", _jsx(_components.code, {\n children: \"suggestion_id\"\n }), \", \", _jsx(_components.code, {\n children: \"hashes_match\"\n }), \" says whether the spec is that suggestion’s candidate; another environment’s suggestion is 404. The evidence replays only cases with an outcome from the owner, reviewers or seeds; the action mix replays a sample of the environment’s recent primary traffic. For features the candidate changes, \", _jsx(_components.code, {\n children: \"before\"\n }), \" is a fresh re-run of the base feature (the fair baseline), so engine nondeterminism can move it between previews; unchanged features replay cached answers when available. \", _jsx(_components.code, {\n children: \"noise_rate\"\n }), \" measures outcome flips from that re-run against the cached baseline, not score drift. Holdout burns and use counts are per environment, and a test key’s preview neither reads nor fills the shared cache of engine answers. A decision nothing was registered, evaluated or seeded under is 404.\"]\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){return _jsx(_Fragment,{})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Preview a spec change against past feedback","description":"Replays a spec change over past cases with feedback: it spends engine calls, stores a run, and burns the held-out cases it lists. Not a dry run of evaluate. Replays a local spec (with its weights pin and cut points) and its base over the decision's reviewed and seeded cases in the key's environment (a test key previews against test cases only), and returns fixes, breaks, the action mix at the cut points and an evidence label. Writes an eval run only: never an evaluation, never traffic, never acceptance. A preview does not register the candidate: before evaluating by its structure hash, register the spec with POST /v1/decisions/{decision_id}/structures (or send the spec inline on evaluate once). Holdout cases it lists individually (fixes and breaks) are burned (they count as training from then on); unlisted holdout cases are only scored. `evidence.by_split.holdout.holdout_uses` counts preview runs that scored held-out cases, not burns. The base, in order: the base of `suggestion_id` when it is sent (then `base` is ignored), else `base`, else the version serving primary traffic in the key's environment, else the latest version seeded there, else none. With `suggestion_id`, `hashes_match` says whether the spec is that suggestion's candidate; another environment's suggestion is 404. The evidence replays only cases with an outcome from the owner, reviewers or seeds; the action mix replays a sample of the environment's recent primary traffic. For features the candidate changes, `before` is a fresh re-run of the base feature (the fair baseline), so engine nondeterminism can move it between previews; unchanged features replay cached answers when available. `noise_rate` measures outcome flips from that re-run against the cached baseline, not score drift. Holdout burns and use counts are per environment, and a test key's preview neither reads nor fills the shared cache of engine answers. A decision nothing was registered, evaluated or seeded under is 404.","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/decisions/{decision_id}/previews","href":"/api-reference/suggestions/preview-a-spec-change-against-past-feedback","autogeneratedByOpenApi":true}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[],"codeExamples":{}},"jsLinks":[],"openApiReferenceData":{"operation":{"operationId":"preview","tags":["suggestions"],"security":["41dede0f-e8eb-46d3-94fe-fdfcc2bed9aa"],"summary":"Preview a spec change against past feedback","description":"Replays a spec change over past cases with feedback: it spends engine calls, stores a run, and burns the held-out cases it lists. Not a dry run of evaluate. Replays a local spec (with its weights pin and cut points) and its base over the decision's reviewed and seeded cases in the key's environment (a test key previews against test cases only), and returns fixes, breaks, the action mix at the cut points and an evidence label. Writes an eval run only: never an evaluation, never traffic, never acceptance. A preview does not register the candidate: before evaluating by its structure hash, register the spec with POST /v1/decisions/{decision_id}/structures (or send the spec inline on evaluate once). Holdout cases it lists individually (fixes and breaks) are burned (they count as training from then on); unlisted holdout cases are only scored. `evidence.by_split.holdout.holdout_uses` counts preview runs that scored held-out cases, not burns. The base, in order: the base of `suggestion_id` when it is sent (then `base` is ignored), else `base`, else the version serving primary traffic in the key's environment, else the latest version seeded there, else none. With `suggestion_id`, `hashes_match` says whether the spec is that suggestion's candidate; another environment's suggestion is 404. The evidence replays only cases with an outcome from the owner, reviewers or seeds; the action mix replays a sample of the environment's recent primary traffic. For features the candidate changes, `before` is a fresh re-run of the base feature (the fair baseline), so engine nondeterminism can move it between previews; unchanged features replay cached answers when available. `noise_rate` measures outcome flips from that re-run against the cached baseline, not score drift. Holdout burns and use counts are per environment, and a test key's preview neither reads nor fills the shared cache of engine answers. A decision nothing was registered, evaluated or seeded under is 404.","parameters":["dfc875df-7edf-462f-ade3-a725103948d3","bb693f41-0374-49cb-89c0-72f5cb62eeed"],"requestBody":"d53d9dd7-bb87-472c-ada0-1cbd34101b4b","responses":{"200":"86d3ccef-36a3-4afc-bc0b-5e94b9576750","400":"32f4a3a8-b30f-4e0c-ac7b-4d04d0739a9e","401":"2f094d46-557b-418a-bec0-f6b6adcf6033","403":"310b6e65-040c-4a2f-a45a-ab9ad3491950","404":"bdf2fdc0-ee6f-417a-a101-802613a30042","409":"9c1d8042-345c-4a09-9938-7ac158f84a62","410":"36339270-a10f-4d52-8d5b-62658f45b0ab","422":"47d36fbc-de5d-4072-967e-462742e31d38","429":"f7708d81-0517-4686-83e7-8cf0cd7e42b9","502":"5a77e95b-e2db-4e29-9b91-2338ef4b4912","503":"ead9ae3a-7bfa-4acc-9910-cd9556c50a4d"},"method":"post","type":"path","servers":["9e61324b-4cc4-430d-a8d9-fa0221e50db5"],"path":"/v1/decisions/{decision_id}/previews","baseUrlOptions":["https://api.moonbounce.ai"],"title":"Preview a spec change against past feedback","codeSamples":[],"requiredOnlyExamples":false,"requestExampleType":"generated","responseExampleType":"generated"},"dependencies":{"parameters":{"dfc875df-7edf-462f-ade3-a725103948d3":{"schema":{"type":"string","pattern":"^[a-z][a-z0-9_.-]{0,127}$","isRequired":true,"uniqueKey":"","typeLabel":"string"},"required":true,"name":"decision_id","in":"path"},"bb693f41-0374-49cb-89c0-72f5cb62eeed":{"schema":{"type":"string","minLength":1,"maxLength":255,"pattern":"^[\\x20-\\x7e]+$","description":"Makes a retry safe. For 24 hours, the same key with the same request returns the first stored result (with Idempotent-Replayed: true); the same key with a different request is a 422 IDEMPOTENCY_KEY_REUSED. Keys are scoped to the organization and environment across every operation, so use a fresh key per request. A request that failed before its result was stored runs again when retried with its key.","isRequired":false,"uniqueKey":"","typeLabel":"string"},"required":false,"description":"Makes a retry safe. For 24 hours, the same key with the same request returns the first stored result (with Idempotent-Replayed: true); the same key with a different request is a 422 IDEMPOTENCY_KEY_REUSED. Keys are scoped to the organization and environment across every operation, so use a fresh key per request. A request that failed before its result was stored runs again when retried with its key.","name":"idempotency-key","in":"header"}},"requestBody":{"required":true,"content":{"application/json":{"schema":{"type":"object","properties":{"spec":{"type":"object","properties":{"format":{"type":"string","enum":["moonbounce.spec/0"],"isRequired":true,"uniqueKey":"spec.format","typeLabel":"enum\u003cstring>"},"nodes":{"type":"object","additionalProperties":{"oneOf":[{"type":"object","required":["type","prompt"],"properties":{"type":{"type":"string","enum":["boolean"],"isRequired":true,"uniqueKey":"spec.nodes.additionalProperties.oneOf.0.type","typeLabel":"enum\u003cstring>"},"prompt":{"type":"string","minLength":1,"maxLength":4000,"isRequired":true,"uniqueKey":"spec.nodes.additionalProperties.oneOf.0.prompt","typeLabel":"string"},"guidance":{"type":"string","minLength":1,"maxLength":4000,"uniqueKey":"spec.nodes.additionalProperties.oneOf.0.guidance","typeLabel":"string"},"inputs":{"type":"array","items":{"type":"string","pattern":"^[a-z][a-z0-9_]{0,63}$","uniqueKey":"spec.nodes.additionalProperties.oneOf.0.inputs.items.[INDEX]","typeLabel":"string"},"minItems":1,"description":"Names of the `subject` parts this feature reads (default: all of them); `context` parts are always read. Every name must match a subject part's `name`, or the request is a 400 CONTENT_INVALID.","uniqueKey":"spec.nodes.additionalProperties.oneOf.0.inputs","typeLabel":"string[]"},"criteria":{"type":"object","properties":{"true":{"type":"string","minLength":1,"maxLength":4000,"uniqueKey":"spec.nodes.additionalProperties.oneOf.0.criteria.true","typeLabel":"string"},"false":{"type":"string","minLength":1,"maxLength":4000,"uniqueKey":"spec.nodes.additionalProperties.oneOf.0.criteria.false","typeLabel":"string"}},"additionalProperties":false,"uniqueKey":"spec.nodes.additionalProperties.oneOf.0.criteria","typeLabel":"object"}},"additionalProperties":false,"uniqueKey":"spec.nodes.additionalProperties.oneOf.0","typeLabel":"object"},{"type":"object","description":"Scores a node from its terms. Before fitting (and without fixed numbers), mean averages the oriented inputs, so each of n terms weighs 1/n and adding a term dilutes the others; any computes sigmoid(-4 + 8·Σraises - 8·Σlowers): one strong raise is enough, weak raises add up, and lowers cancel raises. Fitted or fixed numbers replace the prior.","required":["type","terms"],"properties":{"type":{"type":"string","enum":["combine"],"isRequired":true,"uniqueKey":"spec.nodes.additionalProperties.oneOf.1.type","typeLabel":"enum\u003cstring>"},"terms":{"type":"array","items":{"type":"object","properties":{"node":{"type":"string","pattern":"^[a-z][a-z0-9_]{0,63}$","isRequired":true,"uniqueKey":"spec.nodes.additionalProperties.oneOf.1.terms.items.[INDEX].node","typeLabel":"string"},"option":{"type":"string","pattern":"^[a-z][a-z0-9_]{0,63}$","description":"Reserved for choice and scale features, which are not available yet: any value is a 400.","uniqueKey":"spec.nodes.additionalProperties.oneOf.1.terms.items.[INDEX].option","typeLabel":"string"},"effect":{"type":"string","enum":["raises","lowers"],"default":"raises","description":"raises: a yes pushes the score up; lowers: a yes pushes it down. The sign lives here; fixed weights must agree with it.","uniqueKey":"spec.nodes.additionalProperties.oneOf.1.terms.items.[INDEX].effect","typeLabel":"enum\u003cstring>"}},"required":["node"],"additionalProperties":false,"uniqueKey":"spec.nodes.additionalProperties.oneOf.1.terms.items.[INDEX]","typeLabel":"object"},"minItems":1,"maxItems":64,"isRequired":true,"uniqueKey":"spec.nodes.additionalProperties.oneOf.1.terms","typeLabel":"object[]"},"prior":{"type":"string","enum":["mean","any"],"description":"Default combine weights before fitting. mean averages oriented inputs; any computes sigmoid(-4 + 8·Σraises - 8·Σlowers), a logistic of a signed sum: one strong raise is enough and weak raises add up.","uniqueKey":"spec.nodes.additionalProperties.oneOf.1.prior","typeLabel":"enum\u003cstring>"},"fixed":{"type":"object","properties":{"link":{"type":"string","enum":["identity","logistic"],"description":"identity: the weighted sum plus bias, clipped to 0..1; logistic: the sigmoid of the weighted sum plus bias.","isRequired":true,"uniqueKey":"spec.nodes.additionalProperties.oneOf.1.fixed.link","typeLabel":"enum\u003cstring>"},"weights":{"type":"object","additionalProperties":{"type":"number","uniqueKey":"spec.nodes.additionalProperties.oneOf.1.fixed.weights.additionalProperties","typeLabel":"number"},"description":"Signed weights per term key (node; options are reserved).","isRequired":true,"uniqueKey":"spec.nodes.additionalProperties.oneOf.1.fixed.weights","typeLabel":"object"},"bias":{"type":"number","description":"Offset added to the weighted sum before applying the link.","isRequired":true,"uniqueKey":"spec.nodes.additionalProperties.oneOf.1.fixed.bias","typeLabel":"number"}},"required":["link","weights","bias"],"additionalProperties":false,"description":"Numbers fixed in code, never overridden by fitted weights. Signed weights multiply raw P(yes): raises weights must be >= 0 and lowers weights \u003c= 0.","uniqueKey":"spec.nodes.additionalProperties.oneOf.1.fixed","typeLabel":"object"}},"additionalProperties":false,"uniqueKey":"spec.nodes.additionalProperties.oneOf.1","typeLabel":"object"},{"type":"object","required":["type","node"],"properties":{"type":{"type":"string","enum":["calibrate"],"isRequired":true,"uniqueKey":"spec.nodes.additionalProperties.oneOf.2.type","typeLabel":"enum\u003cstring>"},"node":{"type":"string","pattern":"^[a-z][a-z0-9_]{0,63}$","isRequired":true,"uniqueKey":"spec.nodes.additionalProperties.oneOf.2.node","typeLabel":"string"}},"additionalProperties":false,"uniqueKey":"spec.nodes.additionalProperties.oneOf.2","typeLabel":"object"}],"uniqueKey":"spec.nodes.additionalProperties","typeLabel":"object"},"description":"The spec's named nodes, 1 to 64: boolean features and the aggregators that read them. Every reference (`output`, a combine term's `node`, a calibrate's `node`) names a node in this map, with no cycles.","isRequired":true,"uniqueKey":"spec.nodes","typeLabel":"object"},"output":{"type":"string","pattern":"^[a-z][a-z0-9_]{0,63}$","isRequired":true,"uniqueKey":"spec.output","typeLabel":"string"},"guidance":{"type":"string","minLength":1,"maxLength":20000,"uniqueKey":"spec.guidance","typeLabel":"string"},"target":{"type":"string","minLength":1,"maxLength":4000,"description":"The yes/no statement the output's score is the probability of. Required when `output` is a combine or calibrate node, optional on a boolean output. Feedback `target` claims need it.","uniqueKey":"spec.target","typeLabel":"string"},"meta":{"type":"object","properties":{"title":{"type":"string","maxLength":200,"uniqueKey":"spec.meta.title","typeLabel":"string"},"description":{"type":"string","maxLength":4000,"uniqueKey":"spec.meta.description","typeLabel":"string"},"owner":{"type":"string","maxLength":200,"uniqueKey":"spec.meta.owner","typeLabel":"string"},"tags":{"type":"array","items":{"type":"string","maxLength":64,"uniqueKey":"spec.meta.tags.items.[INDEX]","typeLabel":"string"},"maxItems":32,"uniqueKey":"spec.meta.tags","typeLabel":"string[]"},"display":{"type":"object","additionalProperties":{"type":"object","properties":{"text":{"type":"string","minLength":1,"maxLength":40,"isRequired":true,"uniqueKey":"spec.meta.display.additionalProperties.text","typeLabel":"string"},"help":{"type":"string","maxLength":200,"uniqueKey":"spec.meta.display.additionalProperties.help","typeLabel":"string"}},"required":["text"],"additionalProperties":false,"uniqueKey":"spec.meta.display.additionalProperties","typeLabel":"object"},"uniqueKey":"spec.meta.display","typeLabel":"object"}},"additionalProperties":false,"uniqueKey":"spec.meta","typeLabel":"object"}},"required":["format","nodes","output"],"additionalProperties":false,"isRequired":true,"uniqueKey":"spec","typeLabel":"object"},"weights":{"oneOf":[{"type":"string","default":"default","enum":["default"],"isRequired":true,"uniqueKey":"weights.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"string","default":"default","pattern":"^sha256:[0-9a-f]{64}$","isRequired":true,"uniqueKey":"weights.oneOf.1","typeLabel":"string"}],"isRequired":true,"uniqueKey":"weights","typeLabel":"enum\u003cstring> | string"},"outcomes":{"type":"object","properties":{"below":{"type":"string","pattern":"^[a-z][a-z0-9_]{0,63}$","description":"The outcome for a score under the first cut.","isRequired":true,"uniqueKey":"outcomes.below","typeLabel":"string"},"cuts":{"type":"array","items":{"type":"object","properties":{"at":{"type":"number","isRequired":true,"uniqueKey":"outcomes.cuts.items.[INDEX].at","typeLabel":"number"},"outcome":{"type":"string","pattern":"^[a-z][a-z0-9_]{0,63}$","isRequired":true,"uniqueKey":"outcomes.cuts.items.[INDEX].outcome","typeLabel":"string"}},"required":["at","outcome"],"additionalProperties":false,"uniqueKey":"outcomes.cuts.items.[INDEX]","typeLabel":"object"},"minItems":1,"maxItems":9,"isRequired":true,"uniqueKey":"outcomes.cuts","typeLabel":"object[]"},"abstain":{"type":"string","pattern":"^[a-z][a-z0-9_]{0,63}$","uniqueKey":"outcomes.abstain","typeLabel":"string"}},"required":["below","cuts"],"additionalProperties":false,"isRequired":true,"uniqueKey":"outcomes","typeLabel":"object"},"suggestion_id":{"type":"string","pattern":"^sug_[0-9a-f]{8}-[0-9a-f]{4}-7[0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$","uniqueKey":"suggestion_id","typeLabel":"string"},"base":{"type":"object","properties":{"structure":{"type":"string","pattern":"^sha256:[0-9a-f]{64}$","isRequired":true,"uniqueKey":"base.structure","typeLabel":"string"},"weights":{"type":"string","pattern":"^sha256:[0-9a-f]{64}$","isRequired":true,"uniqueKey":"base.weights","typeLabel":"string"}},"required":["structure","weights"],"additionalProperties":false,"uniqueKey":"base","typeLabel":"object"}},"required":["spec","weights","outcomes"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"spec":{"format":"moonbounce.spec/0","nodes":{},"output":"\u003cstring>","guidance":"\u003cstring>","target":"\u003cstring>","meta":{"title":"\u003cstring>","description":"\u003cstring>","owner":"\u003cstring>","tags":["\u003cstring>"],"display":{}}},"weights":"default","outcomes":{"below":"\u003cstring>","cuts":[{"at":123,"outcome":"\u003cstring>"}],"abstain":"\u003cstring>"},"suggestion_id":"\u003cstring>"}}},"exampleType":"generated"}},"exampleType":"generated"},"responses":{"86d3ccef-36a3-4afc-bc0b-5e94b9576750":{"description":"The preview","headers":{"Idempotent-Replayed":{"schema":{"type":"string","enum":["true"],"description":"Present and `true` when this is the stored result of an earlier request with the same Idempotency-Key."},"required":false,"description":"Present and `true` when this is the stored result of an earlier request with the same Idempotency-Key."}},"content":{"application/json":{"schema":{"type":"object","properties":{"preview_id":{"type":"string","pattern":"^run_[0-9a-f]{8}-[0-9a-f]{4}-7[0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$","isRequired":true,"uniqueKey":"preview_id","typeLabel":"string"},"decision_id":{"type":"string","pattern":"^[a-z][a-z0-9_.-]{0,127}$","isRequired":true,"uniqueKey":"decision_id","typeLabel":"string"},"environment":{"type":"string","enum":["production","test"],"description":"The environment of the key that made the call: `production` or `test`. Evaluations, feedback, reviews and suggestions are separate per environment; registered structures are shared.","isRequired":true,"uniqueKey":"environment","typeLabel":"enum\u003cstring>"},"base":{"oneOf":[{"type":"object","required":["structure","weights","engine_profile"],"properties":{"structure":{"type":"string","pattern":"^sha256:[0-9a-f]{64}$","isRequired":true,"uniqueKey":"base.oneOf.0.structure","typeLabel":"string"},"weights":{"type":"string","pattern":"^sha256:[0-9a-f]{64}$","isRequired":true,"uniqueKey":"base.oneOf.0.weights","typeLabel":"string"},"engine_profile":{"type":"string","isRequired":true,"uniqueKey":"base.oneOf.0.engine_profile","typeLabel":"string"}},"additionalProperties":false,"isRequired":true,"uniqueKey":"base.oneOf.0","typeLabel":"object"},{"type":"null","isRequired":true,"uniqueKey":"base.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"base","typeLabel":"object | null"},"candidate":{"type":"object","properties":{"structure":{"type":"string","pattern":"^sha256:[0-9a-f]{64}$","isRequired":true,"uniqueKey":"candidate.structure","typeLabel":"string"},"weights":{"type":"string","pattern":"^sha256:[0-9a-f]{64}$","isRequired":true,"uniqueKey":"candidate.weights","typeLabel":"string"},"engine_profile":{"type":"string","isRequired":true,"uniqueKey":"candidate.engine_profile","typeLabel":"string"}},"required":["structure","weights","engine_profile"],"additionalProperties":false,"isRequired":true,"uniqueKey":"candidate","typeLabel":"object"},"hashes_match":{"oneOf":[{"type":"object","required":["structure","weights"],"properties":{"structure":{"type":"boolean","isRequired":true,"uniqueKey":"hashes_match.oneOf.0.structure","typeLabel":"boolean"},"weights":{"type":"boolean","isRequired":true,"uniqueKey":"hashes_match.oneOf.0.weights","typeLabel":"boolean"}},"additionalProperties":false,"isRequired":true,"uniqueKey":"hashes_match.oneOf.0","typeLabel":"object"},{"type":"null","isRequired":true,"uniqueKey":"hashes_match.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"hashes_match","typeLabel":"object | null"},"evidence":{"type":"object","properties":{"label":{"type":"string","enum":["starting_examples","training_cases","holdout"],"isRequired":true,"uniqueKey":"evidence.label","typeLabel":"enum\u003cstring>"},"frozen_at":{"type":"string","format":"date-time","isRequired":true,"uniqueKey":"evidence.frozen_at","typeLabel":"string\u003cdate-time>"},"by_split":{"type":"object","properties":{"seed":{"type":"object","properties":{"n":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.seed.n","typeLabel":"integer"},"fixes":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.seed.fixes","typeLabel":"integer"},"breaks":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.seed.breaks","typeLabel":"integer"},"base_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.seed.base_correct","typeLabel":"integer"},"candidate_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.seed.candidate_correct","typeLabel":"integer"},"holdout_uses":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_split.seed.holdout_uses","typeLabel":"integer"},"owner_decided":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_split.seed.owner_decided","typeLabel":"integer"}},"required":["n","fixes","breaks","base_correct","candidate_correct"],"additionalProperties":false,"uniqueKey":"evidence.by_split.seed","typeLabel":"object"},"train":{"type":"object","properties":{"n":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.train.n","typeLabel":"integer"},"fixes":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.train.fixes","typeLabel":"integer"},"breaks":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.train.breaks","typeLabel":"integer"},"base_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.train.base_correct","typeLabel":"integer"},"candidate_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.train.candidate_correct","typeLabel":"integer"},"holdout_uses":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_split.train.holdout_uses","typeLabel":"integer"},"owner_decided":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_split.train.owner_decided","typeLabel":"integer"}},"required":["n","fixes","breaks","base_correct","candidate_correct"],"additionalProperties":false,"uniqueKey":"evidence.by_split.train","typeLabel":"object"},"holdout":{"type":"object","properties":{"n":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.holdout.n","typeLabel":"integer"},"fixes":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.holdout.fixes","typeLabel":"integer"},"breaks":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.holdout.breaks","typeLabel":"integer"},"base_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.holdout.base_correct","typeLabel":"integer"},"candidate_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_split.holdout.candidate_correct","typeLabel":"integer"},"holdout_uses":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_split.holdout.holdout_uses","typeLabel":"integer"},"owner_decided":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_split.holdout.owner_decided","typeLabel":"integer"}},"required":["n","fixes","breaks","base_correct","candidate_correct"],"additionalProperties":false,"uniqueKey":"evidence.by_split.holdout","typeLabel":"object"}},"additionalProperties":false,"isRequired":true,"uniqueKey":"evidence.by_split","typeLabel":"object"},"noise_rate":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"isRequired":true,"uniqueKey":"evidence.noise_rate.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":1,"isRequired":true,"uniqueKey":"evidence.noise_rate.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"evidence.noise_rate","typeLabel":"number | null"},"action_mix":{"oneOf":[{"type":"object","required":["before","after","on","n"],"properties":{"before":{"type":"object","additionalProperties":{"type":"number","minimum":0,"maximum":1,"uniqueKey":"evidence.action_mix.oneOf.0.before.additionalProperties","typeLabel":"number"},"isRequired":true,"uniqueKey":"evidence.action_mix.oneOf.0.before","typeLabel":"object"},"after":{"type":"object","additionalProperties":{"type":"number","minimum":0,"maximum":1,"uniqueKey":"evidence.action_mix.oneOf.0.after.additionalProperties","typeLabel":"number"},"isRequired":true,"uniqueKey":"evidence.action_mix.oneOf.0.after","typeLabel":"object"},"on":{"type":"string","isRequired":true,"uniqueKey":"evidence.action_mix.oneOf.0.on","typeLabel":"string"},"n":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.action_mix.oneOf.0.n","typeLabel":"integer"}},"additionalProperties":false,"isRequired":true,"uniqueKey":"evidence.action_mix.oneOf.0","typeLabel":"object"},{"type":"null","isRequired":true,"uniqueKey":"evidence.action_mix.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"evidence.action_mix","typeLabel":"object | null"},"changed_items":{"type":"array","items":{"type":"object","properties":{"evaluation_id":{"type":"string","pattern":"^evl_[0-9a-f]{8}-[0-9a-f]{4}-7[0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$","isRequired":true,"uniqueKey":"evidence.changed_items.items.[INDEX].evaluation_id","typeLabel":"string"},"feedback_id":{"type":"string","pattern":"^fbk_[0-9a-f]{8}-[0-9a-f]{4}-7[0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$","isRequired":true,"uniqueKey":"evidence.changed_items.items.[INDEX].feedback_id","typeLabel":"string"},"split":{"type":"string","enum":["seed","train","holdout","burned"],"isRequired":true,"uniqueKey":"evidence.changed_items.items.[INDEX].split","typeLabel":"enum\u003cstring>"},"change":{"type":"string","enum":["fix","break"],"isRequired":true,"uniqueKey":"evidence.changed_items.items.[INDEX].change","typeLabel":"enum\u003cstring>"},"before":{"type":"object","properties":{"features":{"type":"object","additionalProperties":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"uniqueKey":"evidence.changed_items.items.[INDEX].before.features.additionalProperties.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":1,"uniqueKey":"evidence.changed_items.items.[INDEX].before.features.additionalProperties.oneOf.1","typeLabel":"null"}],"uniqueKey":"evidence.changed_items.items.[INDEX].before.features.additionalProperties","typeLabel":"number | null"},"isRequired":true,"uniqueKey":"evidence.changed_items.items.[INDEX].before.features","typeLabel":"object"},"outcome":{"type":"string","pattern":"^[a-z][a-z0-9_]{0,63}$","uniqueKey":"evidence.changed_items.items.[INDEX].before.outcome","typeLabel":"string"},"score":{"type":"number","uniqueKey":"evidence.changed_items.items.[INDEX].before.score","typeLabel":"number"}},"required":["features"],"additionalProperties":false,"isRequired":true,"uniqueKey":"evidence.changed_items.items.[INDEX].before","typeLabel":"object"},"after":{"type":"object","properties":{"features":{"type":"object","additionalProperties":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"uniqueKey":"evidence.changed_items.items.[INDEX].after.features.additionalProperties.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":1,"uniqueKey":"evidence.changed_items.items.[INDEX].after.features.additionalProperties.oneOf.1","typeLabel":"null"}],"uniqueKey":"evidence.changed_items.items.[INDEX].after.features.additionalProperties","typeLabel":"number | null"},"isRequired":true,"uniqueKey":"evidence.changed_items.items.[INDEX].after.features","typeLabel":"object"},"outcome":{"type":"string","pattern":"^[a-z][a-z0-9_]{0,63}$","uniqueKey":"evidence.changed_items.items.[INDEX].after.outcome","typeLabel":"string"},"score":{"type":"number","uniqueKey":"evidence.changed_items.items.[INDEX].after.score","typeLabel":"number"}},"required":["features"],"additionalProperties":false,"isRequired":true,"uniqueKey":"evidence.changed_items.items.[INDEX].after","typeLabel":"object"}},"required":["evaluation_id","feedback_id","split","change","before","after"],"additionalProperties":false,"uniqueKey":"evidence.changed_items.items.[INDEX]","typeLabel":"object"},"isRequired":true,"uniqueKey":"evidence.changed_items","typeLabel":"object[]"},"credited_feedback":{"type":"array","items":{"type":"string","pattern":"^fbk_[0-9a-f]{8}-[0-9a-f]{4}-7[0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$","uniqueKey":"evidence.credited_feedback.items.[INDEX]","typeLabel":"string"},"isRequired":true,"uniqueKey":"evidence.credited_feedback","typeLabel":"string[]"},"by_source":{"type":"object","properties":{"app_native":{"type":"object","properties":{"n":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.app_native.n","typeLabel":"integer"},"fixes":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.app_native.fixes","typeLabel":"integer"},"breaks":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.app_native.breaks","typeLabel":"integer"},"base_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.app_native.base_correct","typeLabel":"integer"},"candidate_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.app_native.candidate_correct","typeLabel":"integer"},"holdout_uses":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.app_native.holdout_uses","typeLabel":"integer"},"owner_decided":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.app_native.owner_decided","typeLabel":"integer"}},"required":["n","fixes","breaks","base_correct","candidate_correct"],"additionalProperties":false,"uniqueKey":"evidence.by_source.app_native","typeLabel":"object"},"app_resolution":{"type":"object","properties":{"n":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.app_resolution.n","typeLabel":"integer"},"fixes":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.app_resolution.fixes","typeLabel":"integer"},"breaks":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.app_resolution.breaks","typeLabel":"integer"},"base_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.app_resolution.base_correct","typeLabel":"integer"},"candidate_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.app_resolution.candidate_correct","typeLabel":"integer"},"holdout_uses":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.app_resolution.holdout_uses","typeLabel":"integer"},"owner_decided":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.app_resolution.owner_decided","typeLabel":"integer"}},"required":["n","fixes","breaks","base_correct","candidate_correct"],"additionalProperties":false,"uniqueKey":"evidence.by_source.app_resolution","typeLabel":"object"},"reviewer":{"type":"object","properties":{"n":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.reviewer.n","typeLabel":"integer"},"fixes":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.reviewer.fixes","typeLabel":"integer"},"breaks":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.reviewer.breaks","typeLabel":"integer"},"base_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.reviewer.base_correct","typeLabel":"integer"},"candidate_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.reviewer.candidate_correct","typeLabel":"integer"},"holdout_uses":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.reviewer.holdout_uses","typeLabel":"integer"},"owner_decided":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.reviewer.owner_decided","typeLabel":"integer"}},"required":["n","fixes","breaks","base_correct","candidate_correct"],"additionalProperties":false,"uniqueKey":"evidence.by_source.reviewer","typeLabel":"object"},"owner":{"type":"object","properties":{"n":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.owner.n","typeLabel":"integer"},"fixes":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.owner.fixes","typeLabel":"integer"},"breaks":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.owner.breaks","typeLabel":"integer"},"base_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.owner.base_correct","typeLabel":"integer"},"candidate_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.owner.candidate_correct","typeLabel":"integer"},"holdout_uses":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.owner.holdout_uses","typeLabel":"integer"},"owner_decided":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.owner.owner_decided","typeLabel":"integer"}},"required":["n","fixes","breaks","base_correct","candidate_correct"],"additionalProperties":false,"uniqueKey":"evidence.by_source.owner","typeLabel":"object"},"import":{"type":"object","properties":{"n":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.import.n","typeLabel":"integer"},"fixes":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.import.fixes","typeLabel":"integer"},"breaks":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.import.breaks","typeLabel":"integer"},"base_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.import.base_correct","typeLabel":"integer"},"candidate_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.import.candidate_correct","typeLabel":"integer"},"holdout_uses":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.import.holdout_uses","typeLabel":"integer"},"owner_decided":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.import.owner_decided","typeLabel":"integer"}},"required":["n","fixes","breaks","base_correct","candidate_correct"],"additionalProperties":false,"uniqueKey":"evidence.by_source.import","typeLabel":"object"},"synthetic_review":{"type":"object","properties":{"n":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.synthetic_review.n","typeLabel":"integer"},"fixes":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.synthetic_review.fixes","typeLabel":"integer"},"breaks":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.synthetic_review.breaks","typeLabel":"integer"},"base_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.synthetic_review.base_correct","typeLabel":"integer"},"candidate_correct":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"evidence.by_source.synthetic_review.candidate_correct","typeLabel":"integer"},"holdout_uses":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.synthetic_review.holdout_uses","typeLabel":"integer"},"owner_decided":{"type":"integer","minimum":0,"uniqueKey":"evidence.by_source.synthetic_review.owner_decided","typeLabel":"integer"}},"required":["n","fixes","breaks","base_correct","candidate_correct"],"additionalProperties":false,"uniqueKey":"evidence.by_source.synthetic_review","typeLabel":"object"}},"uniqueKey":"evidence.by_source","typeLabel":"object"}},"required":["label","frozen_at","by_split","noise_rate","action_mix","changed_items","credited_feedback"],"additionalProperties":false,"isRequired":true,"uniqueKey":"evidence","typeLabel":"object"},"cost":{"type":"object","properties":{"engine_calls":{"type":"integer","minimum":0,"description":"On evaluate and seeds, upstream engine calls reported in usage, including retries; one call can answer several features (Jev compiles them). On previews, features sent to engines, not upstream calls.","isRequired":true,"uniqueKey":"cost.engine_calls","typeLabel":"integer"},"cache_hits":{"type":"integer","minimum":0,"description":"Feature answers reused from cache. Only previews use the cache today; evaluate and seeds report 0.","isRequired":true,"uniqueKey":"cost.cache_hits","typeLabel":"integer"},"input_tokens":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"cost.input_tokens","typeLabel":"integer"},"usd_micros":{"type":"integer","minimum":0,"isRequired":true,"uniqueKey":"cost.usd_micros","typeLabel":"integer"}},"required":["engine_calls","cache_hits","input_tokens","usd_micros"],"additionalProperties":false,"isRequired":true,"uniqueKey":"cost","typeLabel":"object"}},"required":["preview_id","decision_id","environment","base","candidate","hashes_match","evidence","cost"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"preview_id":"\u003cstring>","decision_id":"\u003cstring>","environment":"production","base":{"structure":"\u003cstring>","weights":"\u003cstring>","engine_profile":"\u003cstring>"},"candidate":{"structure":"\u003cstring>","weights":"\u003cstring>","engine_profile":"\u003cstring>"},"hashes_match":{"structure":true,"weights":true},"evidence":{"label":"starting_examples","frozen_at":"2023-11-07T05:31:56Z","by_split":{"seed":{"n":1,"fixes":1,"breaks":1,"base_correct":1,"candidate_correct":1,"holdout_uses":1,"owner_decided":1},"train":{"n":1,"fixes":1,"breaks":1,"base_correct":1,"candidate_correct":1,"holdout_uses":1,"owner_decided":1},"holdout":{"n":1,"fixes":1,"breaks":1,"base_correct":1,"candidate_correct":1,"holdout_uses":1,"owner_decided":1}},"noise_rate":0.5,"action_mix":{"before":{},"after":{},"on":"\u003cstring>","n":1},"changed_items":[{"evaluation_id":"\u003cstring>","feedback_id":"\u003cstring>","split":"seed","change":"fix","before":{"features":{},"outcome":"\u003cstring>","score":123},"after":{"features":{},"outcome":"\u003cstring>","score":123}}],"credited_feedback":["\u003cstring>"],"by_source":{"app_native":{"n":1,"fixes":1,"breaks":1,"base_correct":1,"candidate_correct":1,"holdout_uses":1,"owner_decided":1},"app_resolution":{"n":1,"fixes":1,"breaks":1,"base_correct":1,"candidate_correct":1,"holdout_uses":1,"owner_decided":1},"reviewer":{"n":1,"fixes":1,"breaks":1,"base_correct":1,"candidate_correct":1,"holdout_uses":1,"owner_decided":1},"owner":{"n":1,"fixes":1,"breaks":1,"base_correct":1,"candidate_correct":1,"holdout_uses":1,"owner_decided":1},"import":{"n":1,"fixes":1,"breaks":1,"base_correct":1,"candidate_correct":1,"holdout_uses":1,"owner_decided":1},"synthetic_review":{"n":1,"fixes":1,"breaks":1,"base_correct":1,"candidate_correct":1,"holdout_uses":1,"owner_decided":1}}},"cost":{"engine_calls":1,"cache_hits":1,"input_tokens":1,"usd_micros":1}}}},"exampleType":"generated"}},"exampleType":"generated"},"32f4a3a8-b30f-4e0c-ac7b-4d04d0739a9e":{"description":"Invalid request: `param` names the field at fault when one applies","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"object","properties":{"type":{"type":"string","enum":["invalid_request","authentication","permission_denied","not_found","conflict","rate_limited","engine_failed","unavailable","internal"],"isRequired":true,"uniqueKey":"error.type","typeLabel":"enum\u003cstring>"},"message":{"type":"string","description":"For people; don't parse it.","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"reason":{"type":"string","pattern":"^[A-Z][A-Z0-9_]+$","description":"Set where a caller can act on it, one of the reasons in the ErrorReason schema. New reasons may be added: treat an unknown one by the status and `type`.","uniqueKey":"error.reason","typeLabel":"string"},"param":{"type":"string","description":"The request field at fault, as a dotted path (`subject.0.text`, `claims.1.value`).","uniqueKey":"error.param","typeLabel":"string"},"details":{"type":"object","additionalProperties":{"oneOf":[{}],"uniqueKey":"error.details.additionalProperties","typeLabel":"any"},"uniqueKey":"error.details","typeLabel":"object"}},"required":["type","message"],"additionalProperties":false,"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"required":["error"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"type":"invalid_request","message":"\u003cstring>","reason":"\u003cstring>","param":"\u003cstring>","details":{}}}}},"exampleType":"generated"}},"exampleType":"generated"},"2f094d46-557b-418a-bec0-f6b6adcf6033":{"description":"Missing or invalid API key (reason KEY_INVALID)","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"object","properties":{"type":{"type":"string","enum":["invalid_request","authentication","permission_denied","not_found","conflict","rate_limited","engine_failed","unavailable","internal"],"isRequired":true,"uniqueKey":"error.type","typeLabel":"enum\u003cstring>"},"message":{"type":"string","description":"For people; don't parse it.","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"reason":{"type":"string","pattern":"^[A-Z][A-Z0-9_]+$","description":"Set where a caller can act on it, one of the reasons in the ErrorReason schema. New reasons may be added: treat an unknown one by the status and `type`.","uniqueKey":"error.reason","typeLabel":"string"},"param":{"type":"string","description":"The request field at fault, as a dotted path (`subject.0.text`, `claims.1.value`).","uniqueKey":"error.param","typeLabel":"string"},"details":{"type":"object","additionalProperties":{"oneOf":[{}],"uniqueKey":"error.details.additionalProperties","typeLabel":"any"},"uniqueKey":"error.details","typeLabel":"object"}},"required":["type","message"],"additionalProperties":false,"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"required":["error"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"type":"invalid_request","message":"\u003cstring>","reason":"\u003cstring>","param":"\u003cstring>","details":{}}}}},"exampleType":"generated"}},"exampleType":"generated"},"310b6e65-040c-4a2f-a45a-ab9ad3491950":{"description":"The key may not do this","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"object","properties":{"type":{"type":"string","enum":["invalid_request","authentication","permission_denied","not_found","conflict","rate_limited","engine_failed","unavailable","internal"],"isRequired":true,"uniqueKey":"error.type","typeLabel":"enum\u003cstring>"},"message":{"type":"string","description":"For people; don't parse it.","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"reason":{"type":"string","pattern":"^[A-Z][A-Z0-9_]+$","description":"Set where a caller can act on it, one of the reasons in the ErrorReason schema. New reasons may be added: treat an unknown one by the status and `type`.","uniqueKey":"error.reason","typeLabel":"string"},"param":{"type":"string","description":"The request field at fault, as a dotted path (`subject.0.text`, `claims.1.value`).","uniqueKey":"error.param","typeLabel":"string"},"details":{"type":"object","additionalProperties":{"oneOf":[{}],"uniqueKey":"error.details.additionalProperties","typeLabel":"any"},"uniqueKey":"error.details","typeLabel":"object"}},"required":["type","message"],"additionalProperties":false,"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"required":["error"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"type":"invalid_request","message":"\u003cstring>","reason":"\u003cstring>","param":"\u003cstring>","details":{}}}}},"exampleType":"generated"}},"exampleType":"generated"},"bdf2fdc0-ee6f-417a-a101-802613a30042":{"description":"Not found, or not in this key's organization and environment","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"object","properties":{"type":{"type":"string","enum":["invalid_request","authentication","permission_denied","not_found","conflict","rate_limited","engine_failed","unavailable","internal"],"isRequired":true,"uniqueKey":"error.type","typeLabel":"enum\u003cstring>"},"message":{"type":"string","description":"For people; don't parse it.","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"reason":{"type":"string","pattern":"^[A-Z][A-Z0-9_]+$","description":"Set where a caller can act on it, one of the reasons in the ErrorReason schema. New reasons may be added: treat an unknown one by the status and `type`.","uniqueKey":"error.reason","typeLabel":"string"},"param":{"type":"string","description":"The request field at fault, as a dotted path (`subject.0.text`, `claims.1.value`).","uniqueKey":"error.param","typeLabel":"string"},"details":{"type":"object","additionalProperties":{"oneOf":[{}],"uniqueKey":"error.details.additionalProperties","typeLabel":"any"},"uniqueKey":"error.details","typeLabel":"object"}},"required":["type","message"],"additionalProperties":false,"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"required":["error"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"type":"invalid_request","message":"\u003cstring>","reason":"\u003cstring>","param":"\u003cstring>","details":{}}}}},"exampleType":"generated"}},"exampleType":"generated"},"9c1d8042-345c-4a09-9938-7ac158f84a62":{"description":"Conflict with the current state","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"object","properties":{"type":{"type":"string","enum":["invalid_request","authentication","permission_denied","not_found","conflict","rate_limited","engine_failed","unavailable","internal"],"isRequired":true,"uniqueKey":"error.type","typeLabel":"enum\u003cstring>"},"message":{"type":"string","description":"For people; don't parse it.","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"reason":{"type":"string","pattern":"^[A-Z][A-Z0-9_]+$","description":"Set where a caller can act on it, one of the reasons in the ErrorReason schema. New reasons may be added: treat an unknown one by the status and `type`.","uniqueKey":"error.reason","typeLabel":"string"},"param":{"type":"string","description":"The request field at fault, as a dotted path (`subject.0.text`, `claims.1.value`).","uniqueKey":"error.param","typeLabel":"string"},"details":{"type":"object","additionalProperties":{"oneOf":[{}],"uniqueKey":"error.details.additionalProperties","typeLabel":"any"},"uniqueKey":"error.details","typeLabel":"object"}},"required":["type","message"],"additionalProperties":false,"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"required":["error"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"type":"invalid_request","message":"\u003cstring>","reason":"\u003cstring>","param":"\u003cstring>","details":{}}}}},"exampleType":"generated"}},"exampleType":"generated"},"36339270-a10f-4d52-8d5b-62658f45b0ab":{"description":"The Idempotency-Key's first result was deleted, so it cannot be replayed","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"object","properties":{"type":{"type":"string","enum":["invalid_request","authentication","permission_denied","not_found","conflict","rate_limited","engine_failed","unavailable","internal"],"isRequired":true,"uniqueKey":"error.type","typeLabel":"enum\u003cstring>"},"message":{"type":"string","description":"For people; don't parse it.","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"reason":{"type":"string","pattern":"^[A-Z][A-Z0-9_]+$","description":"Set where a caller can act on it, one of the reasons in the ErrorReason schema. New reasons may be added: treat an unknown one by the status and `type`.","uniqueKey":"error.reason","typeLabel":"string"},"param":{"type":"string","description":"The request field at fault, as a dotted path (`subject.0.text`, `claims.1.value`).","uniqueKey":"error.param","typeLabel":"string"},"details":{"type":"object","additionalProperties":{"oneOf":[{}],"uniqueKey":"error.details.additionalProperties","typeLabel":"any"},"uniqueKey":"error.details","typeLabel":"object"}},"required":["type","message"],"additionalProperties":false,"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"required":["error"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"type":"invalid_request","message":"\u003cstring>","reason":"\u003cstring>","param":"\u003cstring>","details":{}}}}},"exampleType":"generated"}},"exampleType":"generated"},"47d36fbc-de5d-4072-967e-462742e31d38":{"description":"The request is well formed but cannot be processed (for example reason IDEMPOTENCY_KEY_REUSED)","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"object","properties":{"type":{"type":"string","enum":["invalid_request","authentication","permission_denied","not_found","conflict","rate_limited","engine_failed","unavailable","internal"],"isRequired":true,"uniqueKey":"error.type","typeLabel":"enum\u003cstring>"},"message":{"type":"string","description":"For people; don't parse it.","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"reason":{"type":"string","pattern":"^[A-Z][A-Z0-9_]+$","description":"Set where a caller can act on it, one of the reasons in the ErrorReason schema. New reasons may be added: treat an unknown one by the status and `type`.","uniqueKey":"error.reason","typeLabel":"string"},"param":{"type":"string","description":"The request field at fault, as a dotted path (`subject.0.text`, `claims.1.value`).","uniqueKey":"error.param","typeLabel":"string"},"details":{"type":"object","additionalProperties":{"oneOf":[{}],"uniqueKey":"error.details.additionalProperties","typeLabel":"any"},"uniqueKey":"error.details","typeLabel":"object"}},"required":["type","message"],"additionalProperties":false,"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"required":["error"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"type":"invalid_request","message":"\u003cstring>","reason":"\u003cstring>","param":"\u003cstring>","details":{}}}}},"exampleType":"generated"}},"exampleType":"generated"},"f7708d81-0517-4686-83e7-8cf0cd7e42b9":{"description":"RATE_LIMITED: retry after Retry-After seconds; QUOTA_EXCEEDED: details.reset_at gives the daily reset time (no Retry-After), or details.too_large asks for a smaller request","headers":{"Retry-After":{"schema":{"type":"string","description":"Seconds to wait before retrying, when waiting helps."},"required":false,"description":"Seconds to wait before retrying, when waiting helps."}},"content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"object","properties":{"type":{"type":"string","enum":["invalid_request","authentication","permission_denied","not_found","conflict","rate_limited","engine_failed","unavailable","internal"],"isRequired":true,"uniqueKey":"error.type","typeLabel":"enum\u003cstring>"},"message":{"type":"string","description":"For people; don't parse it.","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"reason":{"type":"string","pattern":"^[A-Z][A-Z0-9_]+$","description":"Set where a caller can act on it, one of the reasons in the ErrorReason schema. New reasons may be added: treat an unknown one by the status and `type`.","uniqueKey":"error.reason","typeLabel":"string"},"param":{"type":"string","description":"The request field at fault, as a dotted path (`subject.0.text`, `claims.1.value`).","uniqueKey":"error.param","typeLabel":"string"},"details":{"type":"object","additionalProperties":{"oneOf":[{}],"uniqueKey":"error.details.additionalProperties","typeLabel":"any"},"uniqueKey":"error.details","typeLabel":"object"}},"required":["type","message"],"additionalProperties":false,"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"required":["error"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"type":"invalid_request","message":"\u003cstring>","reason":"\u003cstring>","param":"\u003cstring>","details":{}}}}},"exampleType":"generated"}},"exampleType":"generated"},"5a77e95b-e2db-4e29-9b91-2338ef4b4912":{"description":"An engine failed to answer a feature the output needs (type engine_failed, reason ENGINE_FAILED)","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"object","properties":{"type":{"type":"string","enum":["invalid_request","authentication","permission_denied","not_found","conflict","rate_limited","engine_failed","unavailable","internal"],"isRequired":true,"uniqueKey":"error.type","typeLabel":"enum\u003cstring>"},"message":{"type":"string","description":"For people; don't parse it.","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"reason":{"type":"string","pattern":"^[A-Z][A-Z0-9_]+$","description":"Set where a caller can act on it, one of the reasons in the ErrorReason schema. New reasons may be added: treat an unknown one by the status and `type`.","uniqueKey":"error.reason","typeLabel":"string"},"param":{"type":"string","description":"The request field at fault, as a dotted path (`subject.0.text`, `claims.1.value`).","uniqueKey":"error.param","typeLabel":"string"},"details":{"type":"object","additionalProperties":{"oneOf":[{}],"uniqueKey":"error.details.additionalProperties","typeLabel":"any"},"uniqueKey":"error.details","typeLabel":"object"}},"required":["type","message"],"additionalProperties":false,"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"required":["error"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"type":"invalid_request","message":"\u003cstring>","reason":"\u003cstring>","param":"\u003cstring>","details":{}}}}},"exampleType":"generated"}},"exampleType":"generated"},"ead9ae3a-7bfa-4acc-9910-cd9556c50a4d":{"description":"Temporarily unavailable, with Retry-After (for example reason AUTH_UNAVAILABLE, ENGINE_UNAVAILABLE or STORE_UNAVAILABLE): retry with the same Idempotency-Key","headers":{"Retry-After":{"schema":{"type":"string","description":"Seconds to wait before retrying, when waiting helps."},"required":true,"description":"Seconds to wait before retrying, when waiting helps."}},"content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"object","properties":{"type":{"type":"string","enum":["invalid_request","authentication","permission_denied","not_found","conflict","rate_limited","engine_failed","unavailable","internal"],"isRequired":true,"uniqueKey":"error.type","typeLabel":"enum\u003cstring>"},"message":{"type":"string","description":"For people; don't parse it.","isRequired":true,"uniqueKey":"error.message","typeLabel":"string"},"reason":{"type":"string","pattern":"^[A-Z][A-Z0-9_]+$","description":"Set where a caller can act on it, one of the reasons in the ErrorReason schema. New reasons may be added: treat an unknown one by the status and `type`.","uniqueKey":"error.reason","typeLabel":"string"},"param":{"type":"string","description":"The request field at fault, as a dotted path (`subject.0.text`, `claims.1.value`).","uniqueKey":"error.param","typeLabel":"string"},"details":{"type":"object","additionalProperties":{"oneOf":[{}],"uniqueKey":"error.details.additionalProperties","typeLabel":"any"},"uniqueKey":"error.details","typeLabel":"object"}},"required":["type","message"],"additionalProperties":false,"isRequired":true,"uniqueKey":"error","typeLabel":"object"}},"required":["error"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":{"type":"invalid_request","message":"\u003cstring>","reason":"\u003cstring>","param":"\u003cstring>","details":{}}}}},"exampleType":"generated"}},"exampleType":"generated"}},"security":{"41dede0f-e8eb-46d3-94fe-fdfcc2bed9aa":{"bearerAuth":{"type":"http","scheme":"bearer","description":"An API key, sent as `Authorization: Bearer \u003ckey>`. Each operation lists the scope its key needs: `decisions:evaluate` (evaluate and read evaluations), `decisions:feedback` (your app's feedback) or `decisions:develop` (everything else, including owner feedback and the review queue). An operation listing no scope takes any scoped key. A key with no scope, or without the operation's, gets 403 INSUFFICIENT_SCOPE.","scopes":["decisions:develop"],"schemeName":"bearerAuth"}}},"servers":{"9e61324b-4cc4-430d-a8d9-fa0221e50db5":{"url":"https://api.moonbounce.ai","description":"Production"}},"processedSecurityOptions":[{"schemes":[{"scheme":{"type":"http","scheme":"bearer","description":"An API key, sent as `Authorization: Bearer \u003ckey>`. Each operation lists the scope its key needs: `decisions:evaluate` (evaluate and read evaluations), `decisions:feedback` (your app's feedback) or `decisions:develop` (everything else, including owner feedback and the review queue). An operation listing no scope takes any scoped key. A key with no scope, or without the operation's, gets 403 INSUFFICIENT_SCOPE.","scopes":["decisions:develop"],"schemeName":"bearerAuth"},"schema":{"title":"Bearer Auth","type":"string","isRequired":true,"description":"An API key, sent as `Authorization: Bearer \u003ckey>`. Each operation lists the scope its key needs: `decisions:evaluate` (evaluate and read evaluations), `decisions:feedback` (your app's feedback) or `decisions:develop` (everything else, including owner feedback and the review queue). An operation listing no scope takes any scoped key. A key with no scope, or without the operation's, gets 403 INSUFFICIENT_SCOPE.","format":"bearer","typeLabel":"string\u003cbearer>","deprecated":false},"schemeName":"bearerAuth","name":"Authorization"}],"title":"bearerAuth"}]},"originalFileLocation":"openapi.json"},"subdomain":"moonbounce","siteName":"Moonbounce Decisions API","title":"Preview a spec change against past feedback - Moonbounce Decisions API","navMaps":{"firstHrefInVersion":{},"firstHrefInLanguage":{}},"lastModified":"2026-11-02T20:55:04.143Z","originalFileLocation":"api-reference/suggestions/preview-a-spec-change-against-past-feedback.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Replays a spec change over past cases with feedback: it spends engine calls, stores a run, and burns the held-out cases it lists. Not a dry run of evaluate. Replays a local spec (with its weights pin and cut points) and its base over the decision\u0026#x27;s reviewed and seeded cases in the key\u0026#x27;s environment (a test key previews against test cases only), and returns fixes, breaks, the action mix at the cut points and an evidence label. Writes an eval run only: never an evaluation, never traffic, never acceptance. A preview does not register the candidate: before evaluating by its structure hash, register the spec with POST /v1/decisions/{decision_id}/structures (or send the spec inline on evaluate once). Holdout cases it lists individually (fixes and breaks) are burned (they count as training from then on); unlisted holdout cases are only scored. evidence.by_split.holdout.holdout_uses counts preview runs that scored held-out cases, not burns. The base, in order: the base of suggestion_id when it is sent (then base is ignored), else base, else the version serving primary traffic in the key\u0026#x27;s environment, else the latest version seeded there, else none. With suggestion_id, hashes_match says whether the spec is that suggestion\u0026#x27;s candidate; another environment\u0026#x27;s suggestion is 404. The evidence replays only cases with an outcome from the owner, reviewers or seeds; the action mix replays a sample of the environment\u0026#x27;s recent primary traffic. For features the candidate changes, before is a fresh re-run of the base feature (the fair baseline), so engine nondeterminism can move it between previews; unchanged features replay cached answers when available. noise_rate measures outcome flips from that re-run against the cached baseline, not score drift. Holdout burns and use counts are per environment, and a test key\u0026#x27;s preview neither reads nor fills the shared cache of engine answers. A decision nothing was registered, evaluated or seeded under is 404.\">\u003cmeta data-mint-head name=\"application-name\" content=\"Moonbounce Decisions API\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"https://mintlify.s3.us-west-1.amazonaws.com/moonbounce/_generated/favicon/apple-touch-icon.png?v=3\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"https://mintlify.s3.us-west-1.amazonaws.com/moonbounce/_generated/favicon/favicon-32x32.png?v=3\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"https://mintlify.s3.us-west-1.amazonaws.com/moonbounce/_generated/favicon/favicon-16x16.png?v=3\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"https://mintlify.s3.us-west-1.amazonaws.com/moonbounce/_generated/favicon/favicon.ico?v=3\">\u003cmeta data-mint-head property=\"og:title\" content=\"Preview a spec change against past feedback - Moonbounce Decisions API\">\u003cmeta data-mint-head property=\"og:description\" content=\"Replays a spec change over past cases with feedback: it spends engine calls, stores a run, and burns the held-out cases it lists. Not a dry run of evaluate. Replays a local spec (with its weights pin and cut points) and its base over the decision\u0026#x27;s reviewed and seeded cases in the key\u0026#x27;s environment (a test key previews against test cases only), and returns fixes, breaks, the action mix at the cut points and an evidence label. Writes an eval run only: never an evaluation, never traffic, never acceptance. A preview does not register the candidate: before evaluating by its structure hash, register the spec with POST /v1/decisions/{decision_id}/structures (or send the spec inline on evaluate once). Holdout cases it lists individually (fixes and breaks) are burned (they count as training from then on); unlisted holdout cases are only scored. evidence.by_split.holdout.holdout_uses counts preview runs that scored held-out cases, not burns. The base, in order: the base of suggestion_id when it is sent (then base is ignored), else base, else the version serving primary traffic in the key\u0026#x27;s environment, else the latest version seeded there, else none. With suggestion_id, hashes_match says whether the spec is that suggestion\u0026#x27;s candidate; another environment\u0026#x27;s suggestion is 404. The evidence replays only cases with an outcome from the owner, reviewers or seeds; the action mix replays a sample of the environment\u0026#x27;s recent primary traffic. For features the candidate changes, before is a fresh re-run of the base feature (the fair baseline), so engine nondeterminism can move it between previews; unchanged features replay cached answers when available. noise_rate measures outcome flips from that re-run against the cached baseline, not score drift. Holdout burns and use counts are per environment, and a test key\u0026#x27;s preview neither reads nor fills the shared cache of engine answers. A decision nothing was registered, evaluated or seeded under is 404.\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Moonbounce Decisions API\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://moonbounce.mintlify.app/api-reference/suggestions/preview-a-spec-change-against-past-feedback\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://moonbounce.mintlify.app/_mintlify/api/og/v2?division=suggestions\u0026amp;title=Preview+a+spec+change+against+past+feedback\u0026amp;description=Replays+a+spec+change+over+past+cases+with+feedback%3A+it+spends+engine+calls%2C+stores+a+run%2C+and+burns+the+held-out+cases+it+lists.+Not+a+dry+run+of+evaluate.+Rep\u0026amp;theme=6d67371419b6cc4f4d7d2b27\u0026amp;signature=cc48c881bbdf5ecd4d7a4073fefbaa7755e7a2488dfb7ac86ae2a9fc3712f1f4\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Preview a spec change against past feedback - Moonbounce Decisions API\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Replays a spec change over past cases with feedback: it spends engine calls, stores a run, and burns the held-out cases it lists. Not a dry run of evaluate. Replays a local spec (with its weights pin and cut points) and its base over the decision\u0026#x27;s reviewed and seeded cases in the key\u0026#x27;s environment (a test key previews against test cases only), and returns fixes, breaks, the action mix at the cut points and an evidence label. Writes an eval run only: never an evaluation, never traffic, never acceptance. A preview does not register the candidate: before evaluating by its structure hash, register the spec with POST /v1/decisions/{decision_id}/structures (or send the spec inline on evaluate once). Holdout cases it lists individually (fixes and breaks) are burned (they count as training from then on); unlisted holdout cases are only scored. evidence.by_split.holdout.holdout_uses counts preview runs that scored held-out cases, not burns. The base, in order: the base of suggestion_id when it is sent (then base is ignored), else base, else the version serving primary traffic in the key\u0026#x27;s environment, else the latest version seeded there, else none. With suggestion_id, hashes_match says whether the spec is that suggestion\u0026#x27;s candidate; another environment\u0026#x27;s suggestion is 404. The evidence replays only cases with an outcome from the owner, reviewers or seeds; the action mix replays a sample of the environment\u0026#x27;s recent primary traffic. For features the candidate changes, before is a fresh re-run of the base feature (the fair baseline), so engine nondeterminism can move it between previews; unchanged features replay cached answers when available. noise_rate measures outcome flips from that re-run against the cached baseline, not score drift. Holdout burns and use counts are per environment, and a test key\u0026#x27;s preview neither reads nor fills the shared cache of engine answers. A decision nothing was registered, evaluated or seeded under is 404.\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://moonbounce.mintlify.app/_mintlify/api/og/v2?division=suggestions\u0026amp;title=Preview+a+spec+change+against+past+feedback\u0026amp;description=Replays+a+spec+change+over+past+cases+with+feedback%3A+it+spends+engine+calls%2C+stores+a+run%2C+and+burns+the+held-out+cases+it+lists.+Not+a+dry+run+of+evaluate.+Rep\u0026amp;theme=6d67371419b6cc4f4d7d2b27\u0026amp;signature=cc48c881bbdf5ecd4d7a4073fefbaa7755e7a2488dfb7ac86ae2a9fc3712f1f4\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"https://mintlify.s3.us-west-1.amazonaws.com/moonbounce/_generated/favicon/browserconfig.xml?v=3\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Moonbounce Decisions API\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#4f46e5\">\u003clink data-mint-head rel=\"canonical\" href=\"https://moonbounce.mintlify.app/api-reference/suggestions/preview-a-spec-change-against-past-feedback\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/api-reference/suggestions/preview-a-spec-change-against-past-feedback.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://moonbounce.mintlify.app/#organization\",\"name\":\"Moonbounce Decisions API\",\"url\":\"https://moonbounce.mintlify.app\"},{\"@type\":\"WebSite\",\"@id\":\"https://moonbounce.mintlify.app#website\",\"name\":\"Moonbounce Decisions API\",\"url\":\"https://moonbounce.mintlify.app\",\"publisher\":{\"@id\":\"https://moonbounce.mintlify.app/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://moonbounce.mintlify.app/api-reference/suggestions/preview-a-spec-change-against-past-feedback#webpage\",\"url\":\"https://moonbounce.mintlify.app/api-reference/suggestions/preview-a-spec-change-against-past-feedback\",\"name\":\"Preview a spec change against past feedback\",\"description\":\"Replays a spec change over past cases with feedback: it spends engine calls, stores a run, and burns the held-out cases it lists. Not a dry run of evaluate. Replays a local spec (with its weights pin and cut points) and its base over the decision's reviewed and seeded cases in the key's environment (a test key previews against test cases only), and returns fixes, breaks, the action mix at the cut points and an evidence label. Writes an eval run only: never an evaluation, never traffic, never acceptance. A preview does not register the candidate: before evaluating by its structure hash, register the spec with POST /v1/decisions/{decision_id}/structures (or send the spec inline on evaluate once). Holdout cases it lists individually (fixes and breaks) are burned (they count as training from then on); unlisted holdout cases are only scored. evidence.by_split.holdout.holdout_uses counts preview runs that scored held-out cases, not burns. The base, in order: the base of suggestion_id when it is sent (then base is ignored), else base, else the version serving primary traffic in the key's environment, else the latest version seeded there, else none. With suggestion_id, hashes_match says whether the spec is that suggestion's candidate; another environment's suggestion is 404. The evidence replays only cases with an outcome from the owner, reviewers or seeds; the action mix replays a sample of the environment's recent primary traffic. For features the candidate changes, before is a fresh re-run of the base feature (the fair baseline), so engine nondeterminism can move it between previews; unchanged features replay cached answers when available. noise_rate measures outcome flips from that re-run against the cached baseline, not score drift. Holdout burns and use counts are per environment, and a test key's preview neither reads nor fills the shared cache of engine answers. A decision nothing was registered, evaluated or seeded under is 404.\",\"dateModified\":\"2026-11-02T20:55:04.143Z\",\"isPartOf\":{\"@id\":\"https://moonbounce.mintlify.app#website\"},\"breadcrumb\":{\"@id\":\"https://moonbounce.mintlify.app/api-reference/suggestions/preview-a-spec-change-against-past-feedback#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://moonbounce.mintlify.app/api-reference/suggestions/preview-a-spec-change-against-past-feedback#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Endpoints\",\"item\":\"https://moonbounce.mintlify.app/api-reference/health/health-check\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"suggestions\",\"item\":\"https://moonbounce.mintlify.app/api-reference/suggestions/list-suggestions-for-a-decision\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Preview a spec change against past feedback\",\"item\":\"https://moonbounce.mintlify.app/api-reference/suggestions/preview-a-spec-change-against-past-feedback\"}]},{\"@type\":[\"TechArticle\",\"APIReference\"],\"@id\":\"https://moonbounce.mintlify.app/api-reference/suggestions/preview-a-spec-change-against-past-feedback#apireference\",\"headline\":\"Preview a spec change against past feedback\",\"name\":\"Preview a spec change against past feedback\",\"description\":\"Replays a spec change over past cases with feedback: it spends engine calls, stores a run, and burns the held-out cases it lists. Not a dry run of evaluate. Replays a local spec (with its weights pin and cut points) and its base over the decision's reviewed and seeded cases in the key's environment (a test key previews against test cases only), and returns fixes, breaks, the action mix at the cut points and an evidence label. Writes an eval run only: never an evaluation, never traffic, never acceptance. A preview does not register the candidate: before evaluating by its structure hash, register the spec with POST /v1/decisions/{decision_id}/structures (or send the spec inline on evaluate once). Holdout cases it lists individually (fixes and breaks) are burned (they count as training from then on); unlisted holdout cases are only scored. evidence.by_split.holdout.holdout_uses counts preview runs that scored held-out cases, not burns. The base, in order: the base of suggestion_id when it is sent (then base is ignored), else base, else the version serving primary traffic in the key's environment, else the latest version seeded there, else none. With suggestion_id, hashes_match says whether the spec is that suggestion's candidate; another environment's suggestion is 404. The evidence replays only cases with an outcome from the owner, reviewers or seeds; the action mix replays a sample of the environment's recent primary traffic. For features the candidate changes, before is a fresh re-run of the base feature (the fair baseline), so engine nondeterminism can move it between previews; unchanged features replay cached answers when available. noise_rate measures outcome flips from that re-run against the cached baseline, not score drift. Holdout burns and use counts are per environment, and a test key's preview neither reads nor fills the shared cache of engine answers. A decision nothing was registered, evaluated or seeded under is 404.\",\"url\":\"https://moonbounce.mintlify.app/api-reference/suggestions/preview-a-spec-change-against-past-feedback\",\"mainEntityOfPage\":{\"@id\":\"https://moonbounce.mintlify.app/api-reference/suggestions/preview-a-spec-change-against-past-feedback#webpage\"},\"dateModified\":\"2026-11-02T20:55:04.143Z\",\"publisher\":{\"@id\":\"https://moonbounce.mintlify.app/#organization\"},\"isPartOf\":{\"@id\":\"https://moonbounce.mintlify.app#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Moonbounce Decisions API\",\"creator\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","siteName":"Moonbounce Decisions API","nav":{"global":null,"tabs":[{"tab":"Guides","pages":[{"title":"Guides","href":""}]},{"tab":"API reference","groups":[{"group":"Overview","pages":[{"title":"API reference overview","href":"/reference/overview"}]},{"group":"Endpoints","pages":[{"group":"health","pages":[{"title":"Health check","deprecated":null,"version":null,"openapi":"/openapi.json get /health","href":"/api-reference/health/health-check"}]},{"group":"specs","pages":[{"title":"Hash a decision spec","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/specs/hash","href":"/api-reference/specs/hash-a-decision-spec"},{"title":"List registered structures","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/decisions/{decision_id}/structures","href":"/api-reference/specs/list-registered-structures"},{"title":"Register a spec structure","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/decisions/{decision_id}/structures","href":"/api-reference/specs/register-a-spec-structure"},{"title":"Get a registered structure and its spec","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/decisions/{decision_id}/structures/{structure}","href":"/api-reference/specs/get-a-registered-structure-and-its-spec"},{"title":"List decisions in this environment","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/decisions","href":"/api-reference/specs/list-decisions-in-this-environment"}]},{"group":"engines","pages":[{"title":"List the engines a decision can run on","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/engines","href":"/api-reference/engines/list-the-engines-a-decision-can-run-on"},{"title":"Get the engine a decision runs on","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/decisions/{decision_id}/binding","href":"/api-reference/engines/get-the-engine-a-decision-runs-on"},{"title":"Choose the engine a decision runs on","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/decisions/{decision_id}/binding/revisions","href":"/api-reference/engines/choose-the-engine-a-decision-runs-on"}]},{"group":"evaluate","pages":[{"title":"Evaluate an item against a decision","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/evaluate","href":"/api-reference/evaluate/evaluate-an-item-against-a-decision"},{"title":"Get a past evaluation","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/evaluations/{evaluation_id}","href":"/api-reference/evaluate/get-a-past-evaluation"},{"title":"List a decision's evaluations","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/decisions/{decision_id}/evaluations","href":"/api-reference/evaluate/list-a-decisions-evaluations"}]},{"group":"feedback","pages":[{"title":"Submit feedback on an evaluation or item","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/feedback","href":"/api-reference/feedback/submit-feedback-on-an-evaluation-or-item"},{"title":"Get a feedback submission as stored","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/feedback/{feedback_id}","href":"/api-reference/feedback/get-a-feedback-submission-as-stored"},{"title":"Export a decision's feedback as training data","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/decisions/{decision_id}/feedback","href":"/api-reference/feedback/export-a-decisions-feedback-as-training-data"},{"title":"Seed a decision with labeled examples","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/decisions/{decision_id}/seeds","href":"/api-reference/feedback/seed-a-decision-with-labeled-examples"}]},{"group":"review","pages":[{"title":"List review items","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/review/items","href":"/api-reference/review/list-review-items"},{"title":"Get a review item","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/review/items/{item_id}","href":"/api-reference/review/get-a-review-item"},{"title":"Get the structure and weights a review item was decided with","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/review/items/{item_id}/configuration","href":"/api-reference/review/get-the-structure-and-weights-a-review-item-was-decided-with"},{"title":"Mark a review item as shown","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/review/items/{item_id}/shown","href":"/api-reference/review/mark-a-review-item-as-shown"},{"title":"Submit a review","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/review/items/{item_id}/submit","href":"/api-reference/review/submit-a-review"},{"title":"Withdraw a review answer","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/review/items/{item_id}/withdraw","href":"/api-reference/review/withdraw-a-review-answer"},{"title":"Change your own earlier review answer","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/review/items/{item_id}/change","href":"/api-reference/review/change-your-own-earlier-review-answer"},{"title":"Skip a review item","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/review/items/{item_id}/skip","href":"/api-reference/review/skip-a-review-item"},{"title":"Add the reason for a blind disagreement","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/review/items/{item_id}/reason","href":"/api-reference/review/add-the-reason-for-a-blind-disagreement"}]},{"group":"suggestions","pages":[{"title":"List suggestions for a decision","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/decisions/{decision_id}/suggestions","href":"/api-reference/suggestions/list-suggestions-for-a-decision"},{"title":"Generate a suggestion on demand","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/decisions/{decision_id}/suggestions","href":"/api-reference/suggestions/generate-a-suggestion-on-demand"},{"title":"Get a suggestion","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/suggestions/{suggestion_id}","href":"/api-reference/suggestions/get-a-suggestion"},{"title":"Mark a suggestion pulled or rejected","description":"proposed -> pulled, proposed or pulled -> rejected; repeating the current status is a no-op. Anything else is 409. `accepted` is never set by a caller: it is observed in live calls on production keys. Another environment's suggestion is 404.","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/suggestions/{suggestion_id}/status","href":"/api-reference/suggestions/mark-a-suggestion-pulled-or-rejected"},{"title":"Preview a spec change against past feedback","deprecated":null,"version":null,"openapi":"/openapi.json post /v1/decisions/{decision_id}/previews","href":"/api-reference/suggestions/preview-a-spec-change-against-past-feedback"},{"title":"Get the improvement loop's status","description":"Accepted suggestions with their evidence labels, review counts, spot-check agreement (on the version that last served production before the first acceptance vs on accepted candidates, by the version that served each production review) and the stop check: after `threshold` reviews with no suggestion beating the original on held-out cases, stop and rethink. Counts the key's environment only: a test key's reviews, random stratum and suggestions, with no accepted suggestions and so no spot check (acceptance is production's).","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/decisions/{decision_id}/loop","href":"/api-reference/suggestions/get-the-improvement-loops-status"}]},{"group":"usage","pages":[{"title":"Engine and model cost for a decision, per evaluation and in total","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/decisions/{decision_id}/usage","href":"/api-reference/usage/engine-and-model-cost-for-a-decision-per-evaluation-and-in-total"}]},{"group":"keys","pages":[{"title":"Identify the calling key or sign-in","deprecated":null,"version":null,"openapi":"/openapi.json get /v1/whoami","href":"/api-reference/keys/identify-the-calling-key-or-sign-in"}]}]}]}]},"basePath":"","title":"Preview a spec change against past feedback - Moonbounce Decisions API","buildId":"dpl_36EDyZCDfRuoUD9af5CH4M1bqY2h","deploymentId":"dpl_36EDyZCDfRuoUD9af5CH4M1bqY2h","dynamics":["10e4515597","c2aa737661","2b790eda92","b0f84f53ff","a9bb46feb3"],"chunks":["BannerMarkdown-DHaG7hr_.js","dist-DKZWslLH.js","lib-DuNMoZ05.js","lib-B8HbPgcC.js","clsx-BIWXJmsZ.js","html-void-elements-mCSPHezU.js","katex-YMM-FMeD.js","marked.esm-CZWythHk.js","OpenApiReferenceProvider-DCDCdBVX.js","utils-ME8dDnLe.js","cloneDeep-izs3Hzxb.js","_Uint8Array-BVIqJ90l.js","isObjectLike-C8vmzPEN.js","isArray-Dcu1dQ5t.js","utils-0e84ACsd.js","toString-BX-iyh8G.js","isSymbol-CSH9U2Gm.js","addUniqueKeysToSchema-wgRBj-ia.js","snippetPresets-C11Sgb-o.js","style-to-object-BY3JEAdk.js","v4-DIgz8zy6.js","ApiExamples-C0lapOpP.js","isEqual-BfaiBbcl.js","usePlaygroundInputsStore-ZeRQV8fF.js","shallow-BupWh095.js","getApiPlaygroundDisplay-BnYQO2Ss.js","CodeSnippet-RKKOc8c_.js","CodeSnippets-Drf_m8wS.js","Page-Bevw23-4.js","getPastedJson-u6QiPzNZ.js","icon-Bb-CBSxO.js","MethodPill-F7l5AI7V.js","DuplicateIcon-IiAXkdSg.js","createIcon-FliI8EBc.js","DynamicMarkdown-B62XqCSI.js","SectionHeading-Dj31pT03.js","axios-vUo_bRtp.js","Markdown-BOgQCTwD.js","AssistantPageLink-UDqbR6xh.js"]}