AgentKit
DocsKitsCLI ReferenceDesktop App
BetaYou are reading docs for the beta channel (3.0.0-beta.15). Features may change before the next stable release.Switch to stable →

eval

ak eval workflow

Inspect a bounded scenario, fix or debug decision without executing it

Use ak eval workflow for the operation described below. The command help records its arguments, effects, and options.

Shadow mode calls the external provider only when you have enabled semantic_decision at user scope, granted this consumer explicitly with semantic_decision.consumers.workflow-controller set to true, and made the selected provider's credential available (see providers and credentials). The grant is required even when you have no consumers map. See ak eval decision for the opt-in keys.

Command contract

Inspect a bounded scenario, fix or debug decision without executing it

Synopsis

Off mode validates local facts without reading provider configuration or credentials. Shadow mode requires explicit user-scope workflow-controller consent. Effective legacy actions and scenario dispositions remain unchanged; recommendations never grant authority.

Effects: Optional shadow evaluation sends bounded sanitized facts to the configured provider and may incur charges. Prints a receipt; never executes actions or saves input.

Exit status: 0 receipt available, including safe provider fallback 1 invalid input or configuration 2 invalid arguments

ak eval workflow <request.json|-> [flags]

Examples

  ak eval workflow request.json --json
  ak eval workflow request.json --mode shadow --json

Options

  -h, --help             help for workflow
      --json             Emit machine-readable JSON (implies --no-interactive)
      --mode string      off or explicitly authorized shadow evaluation (default "off")
      --no-interactive   Disable interactive prompts (CI-safe)
  -q, --quiet            Suppress non-error output on stderr
  -V, --verbose          Extra diagnostic output on stderr (loses to --quiet)
  -y, --yes              Assume yes for all prompts

SEE ALSO

  • ak eval - Run controlled skill and agent evaluations