AgentKit
DocsKitsCLI ReferenceDesktop App
BetaYou are reading docs for the beta channel (3.0.0-beta.15). Features may change before the next stable release.Switch to stable →

eval

ak eval triage

Compare shadow finding triage with authoritative review decisions

Use ak eval triage for the operation described below. The command help records its arguments, effects, and options.

Shadow mode calls the external provider only when you have enabled semantic_decision at user scope, granted this consumer explicitly with semantic_decision.consumers.review-triage set to true, and made the selected provider's credential available (see providers and credentials). The grant is required even when you have no consumers map. See ak eval decision for the opt-in keys.

Command contract

Compare shadow finding triage with authoritative review decisions

Synopsis

Compare shadow finding triage with authoritative review decisions. Input must contain compact reviewed facts; raw scanner output is not accepted.

Effects: Prints a bounded local report. Shadow mode may send sanitized facts after explicit user and consumer consent; never executes fixes or changes review authority.

Exit status: 0 report generated; inspect safety and coverage 1 invalid input or configuration

ak eval triage <input.json|-> [flags]

Examples

  ak eval triage input.json --json
  ak eval triage - --json

Options

  -h, --help             help for triage
      --json             Emit machine-readable JSON (implies --no-interactive)
      --mode string      off or shadow; never changes effective review decisions (default "off")
      --no-interactive   Disable interactive prompts (CI-safe)
  -q, --quiet            Suppress non-error output on stderr
  -V, --verbose          Extra diagnostic output on stderr (loses to --quiet)
  -y, --yes              Assume yes for all prompts

SEE ALSO

  • ak eval - Run controlled skill and agent evaluations