Command reference
oko-cli auto-goals llm-eval
Evaluates a routed LLM against the auto-goal intent JSONL corpus.
Invocation
oko-cli auto-goals llm-eval [--file PATH] [--model NAME] [--router URL]Inputs and options
- --file selects the corpus.
- --model selects the routed model.
- --router overrides the configured Stado router.
Output and state effect
- Prints action/title accuracy and individual mismatches; it does not update goal state.
Refusals and safe exits
- Refuses unreadable/invalid JSONL, unavailable router identity/configuration, non-2xx router responses, missing decisions, or evaluation mismatches.