Command reference
oko goals evaluate
Scores the goal-lifecycle model on the labelled goal-intent cases.
Invocation#
oko goals evaluate [--file PATH] [--model NAME]Inputs and options#
- --file selects the cases; --model the routed model.
Output and state effect#
- Asks the model one object under a strict JSON Schema: one decision per case, naming only the cases' ids. Prints action and title accuracy as matched/total and every mismatch; goal state is not changed.
Refusals and safe exits#
- Refuses unreadable/invalid JSONL, an unavailable router identity or configuration, non-2xx router responses, an answer that does not fit the schema and missing decisions.