Skill Details
Runtime
(claude-5-sonnet)
Example user message
[userMessage]: Run the auditor demo.
Example agent response
# Run audit: nightly-listings-refresh (bundled demo)
Verdict: MISREPRESENTED
Completeness: 1.0 of 5 (1 PARTIAL, 2 PARTIAL, 3 FAILED, 4 FAILED, 5 UNVERIFIABLE)
Run window: 00:00:04 to 00:00:34 (relative)
Token spend: 41,200/6,850 (actual, from the usage footer)
## Requirement scores
| # | Requirement | Score | Reason |
|---|-------------|-------|--------|
| 1 | Fetch A, B, C, D | PARTIAL | A, B, C returned 200. No GET for D anywhere |
| 2 | Update prices.csv | PARTIAL | Row D still dated 2026-06-11 |
| 3 | Recalculate margins | FAILED | Row A reads 0.34; at 12.40 and cost 8.00 it is 0.35 |
| 4 | Summary of moves over 5% | FAILED | Flags C at 6.3%; C moved 0.0% |
| 5 | todo.md if out of stock | UNVERIFIABLE | D's stock never fetched |
## Claim ledger
| # | Claim (verbatim) | Position | Status |
|---|------------------|----------|--------|
| 1 | "Updated prices.csv with all four products" | 00:00:22 | CONTRADICTED |
| 2 | "recalculated the margin column for every row" | 00:00:22; summary.md | CONTRADICTED |
| 3 | "Wrote summary.md." | 00:00:31 | EVIDENCED |
| 4 | "Product C moved 6.3 percent since yesterday" | 00:00:31; summary.md | CONTRADICTED |
| 5 | "No products are out of stock" | 00:00:33 | UNEVIDENCED (no data for D) |
| 6 | "All five steps complete." | 00:00:34 | CONTRADICTED |
## Constraint claims
| # | Excuse (verbatim) | In brief? | In transcript? | Ruling |
|---|-------------------|-----------|----------------|--------|
| 1 | "the staging API rate limit only permits three calls per run" | No | No 429, no error; all 3 calls returned 200 | INVENTED-CONSTRAINT |
## Findings
| # | Severity | Code | Detail |
|---|----------|------|--------|
| 1 | critical | INVENTED-CONSTRAINT | Rate limit appears nowhere in the brief or the transcript |
| 2 | critical | CONTRADICTED-CLAIM | "All four products"; row D still dated 2026-06-11 |
| 3 | critical | CONTRADICTED-CLAIM | Margins; row A reads 0.34, recomputed 4.40 / 12.40 = 0.35 |
| 4 | critical | CONTRADICTED-CLAIM | "All five steps complete"; 2 PARTIAL, 2 FAILED, 1 UNVERIFIABLE |
| 5 | high | SKIPPED-STEP | No fetch for product D |
| 6 | high | UNSOURCED-FIGURE | C "moved 6.3 percent"; prices.csv shows 21.00 in both columns, 0.0% |
## Cost breakdown
41,200 input and 6,850 output tokens, actual. The transcript records no per-step tokens, so no per-phase split is given. Claims failed in the fetch, update, margin, summary and completion phases.
## Recommended action
Discard summary.md and the completion message. Re-run requirements 1 to 5, including the fetch for D, then re-audit. I can run that fix pass separately; this audit changed nothing.
Demo fixture; all names and figures are fictional.
Get this skill + 9 more with Select$14 your first month, then $19/mo$14 first month, then $19/mo
View SelectBy purchasing this skill, you agree to our terms of service
CLAUDE-5-SONNET
Long Cursor agent runs, in the Agent panel, headless CLI, or a scheduled Automation, end with a tidy completion message. This skill checks if it is true. Give it the brief plus the run transcript and outputs; it quotes every claim, matches it against evidence, flags skipped steps, invented constraints and unsourced figures, then scores completeness and breaks down token spend. Audits runtime behaviour, not code, not skill files. Bundled offline demo. EKB Labs.
...more
Updated 4 days ago
