From e5b049d4c8c965030c1f0b01ea27685c96280cef Mon Sep 17 00:00:00 2001 From: agentforce314 <273884145+agentforce314@users.noreply.github.com> Date: Sun, 16 Aug 2026 10:23:14 -0700 Subject: [PATCH] feat(nano): make the completion-verification guideline operational MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Four of the nine completed-wrong tasks in tb21-nano-flash-max-2 were one-assertion near-misses, each violating a constraint stated in the task text that the agent never tested: build-pov-ray built from the wrong source archive (2/3 tests green), dna-insert's primer Tm delta was 6.5°C against a stated ≤5°C bound, filter-js-from-html claimed 'fully verified' while mutating clean HTML entities, pytorch-model-cli passed 5/6 with an untested CLI output format. The bullet now names the method — extract the task's explicit requirements AND constraints (formats, tolerances, numeric bounds, required sources/methods) into a list and test the artifact against each — rather than only the principle. TB verifiers are hidden, so self-verification against the stated constraints is the only available check; this is the general skill, not benchmark knowledge. Co-Authored-By: Claude Fable 5 --- src/nano/prompt.py | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-) diff --git a/src/nano/prompt.py b/src/nano/prompt.py index eefeddc6..b3dbb961 100644 --- a/src/nano/prompt.py +++ b/src/nano/prompt.py @@ -79,9 +79,10 @@ "- Run long builds, training runs, or downloads as ONE blocking bash " "command (tee output to a log) — never launch with nohup and poll in " "a loop", - "- Before finishing, re-read the task and verify each explicit " - "requirement against what you actually produced; plausible output " - "is not verified output", + "- Before finishing, re-read the task and list every explicit " + "requirement and constraint (exact formats, tolerances, numeric " + "bounds, required sources or methods), then test your artifact " + "against each one; plausible output is not verified output", "- Be concise in your responses", "- Show file paths clearly when working with files", )