Skip to content

Add eval loop hygiene recipe and honest regression docs - #117

Merged
KangaKode merged 1 commit into
mainfrom
feat/eval-loop-hygiene
Aug 18, 2026
Merged

Add eval loop hygiene recipe and honest regression docs#117
KangaKode merged 1 commit into
mainfrom
feat/eval-loop-hygiene

Conversation

@KangaKode

Copy link
Copy Markdown
Owner

Summary

  • Risk-tier: Medium — docs/template eval recipe + regression example + FEATURES honesty; no high-tier auth/schema/CI workflow paths as the primary change. (Also repairs invalid multiline YAML in .pre-commit-config.yaml so native hooksPath pre-commit can load; same hook intent, no behavior expansion.)
  • FEATURES receipt gate: wording now matches shipped behavior (receipt required; no over-claim of preference graduation or default CI blocking for eval gates).
  • Eval recipe + regression + Makefile: factory-floor error-analysis path (ERROR_ANALYSIS_RECIPE, error_analysis.py, fixture + recipe tests), one ISA open-claim regression example, opt-in Makefile target as a documented no-op unless enabled.
  • No default CI workflow edits — does not change .github/workflows/** to block on evals by default.
  • No private inspiration / upstream project names in the diff.

Test plan

  • python -m unittest tests.test_eval_loop_hygiene
  • Generated project: pytest evals recipe + ISA open-claim regression
  • bash scripts/validate_generated.sh (note SSL/pip-audit env flake if seen; treat as env, not product failure)
  • Confirm FEATURES/GOVERNANCE/EVAL_SCALING_GUIDE claims match code (opt-in Makefile; no default CI block)

Made with Cursor

Ship a factory-floor error-analysis path, one ISA open-claim regression example, opt-in Makefile no-op, and fix FEATURES/docs that over-claimed preference graduation or default CI blocking.

Co-authored-by: Cursor <cursoragent@cursor.com>
@cursor

cursor Bot commented Aug 16, 2026

Copy link
Copy Markdown
Contributor

Bugbot is not enabled for your account, so this pull request was not reviewed.

Enable Bugbot in the Cursor dashboard to get automatic reviews on future PRs.

@KangaKode
KangaKode merged commit 3489014 into main Aug 18, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant