Skip to content

Regenerate retrieval corpus v2 and republish benchmark results #179

Description

@sarthakagrawal927

The retrieval harness now rejects v1 corpora because added files cannot be scored against a pre-fix revision. The checked-in retrieval corpora and reports remain archival until rebuilt and rerun.\n\n- [ ] Rebuild every checked-in corpus with codevetter.context-retrieval-corpus.v2\n- [ ] Confirm created_files are excluded from required_files\n- [ ] Rerun required controls and provider arms under the revision-derived tier protocol\n- [ ] Confirm controls lose at 1k, 4k, and 16k within each repository\n- [ ] Republish reports with per-arm case coverage and abandonment status\n- [ ] Record exact commands, revisions, costs, and artifact hashes

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions