Skip to content

Repository files navigation

braintrust

A multi-harness plugin from the not-my-job marketplace. Primary host: Claude Code. Also designed to work when the skill is loaded from Codex, Grok Build, OpenCode, or agy.

License

What it does

Delegates a task to peer AI CLIs in parallel. Second opinions on architecture, research across model families, security audits, design reviews.

Grounding (Skeptical Colleague + Goal Cards):

  • Goal Cards at .braintrust/goal-cards/<slug>.md with a session_anchor
  • 6-step protocol: restatement, assumptions, evidence, fidelity, honesty, GROUNDED / NOT GROUNDED
  • Host actively curates context before delegating (not "whatever is in the chat")

Members (v1.10)

Slot CLI Notes
Anthropic Claude Task tool inside Claude Code; claude -p from other hosts
Google agy only No Gemini CLI. Account-tier model; optional --model
OpenAI Codex gpt-5.6-sol (GPT-5.6 Sol); isolated CODEX_HOME + --ignore-user-config; CLI ≥ 0.144.0
xAI Grok Default model grok-4.5
Multi OpenCode User's configured/default model (probe discovers)

Up to five independent voices when everything is installed and authenticated. Availability is decided by scripts/bt_probe.sh, not by preference.

Commands

Command What it does
/braintrust Orchestrate a task across peer CLIs
/consult Alias for /braintrust

v1.10.0 Highlights

  • Codex primary model: GPT-5.6 Sol (gpt-5.6-sol). Explicit -m because consults use --ignore-user-config (user config model pin is ignored).
  • Probe prefers Sol, falls back to product default if Sol is unavailable, and records bt_codex_model.
  • Documented minimum Codex CLI 0.144.0+ for Sol (npm i -g @openai/codex@latest).

Earlier (v1.9)

  • Hybrid always-on skill (eval-backed); Gemini CLI removed; OpenCode user-default model discovery
  • Grok default grok-4.5; Codex clean CODEX_HOME + --ignore-user-config
  • Multi-host matrix; durable evals under evals/

Requirements

All peers optional; braintrust uses whatever the probe authenticates.

  • Claude Code
  • Antigravity CLI (agy)curl -fsSL https://antigravity.google/cli/install.sh | bash
  • Codex CLI≥ 0.144.0 for GPT-5.6 Sol (npm i -g @openai/codex@latest)
  • Grok Buildcurl -fsSL https://x.ai/cli/install.sh | bash
  • OpenCode — with an authed provider; set "model" in ~/.config/opencode/opencode.json so headless matches your TUI default

jq required for Codex / Grok / OpenCode JSON parsing.

Install

claude plugins install braintrust@not-my-job

Refresh / dogfood / evals

bash scripts/bt_probe.sh
bash evals/run_eval.sh matrix all agy,codex,grok,opencode
# deeper harness drift notes: skills/braintrust/references/self-improvement.md

License

MIT

About

Orchestrate other AI CLIs (agy, Codex, Grok, OpenCode, Claude Code) for second opinions, research, and codebase analysis. No Gemini CLI. Hybrid always-on skill (eval-backed).

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages