Skip to content

(MOT-4452) fix: clarify LLM failure messages - #817

Merged
ytallo merged 1 commit into
feat/harness-console-adversarial-securityfrom
fix/router-error-dx
Aug 18, 2026
Merged

(MOT-4452) fix: clarify LLM failure messages#817
ytallo merged 1 commit into
feat/harness-console-adversarial-securityfrom
fix/router-error-dx

Conversation

@ytallo

@ytallo ytallo commented Aug 17, 2026

Copy link
Copy Markdown
Contributor

Summary

  • preserve structured Router error codes, classes, retryability, and diagnostics through Harness
  • separate user-facing explanations and recovery actions from technical details in Console
  • add stable error codes and actionable copy for routing, capacity, provider, and stream failures
  • verify provider-family failures remain clear and durable across reload and a later successful turn

Why

Users currently see raw provider and transport diagnostics as the primary failure message. This makes common failures difficult to understand and leaves the Console without enough structured context to recommend the right next step.

This stacked PR builds on #815, which hardens the terminal and retry lifecycle used by these failure paths.

Screenshots

Anthropic Messages

image

OpenAI Chat Completions

image

OpenAI Responses

image

Validation

  • llm-router: 131 library tests passed
  • harness: 324 library tests passed
  • harness-integration: 2 provider-family contract tests passed
  • console/web: 1,208 unit tests passed; application and E2E typechecks passed; Biome passed
  • Playwright: 3 provider-family failure, reload, and recovery scenarios passed against an isolated stack built from this branch

Refs MOT-4452

@vercel

vercel Bot commented Aug 17, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
workers Ready Ready Preview Aug 17, 2026 12:20pm
workers-tech-spec Ready Ready Preview Aug 17, 2026 12:20pm

Request Review

@github-actions

Copy link
Copy Markdown
Contributor

skill-check — worker

0 verified, 60 skipped (no docs/).

Layer Result
structure
vale
ai
render

Four for four. Nicely done.

@coderabbitai

coderabbitai Bot commented Aug 17, 2026

Copy link
Copy Markdown

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: f98f374f-571c-471e-970c-30cc628b6ac3

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@ytallo
ytallo marked this pull request as ready for review August 18, 2026 14:54
@ytallo
ytallo merged commit abaddae into feat/harness-console-adversarial-security Aug 18, 2026
28 of 31 checks passed
ytallo added a commit that referenced this pull request Aug 19, 2026
)

* (MOT-4452) fix: harden Harness and Console boundaries

* (MOT-4452) fix(llm-router): harden retry lifecycle

* (MOT-4452) fix: clarify LLM failure messages (#817)

* (MOT-4452) fix: align CI with hardened error contracts

* (MOT-4452) fix(console): isolate terminal E2E zsh startup

* (MOT-4452) test(console): synchronize terminal replay reload

* (MOT-4452) test(console): synchronize tmux terminal flow

* (MOT-4452) test(console): keep tmux assertions viewport-safe

* (MOT-4452) test(console): preserve structured terminal errors

* (MOT-4452) fix(ci): remove obsolete terminal workflow assertion
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant