Skip to content

github-slack-development-digest: add Linux CI tests - #618

Open
lucbruni-amd wants to merge 6 commits into
mainfrom
users/lucbruni/github-slack-digest-ci-tests
Open

github-slack-development-digest: add Linux CI tests#618
lucbruni-amd wants to merge 6 commits into
mainfrom
users/lucbruni/github-slack-digest-ci-tests

Conversation

@lucbruni-amd

@lucbruni-amd lucbruni-amd commented Jul 22, 2026

Copy link
Copy Markdown
Collaborator

Summary

Adds hidden CI test blocks and Linux platform metadata to the GitHub-to-Slack Development Digest playbook, following the n8n and lemonade test patterns. Addresses #600 (sibling of #601 / #615 for the OpenHands getting-started playbook).

Scoped to Linux only: the agent-canvas agent-server does not start via the playbook's direct npm path on Windows (see below), so Windows is removed from the platform maps and README.

What the tests cover

  • lemonade-version, node-npm-version, uv-version: prerequisite CLIs are present (installs are one-time runner setup, not done in CI)
  • lemonade-chat: Lemonade serves the model (present + downloaded) and answers a deterministic chat request (mirrors playbook step 2, max_tokens: 64)
  • agent-canvas-version: the agent-canvas CLI is on PATH
  • agent-canvas-start: full agent-canvas launch, asserts the agent-server backend is healthy on 18000/server_info (not just the 8000 ingress, which returns 200 even when the backend is down)
  • mcp-packages-resolve: the GitHub and Slack MCP packages resolve from the npm registry (running them needs real tokens plus UI, so out of CI scope)
  • lemonade-unload: frees the GPU pool

Why Linux only

On a Windows halo runner, agent-canvas starts the ingress/static/automation processes but the agent-server exits immediately (The system cannot find the file specified), leaving /server_info and /health returning 502 while / still returns 200. The vendor's own Windows quickstart uses the Docker sandbox rather than the direct npm path this playbook documents. Windows is therefore dropped from supported, tested, required, and published platform maps and the Windows README blocks removed.

Verification (self-hosted runners, halo-02 Linux / halo-0 Windows)

  • All 8 tests pass on Linux (real Qwen3.6-35B chat; full agent-canvas launch reaches 18000/server_info = 200, exit 0)
  • Confirmed the 8000/ probe would false-pass with a dead backend, so the test now probes 18000/server_info
  • Confirmed the cleanup trap no longer flips a pass to a fail under set -euo pipefail
  • validate_playbooks.py: 0 errors

Test plan

  • CI runs the digest tests on halo/stx/krk Linux runners and they pass
  • Confirm Lemonade is serving Qwen3.6-35B-A3B-GGUF on the target runners

Add hidden CI test blocks and Linux platform metadata for the
GitHub-to-Slack digest playbook, following the n8n and lemonade
test patterns. Coverage: prerequisite CLI checks (lemonade, node,
npm, uv, agent-canvas), a Lemonade model chat health check, GitHub
and Slack MCP package resolution, and a full agent-canvas launch
that verifies the agent-server backend on 18000/server_info (not
just the 8000 ingress, which returns 200 even when the backend is
down), plus GPU cleanup.

Scope to Linux only. The agent-canvas agent-server does not start
via the playbook's direct npm path on Windows (reproduced on the
halo runner: "The system cannot find the file specified"), and the
vendor's own Windows path uses Docker instead. Windows is therefore
removed from the supported, tested, required, and published platform
maps and from the README.
Use max_tokens 64 in the lemonade-chat CI test so it mirrors the
exact chat request shown to users in step 2 of the playbook.
Added new platforms for testing and requirements in the playbook.
Comment thread playbooks/supplemental/github-slack-development-digest/README.md Outdated
Comment thread playbooks/supplemental/github-slack-development-digest/README.md Outdated
Comment thread playbooks/supplemental/github-slack-development-digest/README.md Outdated
Co-authored-by: Sreeram <s.sreeram.amd@gmail.com>
@sreeram-11

sreeram-11 commented Jul 27, 2026

Copy link
Copy Markdown
Collaborator

@adamlam2-amd,

Can you please verify whether Agent Canvas is supported on Windows using Docker, and add the instructions to the playbook if it is supported?

Please also address any formatting issues in the playbook. One thing I noticed is that the README.md content in this playbook is not formatted consistently with the other playbooks. In the other playbooks, sentences are generally split onto separate lines for readability and cleaner diffs. Could you please update this playbook to follow the same formatting style?

@sreeram-11
sreeram-11 marked this pull request as ready for review July 27, 2026 06:36
@adamlam2-amd

Copy link
Copy Markdown
Collaborator

Is Windows intended to work for this playbook?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add CI tests for the GitHub-to-Slack Development Digest with Agent Canvas Playbook

3 participants