Skip to content

Create new sandbox pre-check action - #515

Merged
jeefy merged 4 commits into
cncf:mainfrom
jeefy:main
Aug 20, 2026
Merged

Create new sandbox pre-check action#515
jeefy merged 4 commits into
cncf:mainfrom
jeefy:main

Conversation

@jeefy

@jeefy jeefy commented Aug 19, 2026

Copy link
Copy Markdown
Member

Creates a new GitHub Action that invokes Copilot to sanity-check each new Sandbox application. It is only ever invoked once (during issue creation) and the bot creates a comment with its findings.

Example:

## 🤖 Automated Sandbox Application Pre-Review

> [!NOTE]
> This is an automated first-pass review generated by GitHub Copilot against the
> [Sandbox acceptance criteria](https://github.com/cncf/sandbox#before-you-apply-common-reasons-applications-are-closed)
> and the [CNCF TOC Principles](https://github.com/cncf/toc/blob/main/PRINCIPLES.md).
> It is advisory only — the CNCF TOC makes all final decisions.

### Assessment summary

· ✅ License (Apache-2.0 confirmed via API) 
· ✅ Age (created 2024-10-16, active) 
· ✅ MAINTAINERS.md (proper table, resolves) 
· ✅ Reusable project, not reference architecture 
· ✅ Subproject separation N/A 
· ✅ Docs (CONTRIBUTING/CoC/SECURITY/ROADMAP/ADOPTERS all verified) 
· ⚠️  Org diversity (all Obmondo) 
· ⚠️  Product/project separation 
· ✅ Aligns with cloud-native/TOC principles.

### ⚠️  Items for TOC verification (non-blocking)

- All 5 listed maintainers are Obmondo employees — no organization/employer diversity. Disclosed proactively, not a hard requirement, but TOC weighs it.
- Project is built and used operationally by Obmondo for its own managed-service customers; application asserts governance/product separation but TOC may want to probe further.
- Website URL links back to the GitHub repo rather than a distinct site (a separate homepage, kubeaid.io, appears in repo metadata).

(Also there was a workflow.yml file that was located incorrectly and hasn't been invoked in years so yeet)

jeefy added 4 commits August 19, 2026 14:13
Runs the GitHub Copilot CLI against newly opened [Sandbox] issues to
validate applications against the Sandbox acceptance criteria and the
CNCF TOC Principles. Clear violations (incompatible license, project
under 6 months old, reference architecture, invalid MAINTAINERS link,
or an empty application) receive the Postponed label plus an
explanatory comment; passing applications receive an advisory
assessment comment for TOC reviewers. Requires a COPILOT_GITHUB_TOKEN
fine-grained PAT secret with the Copilot Requests permission.

Signed-off-by: Jeffrey Sica <me@jeefy.dev>
Copilot CLI in Actions now supports the built-in GITHUB_TOKEN with the
copilot-requests: write permission, billing usage to the organization's
pooled Copilot credits instead of an individual seat. Replace the
COPILOT_GITHUB_TOKEN PAT secret accordingly and update the docs.

Also remove .github/workflows.yml: it has sat outside the workflows/
directory since 2022 and never executed. Its purpose (labeling new
applications with New) is already handled by the application issue
form, and if activated it would mislabel automation-created onboarding
issues.

Signed-off-by: Jeffrey Sica <me@jeefy.dev>
The project itself must be Apache 2.0; the CNCF allowlist applies to
dependencies, not the project license. Any other project license is a
violation unless a Governing Board license exception is referenced.

Signed-off-by: Jeffrey Sica <me@jeefy.dev>
Enable the url tool so the review can verify claims instead of only
reading the application text: repository license via the GitHub API and
raw LICENSE file, repository age via created_at, and the MAINTAINERS
file contents (existence and required affiliation columns). Fetched
content is treated as untrusted, fetches are limited to URLs listed in
the application, and a failed fetch is reported as a concern rather
than a violation.

Signed-off-by: Jeffrey Sica <me@jeefy.dev>

@angellk angellk left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🎉

@riaankleinhans

Copy link
Copy Markdown
Contributor

Great tool @jeefy

@jeefy
jeefy merged commit e534886 into cncf:main Aug 20, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants