docs: add tester quick-start smoke test guide#158
Open
adityamparikh wants to merge 2 commits into
Open
Conversation
A fast end-to-end smoke test for verifying a solr-mcp release JAR across Claude Code, Claude Desktop, and MCP Inspector. Covers client registration for all three transports, a list-collections sanity check, and a full build-and-query walkthrough against a self-contained 61-document demo collection with expected-output checkpoints and sample queries. Lives in dev-docs/ alongside the other contributor/release-verification guides. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Signed-off-by: adityamparikh <aditya.m.parikh@gmail.com>
The demo URL is a shared public Solr, so the 'shows' collection may already exist from a prior tester's run. create-collection is not idempotent and errors on an existing name. Add guidance to use a unique collection name (keeping the doc-count checkpoints valid) with a reuse/delete fallback. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Signed-off-by: adityamparikh <aditya.m.parikh@gmail.com>
Contributor
|
Thanks for this, I will be able tot eat this tomorrow |
Open
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Adds
dev-docs/SMOKE_TEST.md— a fast, copy-paste end-to-end smoke test for verifying asolr-mcprelease JAR works across the three common MCP clients (Claude Code, Claude Desktop, MCP Inspector).Why
There's currently no single tester-facing checklist for confirming a release candidate (or a fresh local build) actually serves tools over stdio. This gives release verifiers a self-contained script with expected outputs at each step, so a broken JAR is obvious without a separate "expected results" reference.
What's in it
claude mcp add,claude_desktop_config.json,npx @modelcontextprotocol/inspector) — samejava -jar+SOLR_URLrecipe for each.list-collectionssanity check as the first smoke signal.create-collection→add-fields→index-json-documents→get-collection-stats→search) against a self-contained 61-document demo collection, with expected-output checkpoints (61 of 61 indexed,numDocs: 61,20 hits).pintfields don't reject them), and seven samplesearchqueries plus their natural-language equivalents.Placed in
dev-docs/alongside the existing contributor/release-verification guides (e.g.ATR_TESTING_GUIDE.md).Docs-only change — no source or build files touched.
🤖 Generated with Claude Code