[CI] Parity: classify newly observed ROCm skips - #3523
Conversation
Validation runsDispatched
The CUDA baseline now downloads correctly on every arch — no more The mi300 run is flagged failed only by the intentional graceful-degradation step: for this specific SHA the ROCm mi300 test-report artifacts (default/distributed/inductor) are absent in S3/GHA, so a partial report was produced and the job self-flagged. That is a pre-existing data-availability path unrelated to this change (the CUDA fix itself worked identically there). |
4a4d7b1 to
0376854
Compare
|
Rebased onto latest |
Tested — now detects shard counts for all architecturesSecond commit extends dynamic shard detection to every ROCm arch (mi350/mi300/mi200/…) plus the CUDA trunk baseline. The standalone ROCm arch workflows run their shards inside a reusable workflow ( Validation runs on the PR branch code (
mi300 proves the detection catches an actual upstream reshard (6→8, 2→4) that the hardcoded config missed. Its run only fails on the distinct "which run hosts the reusable-workflow artifacts" issue — not a shard-count problem — which is being tracked separately. |
|
Added a third commit: auto-detect ROCm job-name prefixes ( |
|
Follow-up fix for |
|
Ported the two remaining deployment-fork fixes into this PR:
This PR now carries the full set: CUDA shard detection, all-arch ROCm shard detection (check-runs), job-name prefix auto-detection, busted-job-URL fix, and artifact-hosting-run resolution. |
Acting on the HUD AI-analysis, which flagged commit-to-commit skip-category churn caused by newly-added upstream tests that lacked a classification rule (so they landed in the wrong / blank bucket instead of their real category). Add file-based rules for three unambiguous suites that had no rule: - inductor/test_triton_kernels -> PT2.0 - Inductor - inductor/test_triton_heuristics-> PT2.0 - Inductor - dynamo/test_backends (TVM) -> PT2.0 - Dynamo Rules match both '.' and '/' test_file separators for robustness. Verified they classify correctly and leave unrelated files (e.g. test_torch -> Misc) untouched.
340abeb to
4159f02
Compare
Route the new hipSOLVER version guard and fused-attention tests into specific categories so the current dashboard report has no unclassified parity skips.
Summary
hipSOLVER DnXsytrs requires ROCm >= 7.14guard as hipSolver/MagmaDashboard analysis
Reviewed the AI analysis generated on 2026-08-04. It confirms that the
inductor.test_triton_heuristicsand TVM backend movements are classifier artifacts addressed by this PR. I also checked the underlying analyzed mi350 report rather than relying only on the AI recommendations: all 62 incoming unclassified skips are now covered—60 hipSOLVER version guards and twoinductor.test_fused_attentiontests.The analysis also reports large historical convolution, distributed, FSDP, and Misc category movements, but explicitly identifies them as unrelated collection/classifier churn and does not provide test-level evidence for a new category rule. This PR does not add speculative broad rules for those movements.
This PR was split from the earlier parity automation stack and contains only skip-reason classification changes.
Test plan
auto_classify_skip_reasons.py