Skip to content

Add Mamba-AI-Detector to leaderboard#165

Open
fuzhiheng wants to merge 6 commits into
liamdugan:mainfrom
fuzhiheng:mamba-detector-submit
Open

Add Mamba-AI-Detector to leaderboard#165
fuzhiheng wants to merge 6 commits into
liamdugan:mainfrom
fuzhiheng:mamba-detector-submit

Conversation

@fuzhiheng

Copy link
Copy Markdown

Submitting predictions for Mamba-AI-Detector AI text detector.

  • Total predictions: 672000
  • Model: Mamba-based classifier (2.1B parameters)

@github-actions

github-actions Bot commented Jun 8, 2026

Copy link
Copy Markdown

It looks like this eval run failed. Please check the workflow logs to see what went wrong, then push a new commit to your PR to rerun the eval.

@fuzhiheng

Copy link
Copy Markdown
Author

@liamdugan Could you please approve the workflow to run the evaluation for Mamba-AI-Detector? Thank you!

@github-actions

Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Mamba-AI-Detector

Release date: 2026-06-08

I've committed detailed results of this detector's performance on the test set to this PR.

Warning

Failed to find threshold values that achieve False Positive Rate(s): (['5%', '1%']) on all domains. This submission will not appear in the main leaderboard for those FPR values; it will only be visible within the splits in which the target FPR was achieved.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@github-actions

Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Mamba-AI-Detector

Release date: 2026-06-08

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 58.36 and a TPR of 21.97% at FPR=5% and 8.91% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 68.42 and a TPR of 28.01% at FPR=5% and 11.83% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant