Extract compatability test into it's own repository

[caspervonb]

Really not necessary to keep this here, it's meant as a sanity check tool to quickly check the behaviour across the common runtimes.

Convenient to have but it can be moved into a separate repository.