What OP pointing out is that, even a player didn't violate any, the site will counter that the player violated one of the terms. I understand OP on that part as that was unprofessional and users don't have any choice to do. It eventually leads to OP that there should be an authority that will handle it.
However, since crypto gambling was mostly preferred by others because of anonymity, it's somehow irrelevant to hope for an authority that will handle the case in a decentralized world.
For now, there are still lots of regulated crypto gambling site that's not forcing their users to provide KYC. The majority is still anonymous. Even with that setup, there's still a question on how that main authority to be built. Let's say all crypto-gambling sites are now KYC mandated, in the event that users wants to report them for any fraudulent activities, does any government body can pressure those regulated gambling sites?