If you want to start some type of anti crypto scam organization, you'd need to find a private investigator or social engineer who has skills like Kevin Mitnick. Someone who would be willing to track scammers down for a fee. Or develop a business model to use freedom of information requests or issue subpoenas to collect data from servers to backtrace scammers.
In practice, it could be run like an insurance service. Those covered under the insurance might pool their money to hire lawyers or whatever resources were necessary to track down scammers in an attempt to get their money back. There are many different ways it might be done.
I'm not an expert on the topic. I have no intent to try to piece together something that works. I only know that it is possible.
What makes things difficult is, the reactive portion of it only works if scammed/stolen funds are able to be recovered. If people can't retrieve what they lost it makes the process somewhat pointless which could mean it may only work if it functions within some form of rapid deployment, fast reaction, format.