Try to look at this from a business perspective here. We are spending all our time cleaning large lists of indexed websites down to a few that pass incrementally stricter tests until we have something that looks decent enough to take the time to categorize & publish. I've got over 4,000 such results now, but I suspect that there are about 50,000 merchants out there taking bitcoin in total so far. (Of course that number grows daily too.)
We need to get Faster, not much slower at this if we're ever going to get anywhere near letting the world see all of the bitcoin-accepting merchants in one place.
There is already a link on each listing that lets the public report a scammer, and of course comments on the page too where I've already had two people point out scammers and I've removed them by hand.
Crowdsourcing scam-spotting is the only option I have open to me, at least while I'm not profitable yet. Unless some expert at analysis steps up to volunteer his or her time, such a position is simply going to have to wait until I far surpass being profitable and actually can afford a medium-sized business staff.
I'm all ears to your constructive criticsm, but what would really help right now is what I could do in the realm of crowdsourcing the scam-spotting. What could I provide on my site that would make hunting down these bastards fun or at least easy enough that everyone would be happy to do it?
Speed over Quality, does it ever work when the Price is free?