Topic: [Active] Finding spam and scams by keyword (Read 3726 times)

Would you mind adding keywords of the scam group to detect them if they come back, please.

Keywords: Beta tester, Nitrogensports

theymos, please automatic nuke them: a group of scammers.

I've whitelisted you. Your keywords should show up in the next update.

Excuse me for the bump, but would you consider adding this keyword?



Note,
1. I found someone create 15 account to spam website "lowest.ltd" today, https://ninjastic.space/search?title=lowest.ltd
2. "waterfall" or "$water" used to shill certain project/using many new accounts.

Several users are spamming ShibaMemu. I found 24 posts containing ShibaMemu spam. Some posts have already been removed using reports to the moderators. The user wrangler26 is spamming the most.


P.S.. Sorry if I wrote something wrong.

3 month bump

It turns out a search string starting with a dash (-) doesn't work. I only noticed it after 11,851 errors in my logs. It's fixed now. I'll report this to test it > it works now

@NotATether: can you merge your 2 posts in this topic into one?

Recently, I've reported more than 30 posts including links below.
Their posts get deleted. They make new accounts and spam again and again.  

Hope I did it right.



I noticed that the news-related tags get used far more often that the others... my suggestion would be to take off coindesk and cointelegraph, but leave on the ones that come across as desperate spammers, like coinidol. There's probably a lot of people posting coindesk links out of genuine interest and aren't advertising for them on purpose.

I want to test this tool against a known spammer.



I think you should, in order to lower the signal to noise ratio for the spam list. It makes it harder to search for posts with the other keywords.

Let's see if we can catch some word spinners with this tool

Changelog:
10/3/2020 - https_://github.com/EthereumPill/PillForETH/
10/8/2020 - https_://github.com/EthereumPillProject/EthereumPill/
10/12/2020 - https_://github.com/ProjectEthereumPill/EthereumPill/
10/19/2020 - https_://github.com/ProjectEthereum/EthereumPill/
10/22/2020 - https_://github.com/ProjectPill/

I'm just trying to get this clear in my head, so if you will permit me to try out a couple of test samples?


Thanks.  (If I'm reading this right, I just edit this one post - yes?)

---

---

---

---

Timeline:

Other:

20/08/20 Initial list Humbertin + hellow (the latter used by the former)
06/10/20 Added grunch while investigating spike420211/TrevorS/bitcoinst
21/10/2020 Changed category to "email" for a few entries.

Edited

github.com/ethpillan => was malware (I said "was" because the repo is currently deleted, but maybe it can find some deleted posts with that bad link)

I'm testing with ">" in front of "good project", so it only matches something like the beginning of a line.

Feel free to explain the reason why you add a certain phrase in your post
Just don't put it inside the code-tag.

Explanation
provides a free bonus of
For advertising, see this user's post history.
For 1HZwkjkeaoZfTSaJxDw6aKkxp45agDiEzN, see this topic.
Binarium, see this post.

Removed from my list:

The data
See loyce.club/badposts
All categories / spam / scam / other / advertising / email
Most recent posts are shown first.

Whitelisted users

Post keywords
Whitelisted users can post keywords. Please don't use very common words (such as "scam") that trigger too many false positives. And please keep all keywords in one code tag in one post: edit it to add/remove keywords.
Other users can also post, with 2 possible outcomes:

• I whitelist you and process your keywords
• I remove your post

Please don't quote code-tags.

Tips
Leave out "https" from scam links.

Format
Within code-tags, post either "scam:thiswebsiteisascam" or "spam:Ikeeppostingthesamecrapeverywhere". One phrase per line. See this example.
Remove the line to exclude the keyword in the next update.
Only use a space after "scam:" if you want to include a space in your search.
Keyword "other:" is meant for text that isn't necessarily spam or a scam, but needs highlighting nonetheless.
Keyword "advertising" is meant for sites that are often used to copy an article and create a backlink.
Keyword categories:

• spam:
• scam:
• other:
• advertising:
• email:

Features
I search the last ~200,000 posts for new keywords. This covers approximately 1 month.
I update all keywords every 20 minutes.
I show all matches for all usernames and ranks. No exceptions. Not all of them are bad.
Whitelisted users are shown in green.

Limitations
There's a maximum of 60 keywords per post (if you add more those will be ignored). I can increase this if needed.
There's a maximum of 4000 matches per category. If there are more, the oldest are removed.
The minimum keyword length is 4 (for other) or 5 (for spam/scam) characters.
I also search quotes.

Report posts!
This list is only useful if someone actually reports the bad posts

Post removal
I want to keep this topic compact (so I can quickly scrape it many times). That means I'll delete almost all posts that don't contain a list from a Whitelisted user. I would say "I hope I'm not offending anyone", but really, I'm okay with that

---

---

Q&A
See around here

For now: nope
I don't keep track of titles with this data.

Thanks, I've added it.

My plan was to only look back about 100k posts (currently just over 2 weeks), so it won't really help you here. But it would (near) instantly add new posts, and that's what I'm aiming for here.
Searching all my data without database takes too long to do on a regular basis. You should try TryNinja's database though!

Without "www", the url turns into 9gag.com. I think theymos should give "www.bitcointalk.org" the same treatment.
I've added category "other" for things like "www.bitcointalk.org".

I search for the exact phrase (case insensitive), so it matches anything. You can add a space in front of it (as you did already), but that might miss some matches too. It's more or less as intended, if I change this, it might overlook other matches.

It can be explained in the post in this topic. I don't want to add repetitive explanations to my badposts page.

It would be great if you can add this to your earlier post

---

---

It's a tad higher now. Don't worry about overlooking it: I only added it today. I don't think it's much of a problem though: only the first code tag in each post is processed, and I now remove duplicate keywords to reduce search time.

Each 15 minute update takes about 1 second to process.
Each new keyword takes a few minutes to process, reading all 200,000 posts is slow. Processing several new keywords at once is more efficient, so feel free to add them

I'm trying to improve searching for whole words only. I now remove the trailing slash ("/") from the keyword before searching. I don't think it matters for your keywords, but it can improve other strings.

Try without the spaces now

You were trying to adjust for my old search, right while I was adjusting it to improve matching complete words only.

There's many of those altcoin pills nowadays.
You should probably omit the "https://"-part, a scammer can do the same.

See:
This search takes about 2 minutes for new keywords. It's mainly meant to catch new posts, older posts can be found through other means.

The post was edited, see the unedited post.
Unfortunately, I can't know which posts have been edited, so this is a loophole to escape my badposts list.

I did already, see loyce.club/badposts/advertising.html.

Thanks, done:
The following overlapping keywords have been removed:
github.com/ProjectEthereumPill/EthereumPill
github.com/pillforethereum/ETHpillAN (because of github.com/pillforeth)

I also noticed the "Banned" notification is only useful for new keywords, because my banned list is only updated once a day. I ran a one-time update from scratch, searching the last ~800,000 posts, this updates the banned-status on older posts.

HYIP and MLM are too short, the minimum word length is 5 for scams.

I do have logs, but it's too many lines to search now. I think someone must have entered a keyword with many hits, then removed the keyword again. My "badposts" only shows the latest 4000 posts each time I update it, but when a keyword is removed, all those entries are removed too.
I've manually reset it to re-check all keywords in the last ~200k posts. This restored a longer list again.

---

---

I made a new toy:
[Newbie scrutiny instead of jail] Every new user's first post: loyce.club/patrol: