The design it awesome, was this a template or did our Ninja write it by himself? I suck on front-end, so I don't know if was that hard.
Thanks. I made it myself with the help of the
Ant Design library. I also suck on front-end, but I Try.
I don't understand, though, how you guys scrape all this giant information. @TryNinja, did you wrote a script that goes on every single post and saves it on a database?
Old posts = courtesy of our favorite
bot human, LoyceV. I did write a script to scrape all of his posts.
New posts = scraped from the
recent posts page.
Merits = scraped from the
recent merits page.
Once I search for my account does it search among all these millions posts?
Yes. Everything is stored in a PostgreSQL database and indexed for searching in a Elastic Search database (life saver).
Is this ran on a VPS?
Yes.
Contabo's "VPS L SSD".
Is it expensive? I'm curious, because I get my account's result within a second.
The VPS costs ~€15 ($18) per month. It's not that powerful, but it does have 30 GB of RAM to help with the searching.
You should have seen how slow it was on the first version when the search was done through the PostgreSQL database. I'm talking about 3+ minutes, terrible results and some server crashing.
