But today I can't find the "search option" from this nijastic.space.
Ninjastic.Space is a work in progress.
Please problem Solution...
Topic: Ninjastic.space - BitcoinTalk Post/Address archive + API - page 6. (Read 15130 times)
I've been using Ninjastic.space for a long time to view profiles.
But today I can't find the "search option" from this nijastic.space.
Ninjastic.Space is a work in progress.
Please problem Solution...
But today I can't find the "search option" from this nijastic.space.
Ninjastic.Space is a work in progress.
Please problem Solution...
I tried other topics, but the situation is exactly the same there. 100 posts, and then there is repetition.
Fixed. Make sure you clear the cache with Ctrl + F5.Thanks!
I'm postponing the author-reference idea until I can think more about it. 
In the meanwhile, I've made a tool to scrape all old merits before 2022 (ty @LoyceV for his merit.all.txt) and to catch up if the bot or forum is ever down for a few hours; e.g this is now in the database:
The remaining still missing is related to posts that can not be found anymore (not in the database and can't be scraped because they don't exist anymore). Also, at least one merit tx has a duplicate (date, post_id, amount, sender_uid) from the times when you could double-merit by mistake. Since I treat the combination of those fields as the id of the "transaction", only one was inserted.
In the meanwhile, I've made a tool to scrape all old merits before 2022 (ty @LoyceV for his merit.all.txt) and to catch up if the bot or forum is ever down for a few hours; e.g this is now in the database:
Asking because I spotted some merit (the middle transaction, from ETFbitcoin) that didn't make it into your database:
The remaining still missing is related to posts that can not be found anymore (not in the database and can't be scraped because they don't exist anymore). Also, at least one merit tx has a duplicate (date, post_id, amount, sender_uid) from the times when you could double-merit by mistake. Since I treat the combination of those fields as the id of the "transaction", only one was inserted.
Since this change requires a lot of work and time (especially to update the database entries), I want to know if anyone has anything against the idea
Using ID instead of username is much better, so I have nothing against this idea, unless it messes up with older links.For example if I saved archived post I don't want to see this link being broken after you introduce this changes, so maybe you need to link them somehow.
If this is not the case, than you can go for it
It has helped some to prove that they really are who they claim to be.
In the end, this is the important thing. The community has to protect itself from malicious users. The good users on the other ways, need to manage their privacy footprint anyways.
I want to know if anyone has anything against the idea (cc @LoyceV)
No objections here, go for it! In fact, I thought you would use a separate table for userIDs already instead of storing them with each post. The only reason I'm not doing it is because I don't use a database. In hindsight, I should have learned to use databases when I started, but I never expected my little data storage project to get this big. There is nothing wrong in doing so, data are public and privacy is already lost. I am only considering this is going to further facilitate the collecting of data. A bit like the page that connects all the used addresses with their owner.
It's true. This information can leave each user a little more exposed.
But on the other hand, we have to look at the benefits that we've all had from having this data accessible. This has protected the community from some malicious users. It has helped some to prove that they really are who they claim to be.
Therefore, everyone should be aware that this information can be crossed. Mainly, in a community that is very used to looking at all the details and analyzing data.
There is nothing wrong in doing so, data are public and privacy is already lost. I am only considering this is going to further facilitate the collecting of data. A bit like the page that connects all the used addresses with their owner.
I'm thinking about doing some changes to my database's structure to make it easier to develop some new features.
Instead of archiving each post with the author and author_uid field, insert only the author_uid which will reference the user/author from another table.
Instead of archiving each post with the author and author_uid field, insert only the author_uid which will reference the user/author from another table.
I think this will make more sense. Regardless of the username, your ID will always be the same. Therefore, if the reference base is always the user ID, it is much easier to work with all the data.
The only thing to think about is: usually user change names for a reason.
Maybe The BeardedBAby likes to be linked to his old account, and having all the history of his posts easily searchable. But those users who changed their nickname for privacy/OpseC reasons might have a saying against it.
Maybe The BeardedBAby likes to be linked to his old account, and having all the history of his posts easily searchable. But those users who changed their nickname for privacy/OpseC reasons might have a saying against it.
Any user who changes his name must be aware that his ID does not change. So, even though it might not be that easy to detect this information, it exists and is available to everyone.
Therefore, everyone should be aware that this information can be crossed. Mainly, in a community that is very used to looking at all the details and analyzing data.
<...>
The only thing to think about is: usually user change names for a reason.
Maybe The BeardedBAby likes to be linked to his old account, and having all the history of his posts easily searchable. But those users who changed their nickname for privacy/OpseC reasons might have a saying against it.
I'm thinking about doing some changes to my database's structure to make it easier to develop some new features.
Instead of archiving each post with the author and author_uid field, insert only the author_uid which will reference the user/author from another table.
table posts
table authors
What this changes: If someone changes their username, that will be changed for all of his posts (old and new).
Example: TheBeardedBaby === iasenko
TheBeardedBaby https://loyce.club/archive/posts/6172/61728758.html
iasenko https://loyce.club/archive/oldposts/241/241988xx.html#msg24198805
His first post (and all others made when he had the username iasenko), would now show up as TheBeardedBaby instead.
Since this change requires a lot of work and time (especially to update the database entries), I want to know if anyone has anything against the idea (cc @LoyceV)
Instead of archiving each post with the author and author_uid field, insert only the author_uid which will reference the user/author from another table.
table posts
Quote
post_id topic_id author_uid
1234 4321 557798
1234 4321 557798
table authors
Quote
author author_uid
TryNinja 557798
TryNinja 557798
What this changes: If someone changes their username, that will be changed for all of his posts (old and new).
Example: TheBeardedBaby === iasenko
TheBeardedBaby https://loyce.club/archive/posts/6172/61728758.html
iasenko https://loyce.club/archive/oldposts/241/241988xx.html#msg24198805
His first post (and all others made when he had the username iasenko), would now show up as TheBeardedBaby instead.
Since this change requires a lot of work and time (especially to update the database entries), I want to know if anyone has anything against the idea (cc @LoyceV)
After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck. 
Did you ever get around to doing this? (Sorry to bug you so soon after your adventure holiday. Hope you had a blast, by the way.)Are outage-related "holes" in your data something you have any defense for? Do you repair them manually after each outage, or are they automatically repaired (given enough time) with periodic re-scraping?
Nope, which I agree isn't ideal. I also plan to work on it this week. 
After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.
Did you ever get around to doing this? (Sorry to bug you so soon after your adventure holiday. Hope you had a blast, by the way.)Are outage-related "holes" in your data something you have any defense for? Do you repair them manually after each outage, or are they automatically repaired (given enough time) with periodic re-scraping?
Asking because I spotted some merit (the middle transaction, from ETFbitcoin) that didn't make it into your database:
After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.
Update: theymos has whitelisted my bot, so probably no more downtime related to Cloudflare. 
Thanks @LoyceV for asking for it.
maybe look at bypassing CF. Wish me luck.
Good luck The only thing I could think of, was using an actual Firefox browser to open and save a page, but I couldn't get it working.
After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.
These are things that happen... you need to be patient.
You will be able to recover the data that was not collected, as they are still here.
Sorry, some caching issues on my end. Try now.
Yeah I can see now Nigerian board, thanks once again! And no worries, I wasn't in a big hurry as I can't start with the local boards overview before year is over anyway. After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.
It would be great if you could somehow add posts written in their original thread. Anyway, for some reason I just can't find it so I don't know if its just me being incapable or if it will take some time to actually appear?
I don't think the problem is on your side. I can't find Nigerian in the boards list either. I even did a hard refresh with CRTL+F5, but it wasn't helpful.
After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck.
Ninjastic and the Telegram bot seems to be back on track and working as intended, however it catches my attention that Ninjastic webpage did not update properly and do not seem to register the posts I made during the down time, it only started counting after it came online again, I believe it happens the same with a couple of merits I received today.
it really worries me to make a post if it doesn't count there because almost the average signature campaign organizer always uses ninjastic as a reference, will the problem be solved
Oh, no need to worry your pretty little head about it. After all, it's not like you're participating in any signature campaigns or anything.
Jump to: