Pages:
Author

Topic: Ninjastic.space - BitcoinTalk Post/Address archive + API - page 9. (Read 16671 times)

legendary
Activity: 1862
Merit: 5154
**In BTC since 2013**
There is nothing wrong in doing so, data are public and privacy is already lost. I am only considering this is going to further facilitate the collecting of data. A bit like the page that connects all the used addresses with their owner.

It's true. This information can leave each user a little more exposed.
But on the other hand, we have to look at the benefits that we've all had from having this data accessible. This has protected the community from some malicious users. It has helped some to prove that they really are who they claim to be.
legendary
Activity: 2380
Merit: 17063
Fully fledged Merit Cycler - Golden Feather 22-23

Therefore, everyone should be aware that this information can be crossed. Mainly, in a community that is very used to looking at all the details and analyzing data.

There is nothing wrong in doing so, data are public and privacy is already lost. I am only considering this is going to further facilitate the collecting of data. A bit like the page that connects all the used addresses with their owner.
legendary
Activity: 1862
Merit: 5154
**In BTC since 2013**
I'm thinking about doing some changes to my database's structure to make it easier to develop some new features.

Instead of archiving each post with the author and author_uid field, insert only the author_uid which will reference the user/author from another table.

I think this will make more sense. Regardless of the username, your ID will always be the same. Therefore, if the reference base is always the user ID, it is much easier to work with all the data.


The only thing to think about is: usually user change names for a reason.
Maybe The BeardedBAby likes to be linked to his old account, and having all the history of his posts easily searchable. But those users who changed their nickname for privacy/OpseC reasons might have a saying against it.

Any user who changes his name must be aware that his ID does not change. So, even though it might not be that easy to detect this information, it exists and is available to everyone.

Therefore, everyone should be aware that this information can be crossed. Mainly, in a community that is very used to looking at all the details and analyzing data.
legendary
Activity: 2380
Merit: 17063
Fully fledged Merit Cycler - Golden Feather 22-23
<...>


The only thing to think about is: usually user change names for a reason.
Maybe The BeardedBAby likes to be linked to his old account, and having all the history of his posts easily searchable. But those users who changed their nickname for privacy/OpseC reasons might have a saying against it.

legendary
Activity: 2758
Merit: 6830
I'm thinking about doing some changes to my database's structure to make it easier to develop some new features.

Instead of archiving each post with the author and author_uid field, insert only the author_uid which will reference the user/author from another table.

table posts
Quote
post_id    topic_id   author_uid
1234       4321       557798

table authors
Quote
author      author_uid
TryNinja    557798

What this changes: If someone changes their username, that will be changed for all of his posts (old and new).

Example: TheBeardedBaby === iasenko

TheBeardedBaby https://loyce.club/archive/posts/6172/61728758.html
iasenko https://loyce.club/archive/oldposts/241/241988xx.html#msg24198805

His first post (and all others made when he had the username iasenko), would now show up as TheBeardedBaby instead.


Since this change requires a lot of work and time (especially to update the database entries), I want to know if anyone has anything against the idea (cc @LoyceV)
legendary
Activity: 2758
Merit: 6830
After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck. Sad
Did you ever get around to doing this? (Sorry to bug you so soon after your adventure holiday. Hope you had a blast, by the way.)
Not yet, but I see how this is important, so I plan to prioritize it this week. Thanks for the reminder.

Are outage-related "holes" in your data something you have any defense for? Do you repair them manually after each outage, or are they automatically repaired (given enough time) with periodic re-scraping?
Nope, which I agree isn't ideal. I also plan to work on it this week. Tongue
hero member
Activity: 510
Merit: 4005
After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck. Sad
Did you ever get around to doing this? (Sorry to bug you so soon after your adventure holiday. Hope you had a blast, by the way.)

Are outage-related "holes" in your data something you have any defense for? Do you repair them manually after each outage, or are they automatically repaired (given enough time) with periodic re-scraping?

Asking because I spotted some merit (the middle transaction, from ETFbitcoin) that didn't make it into your database:



legendary
Activity: 2758
Merit: 6830
After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck. Sad
Update: theymos has whitelisted my bot, so probably no more downtime related to Cloudflare. Grin

Thanks @LoyceV for asking for it.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
maybe look at bypassing CF. Wish me luck. Sad
Good luck Cheesy
The only thing I could think of, was using an actual Firefox browser to open and save a page, but I couldn't get it working.
legendary
Activity: 1862
Merit: 5154
**In BTC since 2013**
After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck. Sad

These are things that happen... you need to be patient.
You will be able to recover the data that was not collected, as they are still here.  Wink
legendary
Activity: 1722
Merit: 5937
Sorry, some caching issues on my end. Try now.
Yeah I can see now Nigerian board, thanks once again! And no worries, I wasn't in a big hurry as I can't start with the local boards overview before year is over anyway.


After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck. Sad
It would be great if you could somehow add posts written in their original thread.
legendary
Activity: 2758
Merit: 6830
Anyway, for some reason I just can't find it so I don't know if its just me being incapable or if it will take some time to actually appear?
I don't think the problem is on your side.
I can't find Nigerian in the boards list either. I even did a hard refresh with CRTL+F5, but it wasn't helpful.
Sorry, some caching issues on my end. Try now.



After NYE, I'll see if I can scrape what's missing (posts/merits) and maybe look at bypassing CF. Wish me luck. Sad
legendary
Activity: 1162
Merit: 2025
Leading Crypto Sports Betting & Casino Platform
Ninjastic and the Telegram bot seems to be back on track and working as intended, however it catches my attention that Ninjastic webpage did not update properly and do not seem to register the posts I made during the down time, it only started counting after it came online again, I believe it happens the same with a couple of merits I received today.
legendary
Activity: 1820
Merit: 2700
Crypto Swap Exchange
it really worries me to make a post if it doesn't count there because almost the average signature campaign organizer always uses ninjastic as a reference, will the problem be solved

Oh, no need to worry your pretty little head about it. After all, it's not like you're participating in any signature campaigns or anything.  Cheesy
sr. member
Activity: 1988
Merit: 268
20BET - Premium Casino & Sportsbook
doesn't seem to count properly
See Forum's Cloudflare turned to always on? (S.O.S bots). For the last 3 hours and 17 minutes, Cloudflare is blocking my scraping Sad
it really worries me to make a post if it doesn't count there because almost the average signature campaign organizer always uses ninjastic as a reference, will the problem be solved
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
doesn't seem to count properly
See Forum's Cloudflare turned to always on? (S.O.S bots). For the last 3 hours and 17 minutes, Cloudflare is blocking my scraping Sad
sr. member
Activity: 1988
Merit: 268
20BET - Premium Casino & Sportsbook
website error doesn't seem to count properly even stopped counting post count, has anyone seen it
legendary
Activity: 2380
Merit: 5213
Anyway, for some reason I just can't find it so I don't know if its just me being incapable or if it will take some time to actually appear?
I don't think the problem is on your side.
I can't find Nigerian in the boards list either. I even did a hard refresh with CRTL+F5, but it wasn't helpful.
legendary
Activity: 1722
Merit: 5937
Thank you for the warning. It has been added!

That was quick, cheers!

edit: Hm, boards there are sorted by the date of creation right, so Nigerian should be at the bottom? Anyway, for some reason I just can't find it so I don't know if its just me being incapable or if it will take some time to actually appear?

legendary
Activity: 2758
Merit: 6830
I don't know if you noticed, but new local board (Nigerian) has been created so when you plan to add it? I have to start working on a new monthly overview and I can't do it without you updating ninjastic.space first. Cheers! Grin
Thank you for the warning. It has been added!
Pages:
Jump to: