Pages:
Author

Topic: [overview] LoyceV's useful data on Bitcointalk (Read 8078 times)

legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
December 20, 2024, 01:31:10 AM
I ordered another VPS today. It's still going to take a few days go get things settled, but after that I should be able to automate most scripts again. I ran them locally last in the past days, and I don't want to keep doing that.
So... I have this new server, with 8 cores, but I suspect I only got quarter-cores, and my Merit data analysis from last week is still running today! The new one started already while the first one isn't done yet. I kinda miss my dedicated Xeon.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
As I'm not used to directly managing the server, I've always opted for managed options, to provide support for what I can't resolve. Even though sometimes they don't seem to have much desire to help... but that's it.
There's even management software, but usually I just install Apache2 and make some manual settings for subdomains.



I ordered another VPS today. It's still going to take a few days go get things settled, but after that I should be able to automate most scripts again. I ran them locally last in the past days, and I don't want to keep doing that.
legendary
Activity: 1890
Merit: 5197
**In BTC since 2013**
Are you looking for a managed VPS server or not?
Since I left shared hosting (years ago), I've always used unmanaged servers.

Quote
Even so, one day I want to buy a month or two, from an unmanaged one, to test.
You can even get a VPS for $0.001333 per hour, after depositing one dollar. I'm not using nor recommending that host for anything serious, but it's the cheapest I know to get a server.

To test it seems like a good solution.

As I'm not used to directly managing the server, I've always opted for managed options, to provide support for what I can't resolve. Even though sometimes they don't seem to have much desire to help... but that's it.

I had to explore and try to understand how to make everything work correctly, maintaining good levels of security and protection.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
I'll respond then with a way to significantly speed up this process.
An API key would work, but from what I've seen, they're quite expensive. I don't really want to setup many different servers to hammer them (at 100 kB/s each). But it's not really a problem, I'm waiting for a reply from a potential host, and once I have one, I also need to upload 800+ GB from my local backups.
newbie
Activity: 0
Merit: 0
I can't reply to your PM right now, I have to wait an hour.

I'll respond then with a way to significantly speed up this process.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Are you looking for a managed VPS server or not?
Since I left shared hosting (years ago), I've always used unmanaged servers.

Quote
Even so, one day I want to buy a month or two, from an unmanaged one, to test.
You can even get a VPS for $0.001333 per hour, after depositing one dollar. I'm not using nor recommending that host for anything serious, but it's the cheapest I know to get a server.
legendary
Activity: 1890
Merit: 5197
**In BTC since 2013**
Have you already found another server?
Nope, I'm still looking. I found a good deal, but it's IPv6 only, and I don't think that makes adding a domain name very easy.

Are you looking for a managed VPS server or not?

I've never used unmanaged, but it has better prices. But, it is more complex and you need to have deeper knowledge of servers.
Even so, one day I want to buy a month or two, from an unmanaged one, to test.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Have you already found another server?
Nope, I'm still looking. I found a good deal, but it's IPv6 only, and I don't think that makes adding a domain name very easy.

I forgot to add: the good news is that my forum archive, post scraping and notifications are still running (on AWS).
legendary
Activity: 1890
Merit: 5197
**In BTC since 2013**
Update:
Last week, my (donated and dedicated) server disappeared, and I haven't received any response from my sponsor. So I assume it's gone, which messes up a lot of my large data projects. And because it's so large, I don't even have complete backups of everything (but I can download most of it again). I'm currently working on at least keeping my weekly Trust and Merit data processing going, so I don't end up with a missing week.

What a boring situation, I hope you can recover everything.

Have you already found another server?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
If you are going to dload all again, this may be a sign from the crypto gods to use a database.  Smiley
A database would be very good for some of my projects, but far out of my league and I'm far too deep in to make easy changes now.
But the missing data is related to data dumps (for which I "only" have 800 GB in my backup, currently downloading the rest at 100 kB/s), Bitcoin addresses (I only have bits and pieces of the page design, and currently can't download an update) and this huge file (which I can recreate after I downloaded everything else).

I already have a new VPS for the second project (3 cores, 100 GB SSD, 16 TB bandwidth), and I'm currently looking for another VPS for the rest (2 TB HDD, 16 TB bandwidth).
Vod
legendary
Activity: 3668
Merit: 3010
Licking my boob since 1970
Update:
Last week, my (donated and dedicated) server disappeared, and I haven't received any response from my sponsor. So I assume it's gone, which messes up a lot of my large data projects. And because it's so large, I don't even have complete backups of everything (but I can download most of it again).

Sorry for your loss.  Sad

If you are going to dload all again, this may be a sign from the crypto gods to use a database.  Smiley
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Update:
Last week, my (donated and dedicated) server disappeared, and I haven't received any response from my sponsor. So I assume it's gone, which messes up a lot of my large data projects. And because it's so large, I don't even have complete backups of everything (but I can download most of it again). I'm currently working on at least keeping my weekly Trust and Merit data processing going, so I don't end up with a missing week.
member
Activity: 119
Merit: 38
Yo! Member
How to get someone's signature in raw HTML
Example: https://loyce.club/other/usersignature/35.html
Not impressive as the other tools you have .

I can easily copy a signature code which is in bbcode , paste it in txt file, replace the "[" and "]" with "<" and ">" respectively. Done!  Grin
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
This belongs here:
How to get someone's signature in raw HTML
Example: https://loyce.club/other/usersignature/35.html
Details:
Post this link on any public board on Bitcointalk: https://loyce.club/other/usersignature/149737.html

Replace the userID by the user who's signature you want to view:
Code:
https://loyce.club/other/usersignature/.html
(no need to use code tags)

Wait a few seconds, then click the link. It should show the user's signature in it's full size. Adjust your browser window if needed.
I've added this script to my regular scraping, so it should keep working from now on.

Limitations
  • Only one request per post
  • Only new posts are scraped (edits are ignored)
  • Use the exact format as above
  • Older signatures are instantly overwritten

Feel free to delete the link again.
Find all scraped signatures here: loyce.club/other/usersignature/
copper member
Activity: 2198
Merit: 1837
🌀 Cosmic Casino
I think your browser is blocking scripts. The content of that page is created inside the browser from static (text) files on my server.
Thanks for pointing me towards the right direction.

I realized that the culprit causing all this was the No Script Extension. I am not sure how I missed it 🤦‍♂️
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Anything wrong with the website, or it's just my device?
I think your browser is blocking scripts. The content of that page is created inside the browser from static (text) files on my server.

Quote
Also at the bottom left, "Topic on Bitcointalk" has no link to Loyce.club topic on bitcointalk.
I never created that topic Wink
copper member
Activity: 2198
Merit: 1837
🌀 Cosmic Casino
Not sure where to post this since I failed to come across an official thread of Loyce.club

Please bear with me



When I try to access the loyce.club link of different user profiles using the shortcut created by the bpip extension in the forum, this is all is see, for example.



Anything wrong with the website, or it's just my device?

I am using Firefox.

Also at the bottom left, "Topic on Bitcointalk" has no link to Loyce.club topic on bitcointalk.

legendary
Activity: 1890
Merit: 5197
**In BTC since 2013**
Nope. I never kept track of the board. There are currently 114,009 Merited topics (some of them no doubt deleted), so it would be possible to scrape this data in a few days. However, Ninjastic Space has board data already, so maybe you can ask TryNinja for a data dump.

Thanks for the feedback. I will check with TryNinja this possibility. Wink
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Do you happen to get a list of merits sent, but with the nomination on the board it was given?  Roll Eyes
Nope. I never kept track of the board. There are currently 114,009 Merited topics (some of them no doubt deleted), so it would be possible to scrape this data in a few days. However, Ninjastic Space has board data already, so maybe you can ask TryNinja for a data dump.
legendary
Activity: 1890
Merit: 5197
**In BTC since 2013**
@LoyceV
Hello again.  Wink

Do you happen to get a list of merits sent, but with the nomination on the board it was given?  Roll Eyes
Pages:
Jump to: