Pages:
Author

Topic: Bitcoin block data (728 GB): inputs, outputs and transactions - page 5. (Read 3356 times)

legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Really? It's weird since rTorrent (the backend) support DHT.
These are the only options it gives:
Image loading...

Quote
Can you use different tool (which support DHT) on your Seedbox?
I can start the following:
Code:
Deluge
Rclone
qBittorrent
I haven't tried those yet.

Quote
2. You might want to check this thread about torrent piece size, https://torrentinvites.org/f29/piece-size-guide-167985/.
I read about that already, it's a compromise. I could select a smaller piece size, but that means it has many pieces to deal with. I'll try 4MB next time.

Quote
3. Take note not all tracker accept any kind of torrent.
That's the tricky part: I couldn't find much about it, only a list of recommended trackers. That's what makes me think the slow download start might be related to the trackers.
legendary
Activity: 2870
Merit: 7490
Crypto Swap Exchange
how do you create the torrent?
I have a Seedbox at PulsedMedia.com, which by default uses ruTorrent. I clicked "Create Torrent", selected the data, and added some trackers that I found in other torrents. Then, I set the Piece size as large as possible (16 MB, because it's 50+ GB of data). After a couple of minutes, it was ready and I could save the .torrent file.

1. ruTorrent (which use rTorrent as backend) is reliable (according to discussion on different forum), although it's development has slowed down in past 3 years. However it should able to create torrent without problem.
2. You might want to check this thread about torrent piece size, https://torrentinvites.org/f29/piece-size-guide-167985/.
3. Take note not all tracker accept any kind of torrent.

Quote
In past i used mktorrent (to create torrent) and qbittorrent (on both server and client to upload/download) to transfer data due to unstable connection on my end. I don't use any tracker, but i disable private flag so i could use DHT. However, my data size was smaller.
When creating the torrent, ruTorrent doesn't have the option to use DHT.

Really? It's weird since rTorrent (the backend) support DHT. Can you use different tool (which support DHT) on your Seedbox?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
how do you create the torrent?
I have a Seedbox at PulsedMedia.com, which by default uses ruTorrent. I clicked "Create Torrent", selected the data, and added some trackers that I found in other torrents. Then, I set the Piece size as large as possible (16 MB, because it's 50+ GB of data). After a couple of minutes, it was ready and I could save the .torrent file.

Quote
In past i used mktorrent (to create torrent) and qbittorrent (on both server and client to upload/download) to transfer data due to unstable connection on my end. I don't use any tracker, but i disable private flag so i could use DHT. However, my data size was smaller.
When creating the torrent, ruTorrent doesn't have the option to use DHT.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
I have just started download, but I have only one seed, for Transactions.
I will leave it and see if it finish.
Thanks for testing. I see it's indeed uploading now. My own download (from the new server) hasn't started yet.
My guess is there might be a problem with the Trackers I choose.

Update:
My own download started and completed overnight. Judging by the amount of sent data, your download stopped after about a third.
I'd appreciate some pointers from someone with experience creating Torrents.
legendary
Activity: 2870
Merit: 7490
Crypto Swap Exchange
For $10, that VPS is very cheap. Do you mind share the name of the VPS provider?
RamNode.com. This is the "MASSIVE KVM", which means it's HDD and not meant for heavy computing tasks.

Looks like it could meet my needs. I have bit concern about payment processor they use though (Bitpay and Payssion), let's hope one of them won't ask for KYC verification or strict blacklist.
legendary
Activity: 952
Merit: 1386
Has anyone tried these torrents? No data was uploaded, so if you tried and it's not working, please let me know.

I got a new server today: 1 TB, so enough to add the "inputs" data too. I'm currently trying to Torrent the files from the old to the new server, but so far it's not doing anything. Hence my question if anyone else tried Smiley

I have just started download, but I have only one seed, for Transactions.
I will leave it and see if it finish.

legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
Has anyone tried these torrents? No data was uploaded, so if you tried and it's not working, please let me know.

I got a new server today: 1 TB, so enough to add the "inputs" data too. I'm currently trying to Torrent the files from the old to the new server, but so far it's not doing anything. Hence my question if anyone else tried Smiley
legendary
Activity: 2870
Merit: 7490
Crypto Swap Exchange
The best (temporary) option for hosting I found so far is this:
Quote
$10/mo ($0.015/hr)
2 CPU, 2GB RAM, 650GB HDD
This offers 7.5TB/month bandwidth, and charges $4/TB for additional bandwidth.
Would anyone be interested in this data at this price?

As someone who run full node and aware of GitHub existance (which host script to extract Bitcoin Core data), i'm not interested.

P.S. For $10, that VPS is very cheap. Do you mind share the name of the VPS provider?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
New hosting
On my quest for new hosting, I ended up on a seedbox. It's not big enough for all data, but to start, I've uploaded outputs and transactions. See: blockdata. Unfortunately, there's no nicer URL for now.

Torrents!
outputs.torrent
transactions.torrent
I think the problem is with torrent trackers, but I'm not sure how to fix it. It works now Smiley
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
I have bit concern about payment processor they use though (Bitpay and Payssion), let's hope one of them won't ask for KYC verification or strict blacklist.
Last time I funded my account was last May 2021, using a low-fee Forkcoin through Bitpay. I funded it with $10 at a time, just in case they'd hit me with KYC. They didn't. But as far as I know that's no longer possible.
I've never used Payssion.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
For $10, that VPS is very cheap. Do you mind share the name of the VPS provider?
RamNode.com. This is the "MASSIVE KVM", which means it's HDD and not meant for heavy computing tasks.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
The best (temporary) option for hosting I found so far is this:
Quote
$10/mo ($0.015/hr)
2 CPU, 2GB RAM, 650GB HDD
This offers 7.5TB/month bandwidth, and charges $4/TB for additional bandwidth.
Would anyone be interested in this data at this price?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
please inform me after solving hosting
You can click "notify" at the bottom of any topic Smiley
newbie
Activity: 7
Merit: 0
i need blockdata.loyce.club/transactions/ (44 GB) link
Sorry, as I wrote earlier, I currently don't have hosting for it.

Thank you for your reply

please inform me after solving hosting
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
i need blockdata.loyce.club/transactions/ (44 GB) link
Sorry, as I wrote earlier, I currently don't have hosting for it.
newbie
Activity: 7
Merit: 0
please can you update Transaction link
any new link please send
I'm not sure what you mean by "transaction link". If you're looking for the current location of this data, it's on my external USB drive. Unfortunately:
It looks like Chia mining killed cheap storage VPS servers.

sir
i need blockdata.loyce.club/transactions/ (44 GB) link
i am newbie sir , just learning sir......

Thank you sir
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
please can you update Transaction link
any new link please send
I'm not sure what you mean by "transaction link". If you're looking for the current location of this data, it's on my external USB drive. Unfortunately:
It looks like Chia mining killed cheap storage VPS servers.
newbie
Activity: 7
Merit: 0
This data is unavailable until I find an affordable VPS with enough disk space and cheap bandwidth.

Background
I've used Blockchair Database Dumps for several projects, but when I need it I don't want to wait weeks months to download all files. So I created a mirror for Bitcoin data Smiley

The data
See blockdata.loyce.club
blockdata.loyce.club/inputs/ (386 GB)
blockdata.loyce.club/outputs/ (121 GB)
blockdata.loyce.club/transactions/ (44 GB)

Updates
New files are added daily.

Be kind
Please only download with one thread at a time. I don't want to be kicked off another server.

Credits
Blockchair Database Dumps has a staggering amount of data, easily accessible (at 10 100 kB/s) with daily updates. All data in this topic comes from Blockchair.

No spam please.
Self-moderated against spam. Discussion and questions are welcome.



Related topics
Bitcoin block data available in CSV format
List of all Bitcoin addresses with a balance
List of all Bitcoin addresses ever used
[~500 GB] Bitcoin block data: inputs, outputs and transactions

Hello Sir,
please can you update Transaction link
any new link please send

Thank you in advance

maa
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
I understand that your internet provider (bandwidth or transfer limit if you have) could be a problem
That's why Wink
And privacy of course, I'm not hosting things at home.

I found a good offer for my other project, with 15 TB monthly bandwidth. It would be great if that same host offers storage servers in the future.
These used to be my little side projects, but I already have 2 (virtual) servers running for it now. Things tend to get out of hand quickly Tongue
legendary
Activity: 952
Merit: 1386
Why do not you host it on your private/local NAS + dyndns solution? I understand that your internet provider (bandwidth or transfer limit if you have) could be a problem, but you may limit download speed or just do not run it 24/7.
Pages:
Jump to: