Pages:
Author

Topic: [ANN] Bitcoin blockchain data torrent (Read 211191 times)

brand new
Activity: 0
Merit: 0
October 20, 2018, 10:32:42 PM
i dont know how to this data, but thanks for sharing
newbie
Activity: 30
Merit: 0
January 31, 2018, 01:35:22 AM
I will only say that I have maintained several torrent sites since Jeff started this thread. Activity initially zilch.

In the last few weeks, upload bandwidth has skyrocketed.
copper member
Activity: 2856
Merit: 3071
https://bit.ly/387FXHi lightning theory
November 21, 2017, 07:35:16 PM
Torrents make heavy use of checksumming/hashing, so while in the block chain you need to have all previous headers to verify the current one, in a torrent file you just need any chunk of data. Other comments were saying that a feature was being implemented so that all of the headers would be downloaded first and the actual blocks could then be downloaded in any order. I'm guessing the client pretty much has to download the headers serially still in order for the distributed nature to continue working. Serial downloading of the blockchain probably makes it easier for the client to check that nobody is bullshitting them with an incorrect version of the blockchain.

Unless you're talking about parallel processes, I don't see how what you're suggesting would increase the download time.
The headers are downloaded first though so that could be what it does... (But as it tracks the height and suggests the number of blocks downloaded this probably doesnt happen). Also, a feature like that would take about longer and more CPU power IMO as it has to check whether it's done a file and call each block relating to the header randomly.
member
Activity: 108
Merit: 100
November 16, 2017, 06:23:58 PM

It is very convenient, when I install bitcoin-qt on another device, it takes about an hour instead of almost a week Embarrassed
full member
Activity: 1176
Merit: 111
November 14, 2017, 05:08:20 PM
Active torrents. Sharing Nov 7, 2017 - https://blockchaindownload.nl/en/
newbie
Activity: 42
Merit: 0
September 30, 2017, 10:19:41 PM
Torrents make heavy use of checksumming/hashing, so while in the block chain you need to have all previous headers to verify the current one, in a torrent file you just need any chunk of data. Other comments were saying that a feature was being implemented so that all of the headers would be downloaded first and the actual blocks could then be downloaded in any order. I'm guessing the client pretty much has to download the headers serially still in order for the distributed nature to continue working. Serial downloading of the blockchain probably makes it easier for the client to check that nobody is bullshitting them with an incorrect version of the blockchain.
copper member
Activity: 2856
Merit: 3071
https://bit.ly/387FXHi lightning theory
September 10, 2017, 10:24:29 AM
there are some people who has contrary belief to what is better:
download the entire boostrap.dat
OR
start a node and download the data from other nodes.

I wonder if someone has the technical knowledge to clarify this

Until about version 0.10.0 it was much faster to download the bootstrap.dat file.
Since that release of version 0.10.0 it was faster just to leave a node to download it unless you have a dial-up modem or limited internet access (but it'd have to be less than about 100kbps to slow if down by an unreasonable amount that makes downloading impossible). If you have an internet speed that sliw however, if wouldn't be productive to run a node anyway and you may as well use a light wallet instead.
hero member
Activity: 544
Merit: 507
September 10, 2017, 10:07:07 AM
there are some people who has contrary belief to what is better:
download the entire boostrap.dat
OR
start a node and download the data from other nodes.

I wonder if someone has the technical knowledge to clarify this
legendary
Activity: 2618
Merit: 1007
August 23, 2017, 04:07:12 PM
Also, there are (non-English language) papers that use this torrent for performance comparison of various file systems, alternate storage engines and file/partition layouts.
Got some links? Also the ad-hominem is not really useful, using the data in this torrent is objectively a really bad way to bootstrap your node in case you just want to get it up and running as fast as possible.
legendary
Activity: 2128
Merit: 1073
August 22, 2017, 05:59:08 AM
You do realize, that data in torrent are WAY outdated and new node need get lots of data anyway?
So what? It is and it forever will be a proper subset of the valid data. This torrent is sufficient to reliably trigger bugs in certain popular/cheap flash storage devices. This alone would make it an useful test case for at least decade, maybe more.

Also, there are (non-English language) papers that use this torrent for performance comparison of various file systems, alternate storage engines and file/partition layouts.

It is NOT good way to bootstrap node.
This is just your personal limitation that you can't or won't understand why separating over-the-WAN download from over-the-LAN initialization is and will be useful troubleshooting and testing tool.
legendary
Activity: 1361
Merit: 1003
Don`t panic! Organize!
August 19, 2017, 04:26:17 AM
You do realize, that data in torrent are WAY outdated and new node need get lots of data anyway?
It is NOT good way to bootstrap node.
legendary
Activity: 2128
Merit: 1073
August 18, 2017, 02:43:29 PM
This topic can be closed? Some people still asking about thing that is not need for like year.
Please don't close it. Lots of people with unreliable hardware or network problems are still better off downloading separately from initializing the blockchain storage.

There are many people with non-flat-rate network hookups or with over-the-radio hookups with shared IPv4 addresses that continue to download the torrents from this thread.
 
legendary
Activity: 1361
Merit: 1003
Don`t panic! Organize!
August 18, 2017, 02:53:47 AM
IMPORTANT NOTE:  As of Bitcoin Core version 0.10.0 or later, this torrent is slower than a direct download using the bitcoin P2P protocol & client.  This torrent is now only maintained for research and development purposes as a secondary option.  Please use Bitcoin Core directly to download the blockchain.
This topic can be closed? Some people still asking about thing that is not need for like year.
staff
Activity: 3500
Merit: 6152
July 25, 2017, 08:27:00 AM
any bootstrap.dat update 2017?

You don't need it anymore and It's no longer as It used to be, It's now slower. If you want to download the blockchain then do it directly from Bitcoin Core, It should take less time If you are running the latest versions.
member
Activity: 128
Merit: 10
July 25, 2017, 08:15:29 AM
any bootstrap.dat update 2017?
full member
Activity: 476
Merit: 100
July 18, 2017, 04:04:08 AM
Both openbittorrent and publicbt work for me, your "seedboxes" will not be able to BitTorrent traffic and everything you might configure it by the way they do not receive public torrent files / links?
copper member
Activity: 2856
Merit: 3071
https://bit.ly/387FXHi lightning theory
July 16, 2017, 11:18:48 AM
so downloading this and importing would take longer than 2 weeks my bitcoin core is indicating?


Yes, and you might want to look at when one of these was last released. It might not have been for some time considering this thread isn't very active and it's not particularly that useful as the new wallets should load the chain much faster.
sr. member
Activity: 365
Merit: 250
July 16, 2017, 10:46:00 AM
so downloading this and importing would take longer than 2 weeks my bitcoin core is indicating?
full member
Activity: 149
Merit: 100
Solar Bitcoin Specialist
January 17, 2016, 04:40:36 AM
Definitely no for BTC.

For the whole month of August I had my quad-core B2 raspberry pi trying to download and sort the whole blockchain to its compiled-from-src bitcoin-qt.  It crashed and required bitcoin-qt -reindex several times and in one month of usage never completed the necessary first -reindex task.  It seemed to get slower and slower as the number of weeks remaining decreased to 50 wk, (synched up to mid-2014) and eventually I started using a spare i5 instead, which overtook the rPi in a couple of days.

In 2016, I have this rPi being an unobtanium-qt node and a couple of other altcoins too.  They are all a bit underused but seem to have faster confirmation times than BTC and be better suited to (if my neighbours were to pay pocket money for mowing the lawn).  I've just tested an unobtanium electrum-uno lightweight wallet which showed "pending" within the same minute as sending a test transaction from the rPi node via the international UNO blockchain to .. the other PC across my desk. 

If you are serious about power saving then try something like this by all means, but read around to avoid the various scamcoins and proceeds-of-crime coins which are around.

copper member
Activity: 2856
Merit: 3071
https://bit.ly/387FXHi lightning theory
January 16, 2016, 06:33:02 PM
January 11th 2016 blockchain full download
~~~~~~~~~~~~~~~~~~~~~~~~~
Here I report my most recent performance as it will help others to decide what hardware is sufficient. 
It was to a VBOX virtual machine in linux on a quad-core i5 throttled to <75% x 4cpu cores.
Download of the whole blockchain from block 1 to present took about 2 days.  /.bitcoin/ is now about 65GB
2009 to 2013 parts of the blockchain maxed out the 4x cpu usage.
After that it slowed down, with 4x cpu usage decreased from about 95% x 4 x 2.3 GHz to (4 x 2.3 GHz about 40% of the time).
I suspect that the most recent 40GB of the blockchain were synching at a rate limited by my HDD rw speed and seek time, so a faster HDD such as a SSD would be the best available speedup, and might get a full blockchain download down to less that 40 hours.  What have others been seeing?

I don't think that the original bootstrap.dat is much help now as it only does the "easy" third at the start of the blockchain.

I was considering running the bitcoin core of a hard drive on a raspbery pi and transferrring the data over afterward to my laptop.

Would this save power? It only has to power a hard drive, raspberry pi and WiFi adapter.
Pages:
Jump to: