Topic: [BETA] Bitcoin blockchain torrent - page 3. (Read 57756 times)
Ok, thanks. 11 seeds, 3 peers while downloading, dropped to 0 of 1 seeds, 0 of 0 peers while seeding.
Azureus/Vuze
Let it sit for a while to gather nodes via DHT. Since it's trackerless you won't instantaneously get all the available seeds. My torrent client says it knows of 18 seeds and 3 peers.As mentioned upthread, Azureus sadly walls itself off onto "Azureus island", and in my testing, does not find peers as quickly as all other clients tested. Making things worse, Azureus' DHT is separate from the mainline DHT.
TheButterZone: try installing the "mlDHT" plugin for Azureus/Vuze. This connects you to the mainline DHT.
Azureus/Vuze
Let it sit for a while to gather nodes via DHT. Since it's trackerless you won't instantaneously get all the available seeds. My torrent client says it knows of 18 seeds and 3 peers.
Azureus/Vuze
Ooh. Even though I don't use the client, I'm getting this to seed indefinitely (at least when my computer is on and BT is open). Except there's only 1 seed now, no peers. Will it be worth the sectors on my hard drive to keep this going?
What bittorrent client are you using?
Seeing 12+ seeds here.
Ooh. Even though I don't use the client, I'm getting this to seed indefinitely (at least when my computer is on and BT is open). Except there's only 1 seed now, no peers. Will it be worth the sectors on my hard drive to keep this going?
Blocks are oddly sized
Makes sense.
and their locations within the block files are pretty much arbitrary.
Even for someone starting from block 0?
Yup, it is a consequence of the odd block sizes. Reading a single block may involve several disk reads. And getting the file offset to read will also take several reads in the index file.
The way the client currently downloads blocks from peers is hardly more than a hack that somehow frequently manages to work.
We could add even more hacks on top of it to improve it (and it wouldn't take much to improve it a lot), but the right solution in my opinion is doing it right from the ground up: synchronize the headers first, validate those, and then ask your peers to fill in the data for the blocks which you already know in advance are part of the best chain.
The just-merged rewrite of the database layout and validation engine should support such a mode of operation, but someone still has to implement it.
We could add even more hacks on top of it to improve it (and it wouldn't take much to improve it a lot), but the right solution in my opinion is doing it right from the ground up: synchronize the headers first, validate those, and then ask your peers to fill in the data for the blocks which you already know in advance are part of the best chain.
The just-merged rewrite of the database layout and validation engine should support such a mode of operation, but someone still has to implement it.
Blocks are oddly sized
Makes sense.
and their locations within the block files are pretty much arbitrary.
Even for someone starting from block 0?
Also, the way the stock client does the download now, it asks the first node it connects to for the whole chain, block by block.
That sounds quite un-optimal.
Bittorrent ... can manage multiple connections, grabbing different chunks from here and there.
We could update the Bitcoin client to grab blocks from multiple peers, right? With a few more patches, downloading the chain from peers should approach the speed of a torrent.
As a workaround it seems ok for me, so I'm seeding this file right now for helping others bootstrap.
this data is the precisely the same data you see on the P2P network.
Then how is this different than connecting to high-speed bitcoin peers?
Blocks are oddly sized, and their locations within the block files are pretty much arbitrary. If you don't have enough RAM to cache the whole thing, serving them as blocks one by one will thrash the hell out of your disks. Also, the way the stock client does the download now, it asks the first node it connects to for the whole chain, block by block.
Bittorrent, on the other hand, doesn't understand the data at all, so it serves it in chunks that are always the same size, which are always aligned with the filesystem blocks. It also can manage multiple connections, grabbing different chunks from here and there.
The result is that torrents are much more efficient at bulk transfer. They are faster for the client, and less stressful for the server.
But, for various reasons, we don't like that we have to use an outside distribution method. The long term goal is to improve the software to make the initial block download faster and smarter. The bootstrap and torrent are just a temporary thing to lighten the load while work continues.
this data is the precisely the same data you see on the P2P network.
Then how is this different than connecting to high-speed bitcoin peers?
Oh sorry, my post wasn't clear, i was refering to this:
Yes i know, downloading it is very simple and straightforward, what i was speaking about was about creating the file from my blockchain, not about downloading the file via bittorrent.
Quote
I wonder if it could be generated from their existing blockchain (is it basically the same file?) which will presumably be pretty up-to-date.
Yes i know, downloading it is very simple and straightforward, what i was speaking about was about creating the file from my blockchain, not about downloading the file via bittorrent.
Quote
Sadly you do need to be a bit of a programmer to generate a bootstrap.dat file.
Of coursegabi rage: is it so hard to have a program that you just clic it, tell it where the bitcoin folder with the blockchain is and then you press EXTRACT and it create bootstrap.dat?
That's what we have here. "a program" is called a bittorrent client. Tell it where the bitcoin folder with the blockchain is, and then you press download.
Quote
Sadly you do need to be a bit of a programmer to generate a bootstrap.dat file.
Of coursegabi rage: is it so hard to have a program that you just clic it, tell it where the bitcoin folder with the blockchain is and then you press EXTRACT and it create bootstrap.dat?
Quote
Sadly you do need to be a bit of a programmer to generate a bootstrap.dat file.
Of coursegabi rage: is it so hard to have a program that you just clic it, tell it where the bitcoin folder with the blockchain is and then you press EXTRACT and it create bootstrap.dat?
or is the number a count of ipv4 addresses in this section?
Yes, it shows number of different IP addresses for each list. You can check what exactly each of them is filtering (or allowing) here.
well then, sry 4 that
are you seeding from home? if so i can understand avoiding the 720 connections 
Off-topic, sort of:
There's incredible amount of Anti-P2P activity lately. By the time I finished downloading file, 724 IP addresses known to be used by
organizations and companies openly working against P2P were detected on DHT, and 720 of them tried to connect to my client, LOL!
I was downloading and now seed just this file. Really, those people are very fast - and determined - to find out what's new on P2P.
Level 1 filters those mentioned above:
There's incredible amount of Anti-P2P activity lately. By the time I finished downloading file, 724 IP addresses known to be used by
organizations and companies openly working against P2P were detected on DHT, and 720 of them tried to connect to my client, LOL!
I was downloading and now seed just this file. Really, those people are very fast - and determined - to find out what's new on P2P.
Level 1 filters those mentioned above:
yea sure, ipv4 adress spaces higher than 255! lmao
EDIT: or is the number a count of ipv4 addresses in this section?
even touhg, ipfilter is a fine thing, but not really accurate at all.
@jgarzik: need more seeds?
Torrent added to PirateBay! I hope you here or my friend - I used his abandoned account - will be OK with this move. Once PB picks some torrent,
it usualy got spread to numerous other torrent sites in matter of few days, so expect (or not?) some more down/uploaders and/or participants here.
it usualy got spread to numerous other torrent sites in matter of few days, so expect (or not?) some more down/uploaders and/or participants here.
In general, spreading the torrent far and wide is fine.
But for trackers or accounts of friends, it is nice to ask [the tracker site / friend] first
I haven't added any trackers to torrent. I just uploaded .torrent you linked at starting post, from my HDD, and copy/pasted some info.
Yeah, post the .torrent file far and wide.
Torrent added to PirateBay! I hope you here or my friend - I used his abandoned account - will be OK with this move. Once PB picks some torrent,
it usualy got spread to numerous other torrent sites in matter of few days, so expect (or not?) some more down/uploaders and/or participants here.
it usualy got spread to numerous other torrent sites in matter of few days, so expect (or not?) some more down/uploaders and/or participants here.
In general, spreading the torrent far and wide is fine.
But for trackers or accounts of friends, it is nice to ask [the tracker site / friend] first
Jump to: