Pages:
Author

Topic: Blockchain Download Time (Read 393 times)

newbie
Activity: 8
Merit: 0
March 21, 2018, 11:07:45 AM
#30
3 Answers. Assuming you have solid 2 megabytes per second download speed, it would take around 20 hours just to download them. In practice, this takes much longer, as your computer will verify every block individually, which takes some time.
newbie
Activity: 16
Merit: 2
March 21, 2018, 10:41:27 AM
#29
Really it taking too much time...  I have only 100 kbps download speed show more than week download time. now I'm thinking what will happen whne lockchain reach to 1 TB . What will happen to my pc.

Just wait a week.  Once it's downloaded, the updates (a new block every 10 minutes) are very small and fast.  If it gets bigger, you'll need to get a bigger disk!
newbie
Activity: 238
Merit: 0
March 21, 2018, 09:15:13 AM
#28
Really it taking too much time...  I have only 100 kbps download speed show more than week download time. now I'm thinking what will happen whne lockchain reach to 1 TB . What will happen to my pc.
newbie
Activity: 16
Merit: 2
March 21, 2018, 04:07:46 AM
#27
One question though, did you pay or were there any payments done for you to completely downloaded it?

You don't pay to download it.  I used an Amazon Web Services server instance for the download.  You need to pay for that.  I posted the costs for it above.  If you're using a PC on your home broadband it won't cost anything.
sr. member
Activity: 540
Merit: 252
March 20, 2018, 09:43:49 PM
#26
March 17th 2018.  Just for reference.

Just downloaded the entire blockchain.

Number of blocks: 513,962

Download time: 2 days 3 hours

Size on disk: 172GB

Used an Amazon Web Services EC2 t2.small server instance, running Ubuntu. 2GB memory.  Was struggling a bit, hence the download time.  CPU running at 100% constantly.  Memory was fine but I think more would be needed if running a faster processor.  Not sure of the CPU specs on the t2.small instance but it's one of their lowest performing (and cheapest) instances.


I tried to download it before. It keeps on getting rejected and I just notice that the space isn't enough. An excellent information sir, I'd be very careful with it's infos soon. One question though, did you pay or were there any payments done for you to completely downloaded it? Thank you.
newbie
Activity: 16
Merit: 2
March 20, 2018, 03:59:45 PM
#25
In Bitcoin?  That's a hard fork.

Well, it was worth a shot!  Maybe if it's that, or the end of Bitcoin...
legendary
Activity: 3472
Merit: 4801
March 20, 2018, 03:56:01 PM
#24
Assuming there aren't any significant changes to the protocol to allow more on-chain transactions

Why not make a block every minute?  Make the reward 1.25 bitcoin so you still average 12.5 bitcoin every 10 minutes.  You still get 12.5 bitcoin every 10 minutes but you get 10 times the number of transactions confirmed.

Why stop at a minute, make a new block every 10 seconds, every second, again with a proportional reward to maintain the average of 12.5 bitcoin every 10 minutes?  could get a *lot* more transactions processed and more quickly.

In an altcoin?  Sure.  There are many that have already done so.

In Bitcoin?  That's a hard fork.  To accomplish it you need agreement from an overwhelming majority of all users, merchants, miners, exchanges, wallets, etc.  Getting that many people to agree overwhelmingly on such a change isn't going to happen.  It wasn't even possible to get an overwhelming majority to agree to increase the block size from 1 megabyte to 2 megabytes after 7 years of discussion, debate, argument, and attempts.  Attempting to fork with less than an overwhelming majority results in an altcoin "airdrop" ("Bitcoin Cash" was a hard fork without an overwhelming majority).

I don't think there has been a successful hard fork change to "Bitcoin" since Satoshi left.  I doubt there ever will be.

Here's something to think about...

Is the purchase of a coffee or pizza really an important or risky enough transaction that every full node should be required to store that transaction FOREVER?  If not, then why is it so important that people be able to make such a purchase on-chain?
newbie
Activity: 16
Merit: 2
March 20, 2018, 02:01:47 PM
#23
Assuming there aren't any significant changes to the protocol to allow more on-chain transactions

Why not make a block every minute?  Make the reward 1.25 bitcoin so you still average 12.5 bitcoin every 10 minutes.  You still get 12.5 bitcoin every 10 minutes but you get 10 times the number of transactions confirmed.

Why stop at a minute, make a new block every 10 seconds, every second, again with a proportional reward to maintain the average of 12.5 bitcoin every 10 minutes?  could get a *lot* more transactions processed and more quickly.
newbie
Activity: 16
Merit: 2
March 20, 2018, 08:31:55 AM
#22
If you are solo mining, then your mining software is probably getting its block headers from Bitcoin Core using a getwork API call.  In that case, Bitcoin Core has the transaction selecting algorithm coded into it. I haven't done any mining, so I don't know how configurable that algorithm is.  You do have a few command line options when starting up Bitcoin Core:  

  • -blockmaxweight=        Set maximum BIP141 block weight (default: 3000000)
  • -blockmaxsize=            Set maximum block size in bytes (default: 750000)
  • -blockprioritysize=        Set maximum size of high-priority/low-fee transactions in bytes (default: 0)
  • -blockmintxfee=       Set lowest fee rate (in BTC/kB) for transactions to be included in block creation. (default: 0.00001)

Excellent information again, thank you.  Yes, I did notice those options when playing with the core but didn't fully understand them.  So you could set blockmintxfee to quite a high value to only accept transactions with large fees.  Very interesting, so it's the core that determines what transactions are available to miners, hence no setting for it on BFGMiner.  So if you are using someone else's core, you have to go with their settings.  I suppose this goes back to the early days when every miner would have their own core and the core (bitcoind) did the mining.
newbie
Activity: 16
Merit: 2
March 20, 2018, 07:31:24 AM
#21
Just out of curiosity, did you need to pay any bandwidth fees and if yes approx how much?

Bandwidth in, i.e. downloading the blockchain, is free.  Data transfer out is free for the first 1GB then $0.09 per GB after that.  Which would be expensive running as a full node if someone downloaded the entire blockchain of 172GB, would be ~ $15 every time (not sure if the transfer is measured in bits or bytes which could make a significant difference).  You wouldn't have any transfer out if you were using it privately, i.e. not accepting incoming requests/connections.  Plus, I believe data transfer between servers on the AWS network is free.

You pay for the storage.  I used 200GB of storage which is charged at $0.116 per GB per month, which equates to $23.20 for the month.

The server instance is one of their lower specs and costs $0.0264 per hour, which equates to (roughly) $19 a month.

The beauty of the AWS instances is that you can start and stop them at any time.  You only pay for what you use.  I have used this one for a few days just to download the blockchain and have a play with it.  In 5 1/2 days it's cost me $3.53 for the instance and around $5 for the storage.  My transfer out was 4.6GB, costing 42 cents (I was only accepting incoming connections for a few hours).  It's on a very good network too, so you should get good connectivity.
legendary
Activity: 3472
Merit: 4801
March 20, 2018, 07:06:48 AM
#20
Do the mining programs automatically select the transactions with the highest fees?  Been looking at BFGMiner but didn't notice a configuration for this or any mention of it in the README.

If you are mining in a mining pool, then the pool is selecting the transactions and building the blocks.  Then they just hand off the block header (or, more specifically, the partially hashed header called the midstate) to your software for you to complete the hashing on. In that case, the pool is probably running custom software to build the block headers.

If you are solo mining, then your mining software is probably getting its block headers from Bitcoin Core using a getwork API call.  In that case, Bitcoin Core has the transaction selecting algorithm coded into it. I haven't done any mining, so I don't know how configurable that algorithm is.  You do have a few command line options when starting up Bitcoin Core:  

  • -blockmaxweight=        Set maximum BIP141 block weight (default: 3000000)
  • -blockmaxsize=            Set maximum block size in bytes (default: 750000)
  • -blockprioritysize=        Set maximum size of high-priority/low-fee transactions in bytes (default: 0)
  • -blockmintxfee=       Set lowest fee rate (in BTC/kB) for transactions to be included in block creation. (default: 0.00001)

The transactions with lower fees are then left waiting a VERY long time to confirm.  Eventually, people that aren't willing to wait abandon the Bitcoin blockchain and use some other method for making their transactions.  Those other methods may or may not Bitcoin off-chain transactions (such as Lightning Network or Account based services like Coinbase)

Just been reading some very worrying articles about very high bitcoin transaction fees:

http://uk.businessinsider.com/bitcoin-payment-mining-fees-hit-new-high-2017-12
m/2017/12/19/big-transactions-fees-are-a-problem-for-bitcoin.html]https://www.c[Suspicious link removed]m/2017/12/19/big-transactions-fees-are-a-problem-for-bitcoin.html

...meaning no-one is going to use it to buy coffee or pizza. 

Correct.  Assuming there aren't any significant changes to the protocol to allow more on-chain transactions, eventually Bitcoin will either die or it will develop high enough transaction fees that nobody will be using it for small value on-chain transactions.

One of the articles mentions Lightning Network with instant transactions and low fees, which to me looks very interesting.

Lightning Network is one of a few off-chain solutions to allow a large number of off-chain Bitcoin based transactions.  Another off-chain solution is Bitcoin based accounts with services such as Coinbase or BitPay.  Each has their own benefits and issues, and each will probably find use in various circumstances.
newbie
Activity: 16
Merit: 2
March 20, 2018, 04:37:46 AM
#19
Those that want fast confirmation of their transaction therefore increase their transaction fee to get into the next block.

Do the mining programs automatically select the transactions with the highest fees?  Been looking at BFGMiner but didn't notice a configuration for this or any mention of it in the README.

The transactions with lower fees are then left waiting a VERY long time to confirm.  Eventually, people that aren't willing to wait abandon the Bitcoin blockchain and use some other method for making their transactions.  Those other methods may or may not Bitcoin off-chain transactions (such as Lightning Network or Account based services like Coinbase)

Just been reading some very worrying articles about very high bitcoin transaction fees:

http://uk.businessinsider.com/bitcoin-payment-mining-fees-hit-new-high-2017-12
m/2017/12/19/big-transactions-fees-are-a-problem-for-bitcoin.html]https://www.c[Suspicious link removed]m/2017/12/19/big-transactions-fees-are-a-problem-for-bitcoin.html

...meaning no-one is going to use it to buy coffee or pizza.  One of the articles mentions Lightning Network with instant transactions and low fees, which to me looks very interesting.
newbie
Activity: 16
Merit: 2
March 19, 2018, 01:56:29 PM
#18
Thanks all.  Good info!  I would like to keep a full node to help the network.  Just tinkering for now!
legendary
Activity: 3472
Merit: 4801
March 19, 2018, 09:54:43 AM
#17
You do not have to run a node to be able to transact.

Correct.

But you will be highly reliant on nodes that your wallet uses for broadcasting your transactions to the network.

FALSE.

Running a node does not make you any more or less reliant on other nodes for broadcasting your transactions.

As a medium and large size business you would like to be able to control when you broadcast your txs,

Correct.

be sure that wallets do not falsify your balances,

Huh

What balances?  What are you talking about?  Why wouldn't you know what your own balance is?

That certainly sounds like a load of nonsense.

So having a node, thus, downloading blockchain is quite necessary.

This isn't a question about downloading the blockchain.  This is a question about storing the blockchain. Did you even read this thread before posting your nonsense?
copper member
Activity: 158
Merit: 1
March 19, 2018, 09:30:04 AM
#16
Will be interesting to see how big it gets, with the increased popularity of bitcoin.
The size of the blockchain has nothing to do with Bitcoin adoption. Blockchain's size increases with every block added to the blockchain, which usually happens every ten minutes. And each block being of 1 MB in size would increase the size of the blockchain by 1 MB.

Actually it has. You do not have to run a node to be able to transact. But you will be highly reliant on nodes that your wallet uses for broadcasting your transactions to the network. As a medium and large size business you would like to be able to control when you broadcast your txs, be sure that wallets do not falsify your balances, there are no MIM attacks. So having a node, thus, downloading blockchain is quite necessary.
legendary
Activity: 3038
Merit: 4418
Crypto Swap Exchange
March 19, 2018, 08:21:24 AM
#15
My understanding was that you needed the full blockchain for maximum integrity.
You don't. The block files are pretty useless after you've verified them and have gotten the chainstate and other essential information. If your computer can verify its legitmacy, there is no problem throwing them away. You could have problems when importing addresses, etc. None of the potential problems actually affect the security; could just cause some inconvenience.
What if everyone pruned their blockchain, would that mean there wouldn't be any full copies of the blockchain?!  Wouldn't that be a problem?
Yes. If everyone pruned their blockchain, then it would be a huge problem. Since the wallet prune itself as you get more blocks, no one would ever see the entire history if that were to happen. And yes, it would compromise the security greatly in that case. IMO, pruning is just for people who wants to run Bitcoin Core and to support the network, not really that much as to helping the network (debatable but thats my opinion).
legendary
Activity: 3472
Merit: 4801
March 19, 2018, 08:18:25 AM
#14
What if there's tens of thousands, or hundreds of thousands of new transactions per block

This is not possible unless there is a fork and we change the block weight or block size.

Right now, if too many transactions are sent, then the excess transactions that don't fit into the next block must wait until a later block. Those that want fast confirmation of their transaction therefore increase their transaction fee to get into the next block.  The transactions with lower fees are then left waiting a VERY long time to confirm.  Eventually, people that aren't willing to wait abandon the Bitcoin blockchain and use some other method for making their transactions.  Those other methods may or may not Bitcoin off-chain transactions (such as Lightning Network or Account based services like Coinbase)

All those transactions in one block of 1MB?

No.  They just wait for later blocks.

My understanding was that you needed the full blockchain for maximum integrity.

You need to have received and processed the entire blockchain if you want to be 100% certain that you have not been fed any false information about the current state of the UTXO. However, you do not need to have stored/kept that entire history.  You only need to keep the UTXO.

What if everyone pruned their blockchain, would that mean there wouldn't be any full copies of the blockchain?!  Wouldn't that be a problem?

Yes. That would be a problem.  Fortunately, there are many of us that WANT and are willing to store the entire blockchain for various reasons. If you are able to store the entire blockchain and you want the entire blockchain (or you just want to be able to help other new users by supplying the entire blockchain), then you are welcome to do so and we appreciate your willingness to do so.  If you are unable to , or you do not want to, then we can manage without you.
newbie
Activity: 16
Merit: 2
March 18, 2018, 06:08:17 PM
#13
Thanks all for the very helpful replies.  I noticed the prune option but I wasn't sure about it (being very new to this).  My understanding was that you needed the full blockchain for maximum integrity.  What if everyone pruned their blockchain, would that mean there wouldn't be any full copies of the blockchain?!  Wouldn't that be a problem?

Yes, Jet Cash, I remember seeing an option to state the data directory.  That would be very handy to have the .bitcoin directory on a SSD.  Initially I was thinking you would just need the blocks and the chainstate data but it makes sense, and is a lot easier, simply to copy the entire directory.
newbie
Activity: 16
Merit: 2
March 18, 2018, 05:54:31 PM
#12
The size of the blockchain has nothing to do with Bitcoin adoption. Blockchain's size increases with every block added to the blockchain, which usually happens every ten minutes. And each block being of 1 MB in size would increase the size of the blockchain by 1 MB.

Right.  I'm very new to this.  I wasn't thinking about the size of the chain so much as the size of the blocks.  What if there's tens of thousands, or hundreds of thousands of new transactions per block (as there will be when everyone starts using bitcoin on a regular basis!).  All those transactions in one block of 1MB?
legendary
Activity: 2814
Merit: 2472
https://JetCash.com
March 18, 2018, 03:43:56 PM
#11

Wondering if the data files can simply be copied to another disk?  Would save downloading and processing everything again when it comes time to upgrade your system.

I've got 3 copies of the blockchain ( plus the associated files and wallet data), and I run 2 nodes.

I copied the directory onto an SSD, and gave that to a new installation of Core under Ubuntu. It asked me for the directory address, and when I replied, it went ahead and veried the copied chain, and synchronised it. It even gave me the correct info in the wallet.

I'm impressed with core, it seems to be extremely stable, it even runs under Windows without any problems. Smiley
Pages:
Jump to: