How to deal with 80 GB Blockchain? | Bitcointalksearch.org

Moloch

hero member

Activity: 798

Merit: 722

Quote from: cr1776 on January 29, 2016, 08:33:03 PM

Just run it in pruning mode then. If you limit it to 10 GB, then that is only $1/month.

Out of curiosity, what host are you using? (If you don't want to share, no big deal).

AWS

They charge separately for things like HD space and bandwidth

bob123

legendary

Activity: 1624

Merit: 2481

A backup once per Week/month should be fine.
128 GB USB sticks arent expensive at all anymore

Hannu

hero member

Activity: 1063

Merit: 502

RIP: S5, A faithful device long time

Quote from: Indianacoin on January 28, 2016, 05:11:21 AM

We already know that we have to download Bitcoin Core wallet if we want to contribute the network by running the full node of the blockchain.

But it will be a tedious job download the full chain of size 80 GB again if there happens something wrong with one's wallet and it needs to restart a wallet from the beginning.

So is there a recent bootstrap file available anywhere so that I can keep it as a backup in case I need it whenever I start a new wallet?
Or can anyone help me out on how to create a bootstrap file myself directly from the wallet files?

Technical helps are much appreciated

Do not use online wallet? If you dont wanna run fullnode/node on bitcoin network? Roll Eyes

Use offline wallet example http://www.coinmotion.com/

unamis76

legendary

Activity: 1512

Merit: 1012

Buy a new drive or more VPS space

pereira4

legendary

Activity: 1610

Merit: 1183

It's a pain in the ass to be honest. Maintaining it is not that hard work, but download it from scratch? That's a nightmare. I just hope that it never corrupts again. It sometimes has corrupted after upgrading the software. Honestly if it happens again I may give up and run pruned mode in 0.12. And to think there's people that want to make it grow twice as fast, what are they smoking? I think we need to wait a bit longer to raise it so the average user has better internet and hardware.

af_newbie

legendary

Activity: 2702

Merit: 1468

Quote from: Indianacoin on January 28, 2016, 05:11:21 AM

We already know that we have to download Bitcoin Core wallet if we want to contribute the network by running the full node of the blockchain.

But it will be a tedious job download the full chain of size 80 GB again if there happens something wrong with one's wallet and it needs to restart a wallet from the beginning.

So is there a recent bootstrap file available anywhere so that I can keep it as a backup in case I need it whenever I start a new wallet?
Or can anyone help me out on how to create a bootstrap file myself directly from the wallet files?

Technical helps are much appreciated

1. Configure/keep data directory under subdirectory in the installation directory, change your startup script to point to that data directory.
2. Backup your wallet.dat
3. Delete wallet.dat from your data directory. Backup the whole installation/data directory.
4. Now you can put backup in 3. anywhere (for example: your new node)
5. Restart 4., it will recreate wallet.dat (with a new default address)

If you backup installation/data directory every few weeks (and before any major release), you will be ok. Even if they are down for a while, when you restart
them, they will catch up. No need to download of the whole blockchain.

Remember, blockchain and your wallet are two different things. The blockchain files are (should be) identical on all your nodes once synchronized with the network.
wallet.dat should be different.

Just keep blockchain with the matching binaries, so that if you need to upgrade, you'll have no issues. First synchronize, then upgrade.

You should maintain your nodes by upgrading binaries to the latest, released version.

BlockSense

newbie

Activity: 14

Merit: 0

Pruning is most definitely the easiest solution to this issue. One could say the blockchain size is a testament to bitcoinss growing usage. I feel some servers (digitalocean?) should have a "deploy bitcoin core" service that will help save on initial startup. Storage and hosting is getting better and cheaper but still has some way to go before cheaper solutions are worthwhile for both company and customers.

cr1776

legendary

Activity: 4256

Merit: 1313

Quote from: Moloch on January 29, 2016, 08:22:48 PM

Quote from: Jet Cash on January 29, 2016, 03:44:12 AM

What's the big deal about an 80Gb directory. The file sizes are still fairly small, and the notebook I am using now has a 2Tb hard drive. It wasn't that expensive either. If you are on a chromebook, or a mobile, then I can see it would matter, but for a reasonable PC, I'd rather have full control of my wallet.

I suppose it depends on the situation.

The web hosting service I use charges $0.10 per Gb. That's $8/month, nearly $100 per year... Plus bandwidth costs...

Running a full node on my website would cost $1-200/year, and the blockchain is certainly not getting smaller

Just run it in pruning mode then. If you limit it to 10 GB, then that is only $1/month.

Out of curiosity, what host are you using? (If you don't want to share, no big deal).

Moloch

hero member

Activity: 798

Merit: 722

Quote from: Jet Cash on January 29, 2016, 03:44:12 AM

What's the big deal about an 80Gb directory. The file sizes are still fairly small, and the notebook I am using now has a 2Tb hard drive. It wasn't that expensive either. If you are on a chromebook, or a mobile, then I can see it would matter, but for a reasonable PC, I'd rather have full control of my wallet.

I suppose it depends on the situation.

The web hosting service I use charges $0.10 per Gb. That's $8/month, nearly $100 per year... Plus bandwidth costs...

Running a full node on my website would cost $1-200/year, and the blockchain is certainly not getting smaller

Jet Cash

legendary

Activity: 2828

Merit: 2472

https://JetCash.com

What's the big deal about an 80Gb directory. The file sizes are still fairly small, and the notebook I am using now has a 2Tb hard drive. It wasn't that expensive either. If you are on a chromebook, or a mobile, then I can see it would matter, but for a reasonable PC, I'd rather have full control of my wallet.

onlinedragon

hero member

Activity: 1036

Merit: 501

Quote from: shorena on January 29, 2016, 03:06:45 AM

Quote from: ?? on ??

Why download the block chain, can't we just all use online wallets ?

If everyone would use online wallets, bitcoin would in consequence be no different than paypal.

Never there will be only online wallet users. When it's 80gb+ for the whole blockchain I really understand people don't want the full version. Light wallet is for most of the people good enough for me XAPO worked perfectly.

btcdevil

legendary

Activity: 1302

Merit: 1027

Quote from: shorena on January 29, 2016, 03:06:45 AM

Quote from: ?? on ??

Why download the block chain, can't we just all use online wallets ?

If everyone would use online wallets, bitcoin would in consequence be no different than paypal.

Most of the online wallets are changing address with new transactions and they dont even give signed message option if any problem comes with the wallet address associated with any account or transaction so for this i think hardware wallet is much better and safe. because it will be in full control of the user.

shorena

copper member

Activity: 1498

Merit: 1528

No I dont escrow anymore.

Quote from: ?? on ??

Why download the block chain, can't we just all use online wallets ?

If everyone would use online wallets, bitcoin would in consequence be no different than paypal.

Jet Cash

legendary

Activity: 2828

Merit: 2472

https://JetCash.com

I don't trust web wallets. I'm wondering if it will be possible to run 0.12 on a mobile phone to create a pruned node using an SD card. Bandwidth deals are getting insane these days as the supermarkets compete for customers, and most phones have got WiFi and bluetooth now. I guess the problem would be loading the 80Gb blockchain prior to the pruning.

achow101

staff

Activity: 3458

Merit: 6793

Just writing some code

Quote from: ?? on ??

Why download the block chain, can't we just all use online wallets ?

Someone has to have the blockchain, we still need people to run full nodes so that the entire blockchain is available to those online wallets. And not everyone trusts web wallets. It is more likely that people will use SPV wallets as they are safer than web wallets, but SPV wallet still need people to run full nodes so that they can query information from them.

shorena

copper member

Activity: 1498

Merit: 1528

No I dont escrow anymore.

Quote from: Indianacoin on January 28, 2016, 02:33:25 PM

Quote from: shorena on January 28, 2016, 02:28:11 PM

Quote from: Jet Cash on January 28, 2016, 11:32:46 AM

A 128Gb USB stick is so cheap, it seems mad not to back up the Bitcoin directory. As I understand it, you don't have to backup every day. Core will verify the recovered directory, and then build on that from the public blockchain.

Yes, once a week even once a month would easily be enough. With 128 GB you can even hold two backups, at least for a while.

Thanks for the advice but how exactly do I compile a bootstrap file? Like bootstrap.dat?

I do not want to backup the whole folder anyways.

And is it safe to upload the bootstrap.dat on a cloud?
I think yes because bootstrap does not save sensitive keys of wallet.dat inside it.

This[1] should do it. I cant give you any tipps though since I never bothered to create one. I might do this to help migrating to my new server without hammering the CPU/Disk, but not today or tomorrow.

[1] https://github.com/bitcoin/bitcoin/tree/master/contrib/linearize

Indianacoin

sr. member

Activity: 406

Merit: 252

Quote from: shorena on January 28, 2016, 02:28:11 PM

Quote from: Jet Cash on January 28, 2016, 11:32:46 AM

A 128Gb USB stick is so cheap, it seems mad not to back up the Bitcoin directory. As I understand it, you don't have to backup every day. Core will verify the recovered directory, and then build on that from the public blockchain.

Yes, once a week even once a month would easily be enough. With 128 GB you can even hold two backups, at least for a while.

Thanks for the advice but how exactly do I compile a bootstrap file? Like bootstrap.dat?

I do not want to backup the whole folder anyways.

And is it safe to upload the bootstrap.dat on a cloud?
I think yes because bootstrap does not save sensitive keys of wallet.dat inside it.

shorena

copper member

Activity: 1498

Merit: 1528

No I dont escrow anymore.

Quote from: Jet Cash on January 28, 2016, 11:32:46 AM

A 128Gb USB stick is so cheap, it seems mad not to back up the Bitcoin directory. As I understand it, you don't have to backup every day. Core will verify the recovered directory, and then build on that from the public blockchain.

Yes, once a week even once a month would easily be enough. With 128 GB you can even hold two backups, at least for a while.

Jet Cash

legendary

Activity: 2828

Merit: 2472

https://JetCash.com

A 128Gb USB stick is so cheap, it seems mad not to back up the Bitcoin directory. As I understand it, you don't have to backup every day. Core will verify the recovered directory, and then build on that from the public blockchain.

DumbFruit

sr. member

Activity: 433

Merit: 267

Quote from: Indianacoin on January 28, 2016, 06:45:59 AM

Quote from: boboniera on January 28, 2016, 06:24:20 AM

Blockchain needs only the 1-2 years old transactions. All the others must delete.

That is not how a cryptocurrency works Roll Eyes

The block chain is the decentralized ledger where all records of transactions ever made from the beginning of genesis block are recorded in a string like fashion.

Nobody can destroy the older chains just like that! Impossible fact.

Depends on how you define "cryptocurrency". I think the only way it could be defined without excluding something that currently calls itself a cryptocurrency would be a medium of exchange that exists exclusively digitally. (In which case even fiat currency would be a "cryptocurrency" when they abolish cash, like is happening in Sweden.) I would be interested if anyone could name any other distinguishing feature of a "cryptocurrency" (Something applicable to every variation of a cryptocurrency).
In any case, there are several ways that old transactions can be deleted, including demurrage, pruning, and a "rolling blockchain".

To answer the OP, it's fastest just to download the blockchain with the Bitcoin client. After you have the blockchain, you can keep it stored somewhere (bootstrap.dat) so you don't have to download the whole thing, the client will verify the blockchain on import and then download the rest of the blockchain from where it left off.

You can create bootstrap.dat by concatenating all of the blk*.dat files located in your Bitcoin directory. On Windows it would look like this;
copy /b blk0001.dat+blk0002.dat ... bootstrap.dat

https://bitcoin.org/bin/block-chain/README.txt
http://bitcoin.stackexchange.com/questions/10381/creating-my-own-bootstrap-dat

Topic: How to deal with 80 GB Blockchain? (Read 3313 times)