Pages:
Author

Topic: Finally setting up a full node (Read 663 times)

legendary
Activity: 3066
Merit: 1147
The revolution will be monetized!
March 25, 2019, 07:04:10 AM
#30
I just rebuilt my Linux node machine recently. A full DL of the blockchain took a full week.  Fortunately storage is so cheep that I was able to go with a 3 Terabyte HD. That should hold me for a few years. I like having a dedicated machine like this. I usually shop on a different computer and spend from my node for additional privacy.   

Thanks for contributing to the network's strength and resilience!

My node finally finished syncing yesterday, i started syncing at the end of December, syncing mostly at nighttime. Now that is synced it doesn't bother much to leave it running; but during syncing the I/O access to the harddrive was insane. I still run bitcoind it with ionice -c3 just in case...
When it's syncing it's like Damn, this thing is going to catch fire running like that! Once it does sync it's like, well now it doesn't do anything. I miss syncing.

Weak connection or weak hardware. Tongue Last time I checked on a dedicated machine it took me maybe half a day for a full sync (probably less).
Both! It is an old beat up Dell that is basically a Frankenstein monster.  IMO, a node needs to be secure, but not pretty or fast. I know I could set-up my router to get more connections. I'm just not in a hurry.
legendary
Activity: 2674
Merit: 2965
Terminated.
March 25, 2019, 04:08:17 AM
#29
I just rebuilt my Linux node machine recently. A full DL of the blockchain took a full week.  Fortunately storage is so cheep that I was able to go with a 3 Terabyte HD. That should hold me for a few years. I like having a dedicated machine like this. I usually shop on a different computer and spend from my node for additional privacy.  
Weak connection or weak hardware. Tongue Last time I checked on a dedicated machine it took me maybe half a day for a full sync (probably less).
legendary
Activity: 2030
Merit: 1569
CLEAN non GPL infringing code made in Rust lang
March 22, 2019, 09:20:03 PM
#28
during syncing the I/O access to the harddrive was insane

You can arrange the data directories in a way that minimises that

  • Set the bitcoind parameter -datadir to your fastest disk, preferably a disk that's not the main OS disk (e.g. a SATA/M.2/PCI SSD based SSD)
  • Set the bitcoind parameter -blocksdir to a slower disk with loads of space, again, not your OS disk (i.e. a regular mechanical HDD)

So ideally that involves 1 fast disk for the OS, 1 fast disk for the datadir, and 1 slow disk for the blocks. But it will speed things up noticeably.


Another syncing quickly tip: set the -dbcache parameter to something like dbcache=6000 or dbcache=8000, assuming you have that much RAM to spare

Thank you, i used -dbcache=4096 all this time, the main bottleneck was the bandwidth, but now that it synced its fine.
legendary
Activity: 3430
Merit: 3080
March 19, 2019, 05:40:18 AM
#27
during syncing the I/O access to the harddrive was insane

You can arrange the data directories in a way that minimises that

  • Set the bitcoind parameter -datadir to your fastest disk, preferably a disk that's not the main OS disk (e.g. a SATA/M.2/PCI SSD based SSD)
  • Set the bitcoind parameter -blocksdir to a slower disk with loads of space, again, not your OS disk (i.e. a regular mechanical HDD)

So ideally that involves 1 fast disk for the OS, 1 fast disk for the datadir, and 1 slow disk for the blocks. But it will speed things up noticeably.


Another syncing quickly tip: set the -dbcache parameter to something like dbcache=6000 or dbcache=8000, assuming you have that much RAM to spare
legendary
Activity: 2030
Merit: 1569
CLEAN non GPL infringing code made in Rust lang
March 18, 2019, 09:44:31 PM
#26
I just rebuilt my Linux node machine recently. A full DL of the blockchain took a full week.  Fortunately storage is so cheep that I was able to go with a 3 Terabyte HD. That should hold me for a few years. I like having a dedicated machine like this. I usually shop on a different computer and spend from my node for additional privacy.   

Thanks for contributing to the network's strength and resilience!

My node finally finished syncing yesterday, i started syncing at the end of December, syncing mostly at nighttime. Now that is synced it doesn't bother much to leave it running; but during syncing the I/O access to the harddrive was insane. I still run bitcoind it with ionice -c3 just in case...
legendary
Activity: 3430
Merit: 3080
March 15, 2019, 05:15:06 AM
#25
LOL not that what I meant. I will basically try to get to know with those command line things how they work etc etc. It's more like exploring the entire system and getting to know the features.

You're unlikely to break the blocks db just learning the basic commands, but there are blocks commands cli that could potentially mess it up (invalidateblock for instance)


My drive is 2T so space is not an issue.

Put any backup on a different disk, then both disks would need to stop working at the same time to force you into total re-sync
legendary
Activity: 2464
Merit: 3878
Hire Bitcointalk Camp. Manager @ r7promotions.com
March 15, 2019, 04:18:38 AM
#24
That depends on what you mean by "play with the system"... Tongue

If you're not trying to manipulate blocks or other data files, then I don't see how you can do anything that would really warrant needing a backup. In any case, if anything goes really bad, you can always simply delete all the data files/blocks/chainstate etc and then simply re-sync...

However, if you have plenty of space (like a spare ~260Gigs laying around) and feel like backing it all up... it won't hurt.

Making a full backup takes as long as it takes to copy the ~260Gigs to your backup location... whatever that might be (external drive, internal drive, network storage etc)
LOL not that what I meant. I will basically try to get to know with those command line things how they work etc etc. It's more like exploring the entire system and getting to know the features.

My drive is 2T so space is not an issue.

Thanks for your input again. I will come back if I face any issue.

Cheers :-)
HCP
legendary
Activity: 2086
Merit: 4361
March 14, 2019, 10:00:21 PM
#23
That depends on what you mean by "play with the system"... Tongue

If you're not trying to manipulate blocks or other data files, then I don't see how you can do anything that would really warrant needing a backup. In any case, if anything goes really bad, you can always simply delete all the data files/blocks/chainstate etc and then simply re-sync...

However, if you have plenty of space (like a spare ~260Gigs laying around) and feel like backing it all up... it won't hurt.

Making a full backup takes as long as it takes to copy the ~260Gigs to your backup location... whatever that might be (external drive, internal drive, network storage etc)
legendary
Activity: 2464
Merit: 3878
Hire Bitcointalk Camp. Manager @ r7promotions.com
March 14, 2019, 08:30:47 PM
#22
Thanks to both HCP and ETFbitcoin especially to HCP. I will need some times to have all this to learn. I have one more question which I think you guys missed.

Shall I save a copy of the entire node before I play with the system or it's not a big deal? I imagine to make a copy of the entire node will also take a long time.

Thanks in advance.

Cheers :-)
HCP
legendary
Activity: 2086
Merit: 4361
March 13, 2019, 03:39:40 PM
#21
Couple of notes to add to what ETFbitcoin has said:

#1 I see backup wallet feature but I do not see any restore option.
Since there are no restore option then how do we do that?
Is this a correct way:
Imagine I have a wallet.dat file from Electrum. Do I just copy and past it in the main directory and replace the current .DAT file?
Firstly... NO! wallet files from Electrum are NOT compatible with Bitcoin Core! You cannot use a wallet.dat file from Electrum.

Also, do not try and restore the wallet.dat file while Bitcoin Core is running. There is a very real potential to corrupt the file. So, when restoring, you need to ensure that Bitcoin Core is not running, then copy the backup version of the file into the data directory, then start Bitcoin Core.



Quote
#2 In Electrum we can create as many wallet as we can using the 12 word seeds and extended seeds.
In Bitcoin core a full node is one wallet?
Bitcoin Core actually does support using multiple wallet files (since v0.15.0.1)... but only the first wallet specified with the -wallet command will be displayed in the GUI. However you will be able to interact with ALL of them from either the commandline (bitcoin-cli) or using the console in the GUI (Help -> Debug Window -> Console).

Refer: https://bitcoin.org/en/release/v0.15.0.1#multi-wallet-support



Quote
#3 How can I create a multiSign wallet? I do not see any feature. I think a full node is only one wallet if the #2 is correct.
Multisig isn't quite as "tidy" as in a wallet like Electrum, it currently requires a lot of manual commands. You don't create a specific "Multisig" wallet as such... but you can create Multisig addresses in any Bitcoin Core wallet by using the createmultsig command (again, using bitcoin-cli or the console]

createmultisig nrequired ["key",...] ( "address_type" )

Creates a multi-signature address with n signature of m keys required.
It returns a json object with the address and redeemScript.

Arguments:
1. nrequired                    (numeric, required) The number of required signatures out of the n keys.
2. "keys"                       (string, required) A json array of hex-encoded public keys
     [
       "key"                    (string) The hex-encoded public key
       ,...
     ]
3. "address_type"               (string, optional) The address type to use. Options are "legacy", "p2sh-segwit", and "bech32". Default is legacy.

Result:
{
  "address":"multisigaddress",  (string) The value of the new multisig address.
  "redeemScript":"script"       (string) The string value of the hex-encoded redemption script.
}

As for spending from Multisig addresses... you can see the process in this walkthru: https://github.com/anders94/bitcoin-2-of-3-multisig



Quote
#4 Is there any easy way to "Send to many" option.
In Electrum we can just paste the addresses separating by comma with the amount in each line but here we do not have such feature. The one we have is click and fill the form which is not much user friendly. Is there any other way?
probably scripting and using the commandline... or the console, but you can't really script that, you could however generate the sendmany command using a script and copy/paste that to the console.



Quote
#5 If I use the encrypt wallet feature then this means the current wallet.dat file gets encrypted. How do I recover it? Follow #1 if my explanation is correct and in this case I will need the password phrase?
It's the same process as Electrum... the GUI will automatically prompt you for the passphrase when it requires access to the encrypted data... you "unlock" the wallet using the walletpassphrase command when you're trying to use the CLI or console.



Quote
#6 If someone want to take the full node from me. I give them everything except the wallet.dat file? I mean which are the files I am okay to give them if they want to get the files from me to run their own full node?
Just give them the "blocks" and "chainstate" folders... they don't require anything else.



Quote
#7 This full node is of-course helping the Bitcoin Network and I am happy with that.
Are you really "helping the Bitcoin Network" tho? Simply running Bitcoin Core is not enough. Is your node actually configured to allow incoming connections? If it is not... you're not really helping.

Refer to the "Network Configuration" section of "Running a Full Node": https://bitcoin.org/en/full-node#network-configuration
legendary
Activity: 2464
Merit: 3878
Hire Bitcointalk Camp. Manager @ r7promotions.com
March 13, 2019, 01:37:42 PM
#20
After the synchronization so far these are the things I am wondering. I will be happy to get responses on these please:

#1 I see backup wallet feature but I do not see any restore option.

Since there are no restore option then how do we do that?
Is this a correct way:
Imagine I have a wallet.dat file from Electrum. Do I just copy and past it in the main directory and replace the current .DAT file?

#2 In Electrum we can create as many wallet as we can using the 12 word seeds and extended seeds.
In Bitcoin core a full node is one wallet?

#3 How can I create a multiSign wallet? I do not see any feature. I think a full node is only one wallet if the #2 is correct.

#4 Is there any easy way to "Send to many" option.
In Electrum we can just paste the addresses separating by comma with the amount in each line but here we do not have such feature. The one we have is click and fill the form which is not much user friendly. Is there any other way?

#5 If I use the encrypt wallet feature then this means the current wallet.dat file gets encrypted. How do I recover it? Follow #1 if my explanation is correct and in this case I will need the password phrase?

#6 If someone want to take the full node from me. I give them everything except the wallet.dat file? I mean which are the files I am okay to give them if they want to get the files from me to run their own full node?

#7 This full node is of-course helping the Bitcoin Network and I am happy with that. My question is that running this full node gives me any personal benefit?
I understand miners earn Bitcoin from the network by solving the algorithm and from transaction fees but for a full noder, is there any financial gain?

Thanks in advance.
legendary
Activity: 2464
Merit: 3878
Hire Bitcointalk Camp. Manager @ r7promotions.com
March 13, 2019, 10:50:52 AM
#19
Finally the synchronization has done.



The total file size is now 224 GB. I want to play with the entire system and before I do that do you think I keep a copy of the current entire folder?
legendary
Activity: 3430
Merit: 3080
March 11, 2019, 03:07:00 PM
#18
I doubt that's being updated any longer, it was superseded by "headers-first" downloading in version 0.10 (parallel downloading didn't work before headers-first. Bittorrent only downloads, it doesn't check the blocks, which is what really takes all the time). Version 0.10 was a very long time ago.

Additionally database format was changed since Core 0.15.0 which means you'll need to wait for database conversion to newer format and verify the blocks.

I've no idea how long it'd take, but probably you will waste more time rather than download whole Blockchain using Bitcoin Core directly.

I think only the chainstate database changed format, and I would assume the torrent file contained only the blocks. It makes no difference anyhow, the torrent is probably not being seeded anymore, and of course using Bitcoin to do the IDB is, as you say, quicker in any case
legendary
Activity: 3066
Merit: 1147
The revolution will be monetized!
March 11, 2019, 02:03:29 PM
#17
I just rebuilt my Linux node machine recently. A full DL of the blockchain took a full week.  Fortunately storage is so cheep that I was able to go with a 3 Terabyte HD. That should hold me for a few years. I like having a dedicated machine like this. I usually shop on a different computer and spend from my node for additional privacy.   

Thanks for contributing to the network's strength and resilience!
legendary
Activity: 2464
Merit: 3878
Hire Bitcointalk Camp. Manager @ r7promotions.com
March 11, 2019, 01:46:50 PM
#16
~snip~

Additionally database format was changed since Core 0.15.0 which means you'll need to wait for database conversion to newer format and verify the blocks.

I've no idea how long it'd take, but probably you will waste more time rather than download whole Blockchain using Bitcoin Core directly.
I was not aware of this newer format. My node is few hours behind to finish the synchronizing. i am happy with the process so far.

Try downloading the blockchain first. Probably to late on response Sad
Download from here? I think you have not read the responses so far.
legendary
Activity: 2464
Merit: 3878
Hire Bitcointalk Camp. Manager @ r7promotions.com
March 11, 2019, 09:51:49 AM
#15
~snip~
All the fibre bandwidth in the world won't help much if you're running on an old dual core CPU with 2 Gigs RAM using a 5400 RPM HDD Tongue

Utterly and butterly true :-P

Anyway, I am hoping finally today the entire synchronization will finish. Around 80k blocks are reaming for my full node. I will then start playing with the system :-)
HCP
legendary
Activity: 2086
Merit: 4361
March 10, 2019, 03:29:13 PM
#14
Not sure if this helps but I found this.

https://bitcoin.org/bin/block-chain/
I doubt that's being updated any longer, it was superseded by "headers-first" downloading in version 0.10 (parallel downloading didn't work before headers-first. Bittorrent only downloads, it doesn't check the blocks, which is what really takes all the time). Version 0.10 was a very long time ago.

Indeed... from the bootstrap.txt file:
Block height: 317000
So you're missing around 250,000 blocks... and the files were uploaded on 24-Aug-2014 01:40 Tongue

As has been mentioned several times, "syncing" the blockchain is NOT just "downloading" blocks... those blocks need to be verified and it is this processing, which is highly CPU and disk IO intensive, that is generally the bottleneck when syncing.

All the fibre bandwidth in the world won't help much if you're running on an old dual core CPU with 2 Gigs RAM using a 5400 RPM HDD Tongue
legendary
Activity: 3430
Merit: 3080
March 10, 2019, 01:07:01 PM
#13
Not sure if this helps but I found this.

https://bitcoin.org/bin/block-chain/

Seems to be a torrent link to the blockchain in bootstrap type format.

I doubt that's being updated any longer, it was superseded by "headers-first" downloading in version 0.10 (parallel downloading didn't work before headers-first. Bittorrent only downloads, it doesn't check the blocks, which is what really takes all the time). Version 0.10 was a very long time ago.
hero member
Activity: 1220
Merit: 612
OGRaccoon
March 10, 2019, 12:30:33 PM
#12
Not sure if this helps but I found this.

https://bitcoin.org/bin/block-chain/

Seems to be a torrent link to the blockchain in bootstrap type format.

there is also reference to this here though the link seems to be changed.

https://bitcointalksearch.org/topic/ann-bitcoin-blockchain-data-torrent-145386

As per the above you should do verification on this if you use it.
legendary
Activity: 3486
Merit: 2287
Top Crypto Casino
March 10, 2019, 11:40:57 AM
#11
Last time I had to sync form scratch took me around 6 hours Wink
But to be honest, I have Fiber Internet with 500/100 connection speed...
Pages:
Jump to: