Running a node dumb question - page 2.

khaled0111

legendary

Activity: 2520

Merit: 2853

Top Crypto Casino

Quote from: Eternad on March 27, 2024, 05:42:38 AM

I notice that blocks are being downloaded while my Bitcoin core wallet is syncing in the form of .dat file which is the same format as my wallet on Electrum. Can anyone explain to me in ELI5 what is this format and how block files differ from my wallet files while they have the same format?

The file extension doesn't matter much, it could be .txt or anything else. What matters is the data stored on those files. blk.dat files contain data related to the blocks and transactions that have been mined while wallet.dat contains data related to your wallet.

Quote

If I have the record of all the block files, why is the syncing process still manually reading all my current blocks which is the same speed as when I downloaded them manually? I did an experiment about this in which I saved all my downloaded blocks and uninstalled my Bitcoin core then I manually put the block file in the directory folder when I reinstalled the new app.

The blockchain, as the name suggests, is a chain of block where each block is connected to the previous one. To verify the validity of the blocks and transactions you have downloaded, your node needs to verify the validity of each of them going back to the genesis block (first block ever mined).

Quote

Is it possible to skip certain blocks like blocks around 2009 to 2012

I believe not for the reason explained above.

Quote

Lastly, What I'm achieving in running a node? Am I helping the blockchain to become more decentralized?

Yes, by running a full node you contribute to the decentralization of the network and by using bitcoin core as your wallet or connecting your wallet to your own full node you improve your anonymity.

BlackHatCoiner

legendary

Activity: 1512

Merit: 7340

Farewell, Leo

Quote from: Eternad on March 27, 2024, 05:42:38 AM

If I have the record of all the block files, why is the syncing process still manually reading all my current blocks which is the same speed as when I downloaded them manually? I did an experiment about this in which I saved all my downloaded blocks and uninstalled my Bitcoin core then I manually put the block file in the directory folder when I reinstalled the new app.

In case you still find it strange, it is verification which takes most of the time. Download speed is pretty neat in almost every part of the world. With an average 10 MB/s, it would take you about just a day to download the blockchain. However, verification might even take a week, depending on your computer resources.

Quote from: Eternad on March 27, 2024, 05:42:38 AM

Lastly, What I'm achieving in running a node? Am I helping the blockchain to become more decentralized?

You know the truth.

You need no third parties to figure out how much money you have. It also a privacy upgrade, since you let no third party scrutinize your Bitcoin activity.

NotATether

legendary

Activity: 1568

Merit: 6660

bitcoincleanup.com / bitmixlist.org

Quote from: Eternad on March 27, 2024, 05:42:38 AM

If I have the record of all the block files, why is the syncing process still manually reading all my current blocks which is the same speed as when I downloaded them manually? I did an experiment about this in which I saved all my downloaded blocks and uninstalled my Bitcoin core then I manually put the block file in the directory folder when I reinstalled the new app.

Quote from: Eternad on March 27, 2024, 05:42:38 AM

Is it possible to skip certain blocks like blocks around 2009 to 2012 and directly download 2013 onwards when I want to start running a Node since I find it inefficient to download everything from the start while the pruning process removes previously downloaded blocks and continues the sync process using the onwards downloaded blocks without the need of the old block.

Bitcoin nodes need to assemble the global UTXO set while they are syncing. This is basically the outputs of every bitcoin address that have not been spent yet. In order to make such a list, it needs to read the blocks in order, without skipping anything so that it can verify that there are no invalid transactions inside a block (which should never happen in theory but you can always edit the .dat file to make such a corruption). That is also why it is reading the blocks even after you save them.

ABCbits

legendary

Activity: 2856

Merit: 7410

Crypto Swap Exchange

Quote from: Eternad on March 27, 2024, 06:56:16 AM

Quote from: ABCbits on March 27, 2024, 05:59:58 AM

I'm not fully understand your question, but you need to copy whole folder (which also contain other stuff such as "chainstate" folder) rather than only block files.

I back up that too including all the files on the file directory for Bitcoin core. I manually pasted all the files that I previously downloaded to the new file directory of Bitcoin Core after I reinstalled the apps. Still, the synchronization of "headers(not sure of the exact word)" is so slow that it almost didn't progress anymore so I just forgot my previous progress and started fresh again.

If it stuck during syncing block header (NOT block), it's probably due to internet connection. There's no need to start fresh again (as in download blockchain from beginning).

Eternad

hero member

Activity: 1176

Merit: 593

When life gets hard BUY Bitcoin!

Quote from: ABCbits on March 27, 2024, 05:59:58 AM

Quote from: Eternad on March 27, 2024, 05:42:38 AM

If I have the record of all the block files, why is the syncing process still manually reading all my current blocks which is the same speed as when I downloaded them manually? I did an experiment about this in which I saved all my downloaded blocks and uninstalled my Bitcoin core then I manually put the block file in the directory folder when I reinstalled the new app.

I'm not fully understand your question, but you need to copy whole folder (which also contain other stuff such as "chainstate" folder) rather than only block files.

I back up that too including all the files on the file directory for Bitcoin core. I manually pasted all the files that I previously downloaded to the new file directory of Bitcoin Core after I reinstalled the apps. Still, the synchronization of "headers(not sure of the exact word)" is so slow that it almost didn't progress anymore so I just forgot my previous progress and started fresh again.

un_rank

hero member

Activity: 644

Merit: 661

- Leo -

Quote from: Eternad on March 27, 2024, 05:42:38 AM

Lastly, What I'm achieving in running a node? Am I helping the blockchain to become more decentralized?

You get to improve your own privacy and the decentralization of the network. Just as with mining, the more divers nodes we have keeping a record of their own mempool, the more decentralized blockchain information is, making the information immutable.

- Jay -

ABCbits

legendary

Activity: 2856

Merit: 7410

Crypto Swap Exchange

Quote from: Eternad on March 27, 2024, 05:42:38 AM

I notice that blocks are being downloaded while my Bitcoin core wallet is syncing in the form of .dat file which is the same format as my wallet on Electrum. Can anyone explain to me in ELI5 what is this format and how block files differ from my wallet files while they have the same format?

~~They just happen to have same extension, the format of those files are different.~~ They have different format and usually Electrum create wallet without extension. If you actually refer to Bitcoin Core's wallet.dat, they just happen to have same extensions.

Quote from: Eternad on March 27, 2024, 05:42:38 AM

If I have the record of all the block files, why is the syncing process still manually reading all my current blocks which is the same speed as when I downloaded them manually? I did an experiment about this in which I saved all my downloaded blocks and uninstalled my Bitcoin core then I manually put the block file in the directory folder when I reinstalled the new app.

I'm not fully understand your question, but you need to copy whole folder (which also contain other stuff such as "chainstate" folder) rather than only block files.

Quote from: Eternad on March 27, 2024, 05:42:38 AM

Is it possible to skip certain blocks like blocks around 2009 to 2012 and directly download 2013 onwards when I want to start running a Node since I find it inefficient to download everything from the start while the pruning process removes previously downloaded blocks and continues the sync process using the onwards downloaded blocks without the need of the old block.

Theoretically it's possible, assuming you have programming skill to modify Bitcoin Core (or other full node) software. But that means you're skipping some verification process which is point of full node.

Eternad

hero member

Activity: 1176

Merit: 593

When life gets hard BUY Bitcoin!

PS; I don't want to spam the challenge thread so I decided to create this thread for my personal question as my curiosity started to go deeper on the technical aspect of running a node.

I notice that blocks are being downloaded while my Bitcoin core wallet is syncing in the form of .dat file which is the same format as my wallet on Electrum. Can anyone explain to me in ELI5 what is this format and how block files differ from my wallet files while they have the same format?
If I have the record of all the block files, why is the syncing process still manually reading all my current blocks which is the same speed as when I downloaded them manually? I did an experiment about this in which I saved all my downloaded blocks and uninstalled my Bitcoin core then I manually put the block file in the directory folder when I reinstalled the new app.
Is it possible to skip certain blocks like blocks around 2009 to 2012 and directly download 2013 onwards when I want to start running a Node since I find it inefficient to download everything from the start while the pruning process removes previously downloaded blocks and continues the sync process using the onwards downloaded blocks without the need of the old block.
Lastly, What I'm achieving in running a node? Am I helping the blockchain to become more decentralized?

I'm completely a noob but I want to explore this so please be gentle in answering my question. Please always use ELI5 format so that I can grasp your idea.

Topic: Running a node dumb question - page 2. (Read 334 times)