Author

Topic: Full relay : cost and benefits (Read 374 times)

hero member
Activity: 1680
Merit: 987
#SWGT CERTIK Audited
September 12, 2023, 04:39:08 PM
#26
Good day all,

Maintaining the entire blockchain ledger and running a full relay by general public is a crucial, foundational aspect of BTC. It's also a substantial commitment in storage, bandwidth and increased need for security. While IMHO those who can, should do it as a public service, there's also a possibility of network somehow compensating those who maintain full ledger. I wonder if this has ever been pondered : can it be done in a way that would incentivize it for individual, independent users vs corporate agents with quasi-unlimited resources ? What are the downsides and upsides beyond obvious ? What does the future hold - what will full ledger look like in a decade from now and how viable will it be then for Joe Internet to keep it on his home network ? Has anyone considered a compression algo that would specialize in good blockchain performance ?

Currently (2023) full ledger is about 435 Gb.  Bandwidth consumption of 200G/month in UPLOADS is reported norm, if left unchecked. I feel a systemic risk to the network that may drift momentum towards large users with unlimited storage and bandwidth in a way that may jeopardize security and decentralized nature of the network.

On other hand, how critical is most of that data to stability and security of the blockchain ? Perhaps my concerns are out of ignorance and it will do just fine when less then 0.01% of all self-hosted nodes maintain a full copy.

With respect
unixux


Actually there are thousand ways to centralize blockchain projects:

1)Mining hardware monopoly: now all the main mining facilities are equipped with specific devices, PCs and/or other devices for everyday use are no more efficient in terms of mining. Control over service and production of mining devices makes blockchain technology centralised.

2)Mining software monopoly: the same story.

3)Wallet software monopoly: control over wallets is also the way to centralisation.

4)Exchange to fiat control: now nearly none business initiatives accept BTC directly, so the only way to use cryptomoney now is to exchange it for fiat. Moreover, legal status of cryptocurrencies is still unclear ewerywhere. So high degree of centralisation will persist as long as the adoption level is this low.

5)Whales become tycoons and rule the whole system. Cryptomoney distribution will be a problem if adoption level raises tremendously. The same thing we can observe in dollar and other fiat money systems: so called "10% of population controls 90% of money" principle. Crypto is also vulnerable to this disaster.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
July 31, 2023, 03:31:14 AM
#25
I know people who get 1GB of data per day on their mobile internet and don't have access to Fiber/Wired Connections.
1 GB/day mobile data is still a lot. Just don't use streaming Wink
If they really want to use their own full node, they can get a VPS and run their own Electrum server. But it's much easier to use one of the many existing Electrum servers. Many Bitcoin users with fast, unlimited internet don't run their own node anyway.
legendary
Activity: 3038
Merit: 4418
Crypto Swap Exchange
July 30, 2023, 12:23:25 PM
#24
This. I am talking about the accessibility of downloading the Bitcoin Blockchain from the first transaction to the latest is not for everyone and I stand true, I know people who get 1GB of data per day on their mobile internet and don't have access to Fiber/Wired Connections. It will take them 550 Days to download the whole blockchain and by then, new blocks will be added and more data will be required to be downloaded. I am not exaggerating anything, just telling the real situation.
That is a very specific use-case of Bitcoin. Generally, for people to use Bitcoin, they don't have to use full nodes. Full nodes are resource intensive by design and it is practically not possible to go around that requirement. If you're in an extremely bandwidth constricted environment, do use an SPV wallet if you cannot synchronize your wallet with Bitcoin Core.

Satellite and mobile data are generally very unstable and unreliable. I would argue that having them on the network serves no tangible benefits to the rest. Constant disconnections results in nodes connecting and disconnecting intermittently which wouldn't be very useful for nodes who are bootstrapping.
copper member
Activity: 1470
Merit: 1609
Bitcoin Bottom was at $15.4k
July 30, 2023, 11:39:29 AM
#23
I never knew the storage space required to manage a full node now is near ~ 500 GB. That's crazy I would say, someone from a third world country with a poor internet connection might not be able to set it up for himself or herself when it's 500 GB, they might get timed out by their Internet Service Provider, doesn't that make it only First World Country ability to run a full node? They should work on it's optimization and make it available for everyone who belives in Bitcoin.

You're exaggerating. Unless the ISP offer very low data cap or FUP, downloading ~500GB blockchain is possible, although it would take some time. When i initially run full node, i remember it took few weeks to download whole blockchain.

youre forgetting those of us who have no wired service. its all satellite/4g in our world. it would take literally many, many months to sync from genesis.

my issue is bandwidth and data caps, not storage. and im sure im not alone. 1st world status means nothing when the nearest infrastructure is miles away.

This. I am talking about the accessibility of downloading the Bitcoin Blockchain from the first transaction to the latest is not for everyone and I stand true, I know people who get 1GB of data per day on their mobile internet and don't have access to Fiber/Wired Connections. It will take them 550 Days to download the whole blockchain and by then, new blocks will be added and more data will be required to be downloaded. I am not exaggerating anything, just telling the real situation.
legendary
Activity: 4354
Merit: 3614
what is this "brake pedal" you speak of?
July 30, 2023, 06:02:19 AM
#22
my issue is bandwidth, not storage and im sure im not alone.
How about keeping up with new blocks? That takes about 6-16 GB per month. Isn't that too much already? I wouldn't want to do that on mobile data.

i ran core overnight and shut it down during the day as my internet was basically unusable when core was syncing.

50 gb/month was one cap i lived under for many years.






legendary
Activity: 1512
Merit: 7340
Farewell, Leo
July 30, 2023, 05:44:25 AM
#21
its not even 20 HD movies
Lol, what kind of movies are you watching? 30 GB+ each is craze, even for 4k.

if a transaction is $2 and a nigerians real world income is $0.30 an hour. they would have to work most of a whole day just to pay a fee to use bitcoin..
What to do about that. This is the cost nevertheless. If you can't give $2 for a couple of transactions, then bitcoin isn't in your favor. These $2 can't just go disappeared, unless we raise the block size to an extent that it'll stop being decentralized sooner or later.

Do we have any data from what Nigerian banks charge for transactions?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
July 30, 2023, 05:33:25 AM
#20
my issue is bandwidth, not storage and im sure im not alone.
How about keeping up with new blocks? That takes about 6-16 GB per month. Isn't that too much already? I wouldn't want to do that on mobile data.
legendary
Activity: 4354
Merit: 3614
what is this "brake pedal" you speak of?
July 30, 2023, 05:27:10 AM
#19
I never knew the storage space required to manage a full node now is near ~ 500 GB. That's crazy I would say, someone from a third world country with a poor internet connection might not be able to set it up for himself or herself when it's 500 GB, they might get timed out by their Internet Service Provider, doesn't that make it only First World Country ability to run a full node? They should work on it's optimization and make it available for everyone who belives in Bitcoin.

You're exaggerating. Unless the ISP offer very low data cap or FUP, downloading ~500GB blockchain is possible, although it would take some time. When i initially run full node, i remember it took few weeks to download whole blockchain.

youre forgetting those of us who have no wired service. its all satellite/4g in our world. it would take literally many, many months to sync from genesis.

my issue is bandwidth and data caps, not storage. and im sure im not alone. 1st world status means nothing when the nearest infrastructure is miles away.



legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
July 30, 2023, 01:46:58 AM
#18
reasons nigerian countries are reluctant to USE bitcoin is the FEE's per transaction
if a transaction is $2
And if a transaction costs $200 it's difficult everywhere. But currently, a small Bitcoin transaction gets a fast confirmation for only $0.20, so your argument isn't very strong.
legendary
Activity: 4410
Merit: 4766
July 29, 2023, 05:35:05 PM
#17
reasons nigerian countries are reluctant to USE bitcoin is the FEE's per transaction
if a transaction is $2 and a nigerians real world income is $0.30 an hour. they would have to work most of a whole day just to pay a fee to use bitcoin..
.. this is why even when other payment subnetworks based on bitcoin tried to adopt nigerians. the nigerians pulled away too becasue even the onramp (lock in fee) from bitcoin to subnetwork was a turn off
it had nothing to do with device cost.

most people with internet access have a device and not everyone is required to be a full node. but if your not even going to USE the network, then your definitely not going to keep your device on to support a network you dont even use.

so the key is to ensure people get to USE the network to then want to SUPPORT the network security

places like el salvador and africa tried the subnetwork that pretends to promote bitcoin . but they fell into traps of never being able to unlock funds out of the subnetwork and didnt like the issues of fee cost of bitcoin when they did unlock(in small occasions) those example countries ended up using centralised exchanges as their fund custodians and just avoiding USING the subnetworks enticing them with lower fees entirely, thus avoided supporting the security and decentralisation of the not only the cheaper subnetwork pretense, but also the actual bitcoin network entirely
sr. member
Activity: 420
Merit: 315
Top Crypto Casino
July 29, 2023, 02:13:29 PM
#16

The strength of bitcoin is based on its decentralization so it will be higher if the nodes are higher and scattered into different individuals so if a substantial portion of the network is controlled by a group with opposing values, it may create distrust among users and investors. This loss of trust could result in decreased confidence in Bitcoin's utility and long-term viability.
Opposing view is vital in Bitcoin decentralization.
Supporting views might create an hive.
Which would require a queen bee.
Even in the political system it check and balance power.
More opposing nodes would reduce efficiency
But would boost effectives.
Quote
But even if you get only 7 Mbit/s in for instance Nigeria, you'll still be able to download the full blockchain in a week if there's no bandwidth limit (I can't find any data on bandwidth limits per country).
I believe its at least more than 15.7million Mbps.
Which was recorded by a company around 2021.
I'm not sure there's any full node user in Nigeria.
Not to mention we kinda skeptical
Towards 5g network.
Due to belief that it releases more radiation
Than other network.
So 4G is more popular here.
Quote
I feel a systemic risk to the network that may drift momentum towards large users with unlimited storage and bandwidth in a way that may jeopardize security and decentralized nature of the network.
Yeah I understand your view.
Fortunately technological development isn't stagnant.
The faster the growth the cheaper the previous version's.
As long as technology growth is higher than Bitcoin's.
I would say there's nothing to worry about
I still believe scalability as a bigger issue for Bitcoin currently.
legendary
Activity: 4410
Merit: 4766
July 29, 2023, 11:56:09 AM
#15
funny thing is 600GB is not even 10 PS4 games
its not even 20 HD movies
so if you are worried about bitcoins international currency network of 14 years of existence. then you certainly must worry about a couple weeks worth of HD movies
ImThour isn't talking about the countries where downloading HD movies is the standard. I estimate our household consumes about 500 GB (one Bitcoin blockchain) per month, and that's totally fine even though my internet speed is under the country's average.
But even if you get only 7 Mbit/s in for instance Nigeria, you'll still be able to download the full blockchain in a week if there's no bandwidth limit (I can't find any data on bandwidth limits per country).

I don't think this is much of a problem. If you can't download 500 GB, or don't even have a PC: use Electrum or any other trusted light wallet.

most developing countries skipped passed the old days of copper wire, and went straight to 5G, where most people stream movies instead of cable..

as for other instances of fake scares.. majority of the world play online games and live stream it, meaning alot of bandwidth. no one is screaming blue murder that the games industry is broke and requires someone to own a server farm
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
July 29, 2023, 11:36:26 AM
#14
I never knew the storage space required to manage a full node now is near ~ 500 GB. That's crazy I would say, someone from a third world country with a poor internet connection might not be able to set it up for himself or herself when it's 500 GB, they might get timed out by their Internet Service Provider, doesn't that make it only First World Country ability to run a full node? They should work on it's optimization and make it available for everyone who belives in Bitcoin.
What do you suggest "they" do about it? The trivial solution is getting a better internet connection, which will take time. It's much easier just use a light wallet instead of a full node. The blockchain can't be made smaller than it is without being trustless.

funny thing is 600GB is not even 10 PS4 games
its not even 20 HD movies
so if you are worried about bitcoins international currency network of 14 years of existence. then you certainly must worry about a couple weeks worth of HD movies
ImThour isn't talking about the countries where downloading HD movies is the standard. I estimate our household consumes about 500 GB (one Bitcoin blockchain) per month, and that's totally fine even though my internet speed is under the country's average.
But even if you get only 7 Mbit/s in for instance Nigeria, you'll still be able to download the full blockchain in a week if there's no bandwidth limit (I can't find any data on bandwidth limits per country).

I don't think this is much of a problem. If you can't download 500 GB, or don't even have a PC: use Electrum or any other trusted light wallet.
legendary
Activity: 4410
Merit: 4766
July 29, 2023, 11:02:27 AM
#13
I never knew the storage space required to manage a full node now is near ~ 500 GB. That's crazy I would say, someone from a third world country with a poor internet connection might not be able to set it up for himself or herself when it's 500 GB, they might get timed out by their Internet Service Provider, doesn't that make it only First World Country ability to run a full node? They should work on it's optimization and make it available for everyone who belives in Bitcoin.

its not a <600gb per session
its currently 600GB for 14 years of data. which does not need to be downloaded repeatedly each time you load the software.

funny thing is 600GB is not even 10 PS4 games
its not even 20 HD movies
so if you are worried about bitcoins international currency network of 14 years of existence. then you certainly must worry about a couple weeks worth of HD movies

there are already litenodes that dont need full archiving so its not a pre requisite for everyone to NEED to be a full node. but for those that want and desire to be. those that want to be should not be FUD'ed into scare tactics that it requires a factory of servers just to run bitcoin as a full node. becasue its not a situation of needing to run a server just to be a full node
copper member
Activity: 1470
Merit: 1609
Bitcoin Bottom was at $15.4k
July 29, 2023, 10:34:42 AM
#12
I never knew the storage space required to manage a full node now is near ~ 500 GB. That's crazy I would say, someone from a third world country with a poor internet connection might not be able to set it up for himself or herself when it's 500 GB, they might get timed out by their Internet Service Provider, doesn't that make it only First World Country ability to run a full node? They should work on it's optimization and make it available for everyone who belives in Bitcoin.
sr. member
Activity: 2520
Merit: 280
Hire Bitcointalk Camp. Manager @ r7promotions.com
July 29, 2023, 09:56:00 AM
#11

if nodes are of a substantial portion of a cult that only sees one path.. then only one path is always followed(like sheep).. it works great when that path has benefits for everyone.. but when that path has flaws. the cult will follow it anyway and not want the flaws fixed due to trust and belief of their dev gods are delay, avoiding and evading for the good of their cult(blind faith).

decentralisation works best when opposing views can atleast units and contribute and agree and consent to a fair balance any majority can accept. thus opposing something even a diverse majority of open minded opposers think are not of benefit. and also not depending on god like creature to blindly believe in. but instead have options to progress to a new path if the cultish path is going down the wrong path


Running our own nodes has its own benefits as well not just to the network and also for the users it just provides the opportunity to verify their transactions on their own without needs data from others which means your privacy is preserved while making the overall network to be more resilient and decentralized.
legendary
Activity: 4410
Merit: 4766
July 29, 2023, 09:43:35 AM
#10
Bitcoin's strength is in the hands of its users. Bitcoin will thrive despite its size, complexity, and skepticism so long as there is a committed user base that believes in its promise.

The strength of bitcoin is based on its decentralization so it will be higher if the nodes are higher and scattered into different individuals so if a substantial portion of the network is controlled by a group with opposing values, it may create distrust among users and investors. This loss of trust could result in decreased confidence in Bitcoin's utility and long-term viability.

It is very important to have the more nodes of the network to determine its decentralization or else we may see censorship over the transactions.

if nodes are of a substantial portion of a cult(brand) that only sees one path.. then only one path is always followed(like sheep).. it works great when that path has benefits for everyone.. but when that path has flaws. the cult will follow it anyway and not want the flaws fixed due to trust and belief of their dev gods. where the blind belief and trust are: delays, avoiding and evading for the good of their cult(blind faith).

decentralisation works best when opposing views can atleast unite and contribute and agree and consent to a fair balance any majority can accept. thus even opposing something even a diverse majority of open minded opposers think are not of benefit. but agreeing to thing even opposers see as benefit of the majority.. and also not depending on god like creatures to blindly believe in. but instead have options to progress to a new path if the cultish path is going down the wrong path

sr. member
Activity: 2520
Merit: 280
Hire Bitcointalk Camp. Manager @ r7promotions.com
July 29, 2023, 09:29:22 AM
#9
Bitcoin's strength is in the hands of its users. Bitcoin will thrive despite its size, complexity, and skepticism so long as there is a committed user base that believes in its promise.

The strength of bitcoin is based on its decentralization so it will be higher if the nodes are higher and scattered into different individuals so if a substantial portion of the network is controlled by a group with opposing values, it may create distrust among users and investors. This loss of trust could result in decreased confidence in Bitcoin's utility and long-term viability.

It is very important to have the more nodes of the network to determine its decentralization or else we may see censorship over the transactions.
legendary
Activity: 4410
Merit: 4766
July 29, 2023, 06:24:28 AM
#8
so concentrate on debates about bringing the cost of using bitcoin down becasue the cost of storing bitcoin is not unmanageable
It goes hand in hand though: if Bitcoin blocks would be an order of magnitude larger, transactions would be cheap for a while, but the required storage would grow much faster.

you dont even need to shout bigger blocks.. (its time you drop the cult narrative)
you dont need to shout its 1999 and storage is limited.. (its time you drop the cult narrative) its 2023

even if you dont want to use a microSD card the size of a fingertip and went for more conventional hard drives. you can get more then 1TB for under $100 in this modern age of post millenial mindset. remember its 2023 not 1990s

anyways

if the byte miscounting cludge and the segregation separation were to be removed and everything went to a lean legacy tx format of utilising the SAME 4mb space per block allowed today.. the storage would grow at the same rate as today.. not faster. and the amount of tx count per day would grow meaning the cost per transaction would come down

also it would stop the ordinal scam tx's from being in blocks meaning even more room for genuine transactors

along with a better fee formulation than the current:  legacy *4. and instead have utxo age <70= *100 would penalise other types of spammers too.. meaning less spammers and only penalise spammers for premium fees. would reduce fees even more and make more room for genuine transactions to take priority thus allowing more people to get priority sooner rather being treated as second class users. thus make people want to be active and help support the network and want to run nodes more regularly.. all without "required storage would grow much faster"

again looking at a 4mb block space as being the equivalent of 208gb per year (1tb /5 year) meaning $0.06 a day storage cost comparing to todays ~$2 per tx FEE cost... its the FEES that make less people want to use bitcoin daily as most people on the internet already paid for a modern device just to get online so the device cost is not really a main thought.. its the utility of a payment system cost per use.
when fees are over 30x more then storage and storage comes as standard with most devices these days.. storage is not the main concern
hero member
Activity: 1316
Merit: 561
Leading Crypto Sports Betting & Casino Platform
July 29, 2023, 06:19:33 AM
#7
The complete blockchain ledger is, indeed, quite large. Yes, a lot of time and money are needed. The majority of the nodes may ultimately be controlled by a few large organizations. Is that truly a negative thing, though? Its easy to get lost in the weeds and start worrying about every little thing. Perhaps major firms will be able to exert more influence. Perhaps they will alter Bitcoin into something completely different. Or maybe, just maybe, they'll aid in its development and steadiness. It has nothing to do with incentives or algorithms, but rather the network's general trajectory. Bitcoin's strength is in the hands of its users. Bitcoin will thrive despite its size, complexity, and skepticism so long as there is a committed user base that believes in its promise.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
July 29, 2023, 01:46:52 AM
#6
It's also a substantial commitment in storage, bandwidth and increased need for security.
You need security for your funds, but it's less important if you only run a node to support the network. If it gets compromised, nothing is lost.

One of the options I have considered in the past is to find a way to distribute the original/full copy of the Bitcoin blockchain on cheap storage devices for offline sharing worldwide. People can just buy or get them for free, install on their computers and join the Bitcoin Network. But I think it would be necessary for the offline copies to be verified as authentic before they are allowed to become part of the Network. Maybe hashing the full copy of the Blockchain and verifying the hash, or/and resyncing would solve this.
That would only be useful in places with limited internet access, and for those places, downloading up to 0.5 GB per day just to keep the node updated may be too much already.

so concentrate on debates about bringing the cost of using bitcoin down becasue the cost of storing bitcoin is not unmanageable
It goes hand in hand though: if Bitcoin blocks would be an order of magnitude larger, transactions would be cheap for a while, but the required storage would grow much faster.
legendary
Activity: 4410
Merit: 4766
July 28, 2023, 04:37:19 PM
#5
currently storing 14 years of international currency and the next 4years+ requires


the real concern is not storage cost

the cost to store YEARS of data become pennies per day
however if it costs dollars just to make a transaction. people wont want to use the network daily thus wont want to run a node on the network

transaction cost per daily use is more important factor than blockchain storage cost per decade

do the math
if you can by 1tb storage for say $100 knowing you might need to upgrade every 8 years.. (lets use 5 for convenience)
thats $0.06 a day

compare that to doing 1 transaction per day at $2 to warrant having a PC on each day.
the cost of using bitcoin is over 30x more then the cost of storing bitcoins blockchain

so concentrate on debates about bringing the cost of using bitcoin down becasue the cost of storing bitcoin is not unmanageable
Ucy
sr. member
Activity: 2674
Merit: 403
Compare rates on different exchanges & swap.
July 28, 2023, 10:49:33 AM
#4
One of the options I have considered in the past is to find a way to distribute the original/full copy of the Bitcoin blockchain on cheap storage devices for offline sharing worldwide. People can just buy or get them for free, install on their computers and join the Bitcoin Network. But I think it would be necessary for the offline copies to be verified as authentic before they are allowed to become part of the Network. Maybe hashing the full copy of the Blockchain and verifying the hash, or/and resyncing would solve this.


Edit: every community, town, city allover the World could do well to have atleast 2 or 3 persons or node runners who can afford to run a fully synced Bitcoin chain on daily basis . These persons can serve as main Blockchain file distributors/sharers, transaction verifiers etc, for the rest of the Community without full nodes
hero member
Activity: 994
Merit: 1089
July 28, 2023, 10:10:26 AM
#3
Full nodes are major contributors to the BTC network, contributing to the safety and efficiency of the network is incentivizing already. There are other advantages to running a full node, like full 'independence' and privacy; you can validate transactions locally and you don't have to connect to third party servers. If the incentives you are looking for is through earning, there is none, but you can always buy mining gears and try competing for blocks.
hero member
Activity: 2366
Merit: 793
Bitcoin = Financial freedom
July 28, 2023, 09:52:41 AM
#2
Running full Node doesn't give any incentives like mining and also it has been discussed in the past about incentivizing full node operators but implementing such changes would require careful consideration to avoid unintended consequences. So all the nodes running are driven in the sense of contributing to the network.

But having your own full node gives you complete privacy, and mitigates the reliance on someone's information.

Alternatively, you can find ways to run nodes in the most efficient ways and already an idea proposed by @n0nce

[Guide] How to run a Bitcoin Core full node for under 50 bucks!
newbie
Activity: 1
Merit: 3
July 28, 2023, 09:46:03 AM
#1
Good day all,

Maintaining the entire blockchain ledger and running a full relay by general public is a crucial, foundational aspect of BTC. It's also a substantial commitment in storage, bandwidth and increased need for security. While IMHO those who can, should do it as a public service, there's also a possibility of network somehow compensating those who maintain full ledger. I wonder if this has ever been pondered : can it be done in a way that would incentivize it for individual, independent users vs corporate agents with quasi-unlimited resources ? What are the downsides and upsides beyond obvious ? What does the future hold - what will full ledger look like in a decade from now and how viable will it be then for Joe Internet to keep it on his home network ? Has anyone considered a compression algo that would specialize in good blockchain performance ?

Currently (2023) full ledger is about 435 Gb.  Bandwidth consumption of 200G/month in UPLOADS is reported norm, if left unchecked. I feel a systemic risk to the network that may drift momentum towards large users with unlimited storage and bandwidth in a way that may jeopardize security and decentralized nature of the network.

On other hand, how critical is most of that data to stability and security of the blockchain ? Perhaps my concerns are out of ignorance and it will do just fine when less then 0.01% of all self-hosted nodes maintain a full copy.

With respect
unixux
Jump to: