Pages:
Author

Topic: Running a full node is starting to be a pain (Read 7366 times)

hero member
Activity: 490
Merit: 500
September 18, 2014, 11:17:00 PM
#74
If you're using the default directory, delete all the stuff in your /users//appdata/roaming/bitcoin folder make a new bitcoin.conf file. After blockchain is done downloading, change maxconnections, also change listen to 1 (if you want), and maybe you need to change keypool to make a majority of addresses you probably wont need to have your wallet bloating

This doesn't make sense. Why would you delete the local blockchain, then download exactly the same thing?

Agreed, this is terrible advice.  The blockchain is 25.5 GB right now, there's no way I'm going to delete & redownload it just for the hell of it.

In any case, I figured out a solution to the problem a little while ago: I ratelimited bitcoin-qt's upload speed to about 1/3 of my bandwidth several days ago in Netbalancer, and then put Netbalancer in my Startup folder so that it'll stay that way.  Seems to have fixed the problem.

I've updated the wiki to mention this issue and explain how I successfully worked around it in Windows.  If anyone has any recommendations for other places to put this information on the wiki that people will be likely to see, please let me know and I'll be happy to add it in there too.
legendary
Activity: 2268
Merit: 1092
September 18, 2014, 10:53:37 PM
#73
If you're using the default directory, delete all the stuff in your /users//appdata/roaming/bitcoin folder make a new bitcoin.conf file. After blockchain is done downloading, change maxconnections, also change listen to 1 (if you want), and maybe you need to change keypool to make a majority of addresses you probably wont need to have your wallet bloating

This doesn't make sense. Why would you delete the local blockchain, then download exactly the same thing?
hero member
Activity: 2147
Merit: 518
September 18, 2014, 04:08:45 PM
#72
I suspect someone started downloading the full blockchain off my full node.  Unfortunately, the effect was that my computer came to a screeching halt: moving the mouse and the pressing keys on my keyboard had absolutely no effect for several minutes.  When I regained use of my computer, I looked in the Task Manager and bitcoin-qt was using the most RAM, and a fair amount of processing power was being used as well.  I turned off bitcoin-qt and the problem went away; anecdotally, I'd say that's reason to believe that running the bitcoin-qt client was causing the problem.

So a little bit about my specs, both internet and computer: I'm using an internet connection of 25 Mbps down / 1.5 Mbps up - reasonable download speed (unfortunately I don't live in an area where gigabit internet is available), but not much on the upload front.  My computer has 5 GB of RAM, 250 GB of hard drive space, and a 3 Ghz processor speed.  The only part of my computer itself that I feel is underpowered is the RAM, I plan on eventually upgrading to 20 GB RAM, but haven't gotten around to it yet.

So here's my question: is there something about the way the bitcoin client is built that causes my computer to freeze up when people start to download the blockchain from me?  Or is this just a case of me not having enough upload bandwidth to handle someone downloading a full node from me?  I'd love to be able to support the network by running the bitcoin-qt client regularly, but this is starting to happen semi-regularly as bitcoin becomes more popular and I don't feel like my computer is THAT underpowered.
If you're using the default directory, delete all the stuff in your /users//appdata/roaming/bitcoin folder make a new bitcoin.conf file. After blockchain is done downloading, change maxconnections, also change listen to 1 (if you want), and maybe you need to change keypool to make a majority of addresses you probably wont need to have your wallet bloating
hero member
Activity: 490
Merit: 500
September 18, 2014, 01:49:07 AM
#71
Yeah, I found that discussion a while ago, am a bit frustrated that nothing seems to be done about it.
Lots of things are being done about it, but they're not done yet. Wheres your contribution?

Not much, I admit, so maybe I'll just update the wiki to let people know how to work around it (in Windows, anyway).  I'd happily fix it myself, but after reading the whole discussion on github about it, I'm pretty sure that I don't have the technical know how to do it.  And I'd rather just let it continue to be an issue than submit a patch that just makes things worse.

So thanks for your work on it, I appreciate it.
staff
Activity: 4284
Merit: 8808
September 17, 2014, 02:10:47 PM
#70
Yeah, I found that discussion a while ago, am a bit frustrated that nothing seems to be done about it.
Lots of things are being done about it, but they're not done yet. Wheres your contribution?
legendary
Activity: 1358
Merit: 1001
https://gliph.me/hUF
September 17, 2014, 01:11:57 PM
#69
As a similar stopgap measure, Bitcoin Core provides a Quality of Service bash script for Linux users that will throttle bandwidth usage. https://github.com/bitcoin/bitcoin/tree/master/contrib/qos

Or use trickle
newbie
Activity: 25
Merit: 66
September 17, 2014, 01:06:39 PM
#68
As a similar stopgap measure, Bitcoin Core provides a Quality of Service bash script for Linux users that will throttle bandwidth usage. https://github.com/bitcoin/bitcoin/tree/master/contrib/qos
hero member
Activity: 490
Merit: 500
September 17, 2014, 08:37:32 AM
#67
I wonder why there isn't more effort put in the direction of implementing QoS mechanisms (like throttling blockchain downloads) in the protocol. After all, the network as a whole does not become more efficient when single nodes hog down other nodes due to misconfigured blockchain downloading.

It's complicated. TL;DR the consensus is that first we need to fix the inefficiencies in how Bitcoin Core transmits data, as that could alleviate many of the problems. Here's the 3 year long debate on the subject: https://github.com/bitcoin/bitcoin/issues/273

Yeah, I found that discussion a while ago, am a bit frustrated that nothing seems to be done about it.  Just throttled bitcoin-qt's upload bandwidth to 300k with Netbalancer, about 1/3 of my maximum upload speed and it seems to be helping my computer run a lot faster than it used to be, so it looks like I won't be needing that RAM upgrade after all.  Netbalancer is free - in case any other Windows users are having this problem, though the free version will only let you shape the bandwidth of three processes, that's plenty for me since bitcoin-qt is the only one giving me grief.
newbie
Activity: 25
Merit: 66
September 12, 2014, 07:46:40 AM
#66
I wonder why there isn't more effort put in the direction of implementing QoS mechanisms (like throttling blockchain downloads) in the protocol. After all, the network as a whole does not become more efficient when single nodes hog down other nodes due to misconfigured blockchain downloading.

It's complicated. TL;DR the consensus is that first we need to fix the inefficiencies in how Bitcoin Core transmits data, as that could alleviate many of the problems. Here's the 3 year long debate on the subject: https://github.com/bitcoin/bitcoin/issues/273
hero member
Activity: 658
Merit: 502
September 11, 2014, 06:05:42 AM
#65
Start the client with the option "-bind=127.0.0.1". You can connect to another people for download but another people cannot connect and download from you.

If everyone did that the entire network would shudder to a halt. This is not good advice.

Exactly.


Depends on finally usage. If you up a node for support the network maybe you don't need this, but if you need to give a BTC services and want to hide the client this is a good way.



FaSan
hero member
Activity: 518
Merit: 502
September 11, 2014, 05:51:12 AM
#64
Start the client with the option "-bind=127.0.0.1". You can connect to another people for download but another people cannot connect and download from you.

If everyone did that the entire network would shudder to a halt. This is not good advice.

Exactly.
hero member
Activity: 490
Merit: 500
September 11, 2014, 02:50:09 AM
#63
Start the client with the option "-bind=127.0.0.1". You can connect to another people for download but another people cannot connect and download from you.

FaSan

I'd really rather use NetBalancer to rate limit bitcoin-qt if I were going to do that than kill connections altogether.  Which, imho, really ought to be built into the bitcoin-qt client, but that's another matter entirely.  I'll do that if it becomes necessary, but so far, most of the problem - I think the hard drive upgrade / replacement mostly fixed the problem. 
legendary
Activity: 1652
Merit: 1016
September 11, 2014, 02:17:05 AM
#62
Start the client with the option "-bind=127.0.0.1". You can connect to another people for download but another people cannot connect and download from you.

If everyone did that the entire network would shudder to a halt. This is not good advice.
legendary
Activity: 2268
Merit: 1092
September 10, 2014, 11:26:54 PM
#61
Start the client with the option "-bind=127.0.0.1". You can connect to another people for download but another people cannot connect and download from you.

-listen=0 will also disable inbound connections. Probably makes a bit more sense. Smiley
hero member
Activity: 518
Merit: 502
September 10, 2014, 10:21:19 AM
#60
Start the client with the option "-bind=127.0.0.1". You can connect to another people for download but another people cannot connect and download from you.

Which is of course exactly what you want when setting up a node for supporting the bitcoin network...  Wink
hero member
Activity: 658
Merit: 502
September 10, 2014, 09:30:15 AM
#59
I suspect someone started downloading the full blockchain off my full node.  Unfortunately, the effect was that my computer came to a screeching halt: moving the mouse and the pressing keys on my keyboard had absolutely no effect for several minutes.  When I regained use of my computer, I looked in the Task Manager and bitcoin-qt was using the most RAM, and a fair amount of processing power was being used as well.  I turned off bitcoin-qt and the problem went away; anecdotally, I'd say that's reason to believe that running the bitcoin-qt client was causing the problem.

So a little bit about my specs, both internet and computer: I'm using an internet connection of 25 Mbps down / 1.5 Mbps up - reasonable download speed (unfortunately I don't live in an area where gigabit internet is available), but not much on the upload front.  My computer has 5 GB of RAM, 250 GB of hard drive space, and a 3 Ghz processor speed.  The only part of my computer itself that I feel is underpowered is the RAM, I plan on eventually upgrading to 20 GB RAM, but haven't gotten around to it yet.

So here's my question: is there something about the way the bitcoin client is built that causes my computer to freeze up when people start to download the blockchain from me?  Or is this just a case of me not having enough upload bandwidth to handle someone downloading a full node from me?  I'd love to be able to support the network by running the bitcoin-qt client regularly, but this is starting to happen semi-regularly as bitcoin becomes more popular and I don't feel like my computer is THAT underpowered.


Start the client with the option "-bind=127.0.0.1". You can connect to another people for download but another people cannot connect and download from you.



FaSan
legendary
Activity: 1358
Merit: 1001
https://gliph.me/hUF
September 10, 2014, 09:25:14 AM
#58
Are the bursts whenever a block comes along?

I have good success running bitcoind with some niceness.
hero member
Activity: 616
Merit: 503
★Bitvest.io★ Play Plinko or Invest!
September 10, 2014, 08:52:41 AM
#57
Isn't it possible that devs "compact" more than 1 year old transations into a simple text file.
It would be like
on 1.1.2013
12trbdk.....  has x.xxx BTC
1bvdsh...... has x.xxx BTC
etc

confirming these transactions has no interest so this would make things much quicker and reduce CPU and bandwidth usage.
hero member
Activity: 560
Merit: 509
I prefer Zakir over Muhammed when mentioning me!
September 10, 2014, 08:18:51 AM
#56
I also noticed a lag when bitcoind runs on my desktop. It's mostly IO related, and it is
noticeable when opening new programs etc. Sometimes the whole computer freezes for a while.
It's an older i5, 4 [email protected], with 8GB ddr3 ram. Bitcoind eats about 1GB of memory,
which doesn't seem to be that much. I am on linux, btw.

But of course, this is all just a very subjective impression - no idea how to measure it.
I have the impression bitcoind is quite "bursty" in its disk access, regularly going over
60% in iotop. I've been noticing (and complaining about) this since a while, but maybe
I should sit down and try to quantify this one of these days. No idea though how to
do that, suggestions appreciated.


Do your motherboard support ddr3? It may work but just check it whether it works completely. My graphics card is ddr3 and my ram is ddr2 and there is some problem due to that. So just check it.

  ~~MZ~~
hero member
Activity: 518
Merit: 502
September 10, 2014, 04:28:49 AM
#55
I also noticed a lag when bitcoind runs on my desktop. It's mostly IO related, and it is
noticeable when opening new programs etc. Sometimes the whole computer freezes for a while.
It's an older i5, 4 [email protected], with 8GB ddr3 ram. Bitcoind eats about 1GB of memory,
which doesn't seem to be that much. I am on linux, btw.

But of course, this is all just a very subjective impression - no idea how to measure it.
I have the impression bitcoind is quite "bursty" in its disk access, regularly going over
60% in iotop. I've been noticing (and complaining about) this since a while, but maybe
I should sit down and try to quantify this one of these days. No idea though how to
do that, suggestions appreciated.
Pages:
Jump to: