Author

Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool - page 421. (Read 2591964 times)

full member
Activity: 322
Merit: 101
What could be worng if the local hashrate is higher than total p2pool hashrate ? ;/
hero member
Activity: 630
Merit: 501
Has anyone ever seen their P2Pool show "no shares yet" under the Active Miners on This Node?

I am seeing this on my Bitcoin P2Pool, also I am seeing the entire pool hashrate has dropped steeply to 99TH/s.

sr. member
Activity: 434
Merit: 250
I've put in a pull request to fix the problem with vardiff sending out 0 diff work that causes some GPU miners to spew endless HWs.

https://github.com/forrestv/p2pool/pull/185/files
legendary
Activity: 2968
Merit: 1198
It's in data/coinname/log

Thank you.


2014-02-28 09:21:58.696997 > Error while processing Event callbacks:
2014-02-28 09:21:58.697274 > Traceback (most recent call last):
2014-02-28 09:21:58.697372 >   File "/home/p2pool/p2pool/p2pool/p2p.py", line 282, in handle_shares
2014-02-28 09:21:58.697467 >     self.node.handle_shares(result, self)
2014-02-28 09:21:58.697555 >   File "/home/p2pool/p2pool/p2pool/node.py", line 48, in handle_shares
2014-02-28 09:21:58.697869 >     self.node.set_best_share()
2014-02-28 09:21:58.697977 >   File "/home/p2pool/p2pool/p2pool/node.py", line 297, in set_best_share
2014-02-28 09:21:58.698067 >     self.best_share_var.set(best)
2014-02-28 09:21:58.698153 >   File "/home/p2pool/p2pool/p2pool/util/variable.py", line 74, in set
2014-02-28 09:21:58.698240 >     self.changed.happened(value)
2014-02-28 09:21:58.698327 > --- ---
2014-02-28 09:21:58.698436 >   File "/home/p2pool/p2pool/p2pool/util/variable.py", line 42, in happened
2014-02-28 09:21:58.698523 >     func(*event)
2014-02-28 09:21:58.698608 >   File "/home/p2pool/p2pool/p2pool/node.py", line 96, in broadcast_share
2014-02-28 09:21:58.698694 >     peer.sendShares([share for share in shares if share.peer_addr != peer.addr], self.node.tracker, self.node.known_txs_var.value, include_txs_with\
=[share_hash])
2014-02-28 09:21:58.698782 >   File "/home/p2pool/p2pool/p2pool/p2p.py", line 290, in sendShares
2014-02-28 09:21:58.698867 >     assert tx_hash in known_txs, 'tried to broadcast share without knowing all its new transactions'
2014-02-28 09:21:58.698954 > exceptions.AssertionError: tried to broadcast share without knowing all its new transactions
sr. member
Activity: 434
Merit: 250
I got an error where it said something about trying to broadcast a share without having all the transactions (?). Then the share was counted against orphans, I think. The message scrolled off before I could save it. There's no log file for p2pool right? At least I couldn't find it.

It's in data/coinname/log
legendary
Activity: 2968
Merit: 1198
I got an error where it said something about trying to broadcast a share without having all the transactions (?). Then the share was counted against orphans, I think. The message scrolled off before I could save it. There's no log file for p2pool right? At least I couldn't find it.

legendary
Activity: 1270
Merit: 1000
Part of the problem may be that python is an interpreted, not compiled language.

I have seen compiled versions of p2pool (at least for windows in the OP). Anyone have instructions on how to do so? I'm not so much interested in increasing the performance as making it easier for others to use without having to load dependencies.
full member
Activity: 322
Merit: 101
thanks I hope it will help.

Quote
root@panda:/etc/security# cat /proc/sys/fs/file-max
1000000
root@panda:/etc/security# ulimit -Sn
524288
root@panda:/etc/security# ulimit -Hn
524288


Many users had left my node so it helped anyway ;/
legendary
Activity: 1008
Merit: 1001
Let the chips fall where they may.
Hi guys, do you have any idea what might be causing this hashrate drops on my p2pool ?

http://freebtc.eu:8336/static/

I was going to guess no internet until you posted the error log.

"0197 > Failure: twisted.internet.error.ConnectBindError: Couldn't bind: 24: Too many open files."
 suggest you should look into raising the number of file descriptors. Have not run into that problem myself yet.
full member
Activity: 322
Merit: 101
Hi guys, do you have any idea what might be causing this hashrate drops on my p2pool ?

http://freebtc.eu:8336/static/



I've upgaradedthe CPU and RAM since the firstdrop, but they occured again ;/ RAM and CPU are at 10% at most

Code:
2014-02-27 10:06:10.109157 > Unhandled Error
2014-02-27 10:06:10.109247 > Traceback (most recent call last):
2014-02-27 10:06:10.109336 >   File "/root/p2pool-blackcoin/p2pool/util/variable.py", line 75, in set
2014-02-27 10:06:10.109428 >     self.transitioned.happened(oldvalue, value)
2014-02-27 10:06:10.109563 >   File "/root/p2pool-blackcoin/p2pool/util/variable.py", line 42, in happened
2014-02-27 10:06:10.109641 >     func(*event)
2014-02-27 10:06:10.109717 >   File "/root/p2pool-blackcoin/p2pool/work.py", line 118, in _
2014-02-27 10:06:10.109792 >     self.new_work_event.happened()
2014-02-27 10:06:10.109869 >   File "/root/p2pool-blackcoin/p2pool/util/variable.py", line 42, in happened
2014-02-27 10:06:10.109944 >     func(*event)
2014-02-27 10:06:10.110019 > --- ---
2014-02-27 10:06:10.110094 >   File "/root/p2pool-blackcoin/p2pool/bitcoin/stratum.py", line 38, in _send_work
2014-02-27 10:06:10.110171 >     x, got_response = self.wb.get_work(*self.wb.preprocess_request('' if self.username is None else self.username))
2014-02-27 10:06:10.110262 >   File "/root/p2pool-blackcoin/p2pool/work.py", line 176, in preprocess_request
2014-02-27 10:06:10.110348 >     raise jsonrpc.Error_for_code(-12345)(u'lost contact with bitcoind')
2014-02-27 10:06:10.110424 > p2pool.util.jsonrpc.NarrowError: -12345 lost contact with bitcoind
2014-02-27 10:06:10.110715 > Unhandled Error

Code:
2014-02-27 10:06:10.429822 > Traceback (most recent call last):
2014-02-27 10:06:10.429901 >   File "/root/p2pool-blackcoin/p2pool/util/variable.py", line 75, in set
2014-02-27 10:06:10.429978 >     self.transitioned.happened(oldvalue, value)
2014-02-27 10:06:10.430054 >   File "/root/p2pool-blackcoin/p2pool/util/variable.py", line 42, in happened
2014-02-27 10:06:10.430130 >     func(*event)
2014-02-27 10:06:10.430206 >   File "/root/p2pool-blackcoin/p2pool/work.py", line 118, in _
2014-02-27 10:06:10.430282 >     self.new_work_event.happened()
2014-02-27 10:06:10.430359 >   File "/root/p2pool-blackcoin/p2pool/util/variable.py", line 42, in happened
2014-02-27 10:06:10.430434 >     func(*event)
2014-02-27 10:06:10.430559 > --- ---
2014-02-27 10:06:10.430641 >   File "/root/p2pool-blackcoin/p2pool/bitcoin/stratum.py", line 38, in _send_work
2014-02-27 10:06:10.430718 >     x, got_response = self.wb.get_work(*self.wb.preprocess_request('' if self.username is None else self.username))
2014-02-27 10:06:10.430796 >   File "/root/p2pool-blackcoin/p2pool/work.py", line 176, in preprocess_request
2014-02-27 10:06:10.430885 >     raise jsonrpc.Error_for_code(-12345)(u'lost contact with bitcoind')
2014-02-27 10:06:10.430963 > p2pool.util.jsonrpc.NarrowError: -12345 lost contact with bitcoind
2014-02-27 10:06:10.519798 > Error getting work from bitcoind:
2014-02-27 10:06:10.519982 > Traceback (most recent call last):
2014-02-27 10:06:10.520197 > Failure: twisted.internet.error.ConnectBindError: Couldn't bind: 24: Too many open files.
2014-02-27 10:06:10.558710 > Unhandled Error
2014-02-27 10:06:10.558896 > Traceback (most recent call last):
2014-02-27 10:06:10.558985 >   File "/root/p2pool-blackcoin/p2pool/main.py", line 578, in run
2014-02-27 10:06:10.559066 >     reactor.run()
2014-02-27 10:06:10.559146 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/base.py", line 1192, in run
2014-02-27 10:06:10.559203 >     self.mainLoop()
2014-02-27 10:06:10.559295 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/base.py", line 1201, in mainLoop
2014-02-27 10:06:10.559373 >     self.runUntilCurrent()
2014-02-27 10:06:10.559455 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/base.py", line 824, in runUntilCurrent
2014-02-27 10:06:10.559532 >     call.func(*call.args, **call.kw)
2014-02-27 10:06:10.559608 > --- ---


sr. member
Activity: 434
Merit: 250
if I run my own p2pool node how do I change to ADDR/0.001?

is there a switch in run_p2pool to achieve this?
when i do run_p2pool -a /0.0001
it gives me a parse error

Is it the username your miner uses to connect to a node. Instead of username = payment address, use ADDR+DIFF to control the pseudo share difficulty (for graphing or support really old asics) or use ADDR/DIFF to control your share target. You can also use both. For instance I mine Uno (a sha256 coin) with ADDR/64000+64 on my Antminer S1 (180GH).
legendary
Activity: 1008
Merit: 1001
Let the chips fall where they may.
Hi! I have the following problem. Sometimes, if the restart p2pool (quark-algoritm), when the power pool > ~ 150 MH / s, process starts to load the processor to 100% and all shares the dead. All logentries "DEAD ON ARRIVAL". Why this happens and how to solve this problem?

If it takes your node more than 30 seconds to verify a block, you will get 100% stales. Even without 6 different hashing algorithms, I have seen up to 12 seconds of CPU lag on my machine processing P2Pool.

Part of the problem may be that python is an interpreted, not compiled language. A Just-In-Time compiler like PyPy may help. (I think I will test that on my own machine)

Edit: I think actual block processing is handed off to Bitcoind. P2Pool still has its own chain though.
Edit: pypy Does not work:
Code:
Traceback (most recent call last):
  File "app_main.py", line 72, in run_toplevel
  File "./p2pool/run_p2pool.py", line 3, in
    from p2pool import main
  File "/usr/home/P2Pool/p2pool/p2pool/main.py", line 17, in
    from twisted.internet import defer, reactor, protocol, tcp
ImportError: No module named twisted

Update:
Got it working.
member
Activity: 78
Merit: 13
Individual miners on a public node would see reduced variance in their own shares, since pool hash rate is taken out of the equation. They could do this by hand now with ADDR/1 (or say /.000001 for scrypt), but I think handling it automatically makes more sense (and keeps vardiff alive for miners that are maybe bigger than justifies using ADDR/1).


if I run my own p2pool node how do I change to ADDR/0.001?

is there a switch in run_p2pool to achieve this?
when i do run_p2pool -a /0.0001
it gives me a parse error
full member
Activity: 159
Merit: 102
Hi! I have the following problem. Sometimes, if the restart p2pool (quark-algoritm), when the power pool > ~ 150 MH / s, process starts to load the processor to 100% and all shares the dead. All logentries "DEAD ON ARRIVAL". Why this happens and how to solve this problem?
sr. member
Activity: 434
Merit: 250
I'm thinking of setting a P2Pool node up for around 2MH/s on Vertcoin.  Can you still auto donate 1% to the dev's?

I don't think Forrest has a Vertcoin address but you can ask him. The address hard coded into the repo wouldn't work anyway. Maybe best to just do a manual donation now and then to his BTC address.
legendary
Activity: 1372
Merit: 1003
I'm thinking of setting a P2Pool node up for around 2MH/s on Vertcoin.  Can you still auto donate 1% to the dev's?
member
Activity: 112
Merit: 10
I can currently offer a 5 LTC bounty if someone can help me resolve this issue:

I'm still having this memory leak issue with p2pool which I would love to resolve:


I looked at the ">" errors in the logs, but I don't know if this is the problem:
Code:
2014-02-24 05:34:43.706844 > Couldn't link returned work's job id with its handler. This should only happen if this process was recently restarted!
Code:
2014-02-24 05:05:18.137532 Worker xxxxxxxxxxx submitted share with hash > target:
2014-02-24 05:05:18.137946     Hash:   xxxxxxxxxxxxxxx
2014-02-24 05:05:18.138166     Target: xxxxxxxxxx
Code:
2014-02-24 05:00:39.106919 > in handle_share_hashes:
2014-02-24 05:00:39.107328 > Traceback (most recent call last):
2014-02-24 05:00:39.107653 > Failure: twisted.internet.defer.TimeoutError: in GenericDeferrer
2014-02-24 05:00:39.109908 Lost peer x.x.x.x:36098 -
2014-02-24 05:00:39.110112     Connection was aborted locally, using
2014-02-24 05:00:39.110291     L{twisted.internet.interfaces.ITCPTransport.abortConnection}.
2014-02-24 05:00:39.110502
2014-02-24 05:00:39.110721     @since: 11.1

Right now I have to restart the node every few days, which the miners don't like.
sr. member
Activity: 434
Merit: 250
For those interested I just found an interesting patch the author mentioned on the HHTT thread:

https://github.com/iongchun/p2pool/tree/auto-worker-diff

Gives you two command line options to control the pseduo share difficulty. You can set a target difficulty per-miner or per-address. Using that per-address would seem to fit nicely with my pull request to set share difficulty based on address speed instead of local node speed.
sr. member
Activity: 434
Merit: 250
Fee % isn't a % of each block. It is a % of shares are randomly given to you instead of your miner. So in 100 shares, on average, 1 share will be 100% credit to you, and 99 shares will be 100% credit to your miners. It should average out long-term that you make 1% of the total income of the pool. But it is very high variance. I hope in a future major version of p2pool the fee % is applied to every block like donation %.
newbie
Activity: 55
Merit: 0
Hi guys, is there a way to check why I'm not getting fees from every mined block (and the total fees are much lower than the set 1%) ?
Right now avarage payout of two biggest miners only is ~4000BC, but I'm not getting any fees ;/ (It's not about greed - I just don't understand it).
Hashrate is constant (and growing).

I had the same question in another topic:

Should you get a 1% fee everytime the miners are paid? I haven't received any fee yet, while the active miners have received their share payments.
Or will this fee be paid on a daily base? I got the feeling something is setup wrong.

It isn't intuitive, but each share a miner submits to you has a 1% chance of becoming your share instead. So you'll see a lot of variance in your pool fee income, but long-term it should even out (at the expense of higher variance for the miner as well).

Maybe one day p2pool will allow the fee amount to be recorded in the share, like the donation amount is, so it can be paid exactly when each share is paid and all shares remain with the miner.

After a few weeks I can confirm this behavior. Sometimes there are days without a fee, and then suddenly you get a few in a row. Looking back a month it seems to be about 1%!

It has also happened to me. I need like a couple of months to understand what is going on until I read on post on the site (another subforum) and finally understood what's going on
Jump to: