Author

Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool - page 647. (Read 2591920 times)

full member
Activity: 165
Merit: 100
Hi forrestv,

There is a lot of interest in partial confirmations of transactions and p2pool has been proposed as a reasonable solution (see here). Specifically, the p2pool sharechain could guarantee that it will include a given txn in its next block (barring a conflicting transaction sneaking into the blockchain). Could you please comment on the feasibility of implementing such functionality into p2pool? What about the benefit? Does p2pool guaranteeing the inclusion of a txn provide any real benefit over sending your txn to the network and waiting for the majority of nodes to get it?

Thanks!
hero member
Activity: 591
Merit: 500
If you don't forward the bitcoin port from your router or disable upnp in your bitcoind you'll only be able to make outgoing connections to the network, that will stop bitcoind from using any real upload bandwidth (except when someone in the p2pool network finds a block which is only about 3x/day).
Or just set your max connections in your bitcoin.conf. I set mine to 10 so I can still have the port open without my network getting bogged down.
sr. member
Activity: 270
Merit: 250
Lol are you joking or what? You pay for that connection, you better use it, or you want to give your ISP money for free? "Here ISP, take my money and don't worry i won't use my connection, i promise!  Shocked

They emailing you?  Shocked

I got one email suggesting there might be malware on my internal network to account for the "over-usage" but nothing more then saying hey your higher then the average person, and I could give 2 shits if they think I am being excessive and I don't care that I upped that much I just thought it was excessive and wanted explanation  .... and my mother-in-law lives with us and netflix is her entertainment so I can't have the cable modem being saturated on the upstream all the time.

If you don't forward the bitcoin port from your router or disable upnp in your bitcoind you'll only be able to make outgoing connections to the network, that will stop bitcoind from using any real upload bandwidth (except when someone in the p2pool network finds a block which is only about 3x/day).
full member
Activity: 231
Merit: 100
Lol are you joking or what? You pay for that connection, you better use it, or you want to give your ISP money for free? "Here ISP, take my money and don't worry i won't use my connection, i promise!  Shocked

They emailing you?  Shocked

I got one email suggesting there might be malware on my internal network to account for the "over-usage" but nothing more then saying hey your higher then the average person, and I could give 2 shits if they think I am being excessive and I don't care that I upped that much I just thought it was excessive and wanted explanation  .... and my mother-in-law lives with us and netflix is her entertainment so I can't have the cable modem being saturated on the upstream all the time.
hero member
Activity: 675
Merit: 514
Looks like something is broken in p2pool 982a81a with bitcoin-next-20120813
Code:
2012-08-24 17:07:49.281000 GOT BLOCK FROM PEER! Passing to bitcoind! 2bd3ca75 bitcoin: http://blockexplorer.com/block/00000000000002a43f189eff39d5a2a12141c8bf03e9c5f2b7e958f22bd3ca75
2012-08-24 17:07:49.281000
2012-08-24 17:07:56.862000 ... done processing 501 shares. New: 501 Have: 26844/~17280
2012-08-24 17:07:56.862000 Requesting parent share 3d1a7c39 from 91.235.254.37:9333
2012-08-24 17:07:56.893000 P2Pool: 17312 shares in chain (10132 verified/26844 total) Peers: 10 (0 incoming)
2012-08-24 17:07:56.893000  Local: 0H/s in last 0.0 seconds Local dead on arrival: ??? Expected time to share: ???
2012-08-24 17:07:56.893000  Shares: 0 (0 orphan, 0 dead) Stale rate: ??? Efficiency: ??? Current payout: 0.0000 BTC
2012-08-24 17:07:56.893000  Pool: 316GH/s Stale rate: 6.0% Expected time to block: 8.3 hours
2012-08-24 17:07:57.049000 > Error submitting block: (will retry)
2012-08-24 17:07:57.049000 > Traceback (most recent call last):
2012-08-24 17:07:57.049000 >   File "C:\Python27-64\lib\site-packages\twisted\internet\defer.py", line 551, in _runCallbacks
2012-08-24 17:07:57.049000 >     current.result = callback(current.result, *args, **kw)
2012-08-24 17:07:57.049000 >   File "C:\Python27-64\lib\site-packages\twisted\internet\defer.py", line 1101, in gotResult
2012-08-24 17:07:57.049000 >     _inlineCallbacks(r, g, deferred)
2012-08-24 17:07:57.049000 >   File "C:\Python27-64\lib\site-packages\twisted\internet\defer.py", line 1043, in _inlineCallbacks
2012-08-24 17:07:57.049000 >     result = result.throwExceptionIntoGenerator(g)
2012-08-24 17:07:57.049000 >   File "C:\Python27-64\lib\site-packages\twisted\python\failure.py", line 382, in throwExceptionIntoGenerator
2012-08-24 17:07:57.049000 >     return g.throw(self.type, self.value, self.tb)
2012-08-24 17:07:57.049000 > --- ---
2012-08-24 17:07:57.049000 >   File "D:\forrestv-p2pool\forrestv-p2pool-982a81a\p2pool\util\deferral.py", line 41, in f
2012-08-24 17:07:57.049000 >     result = yield func(*args, **kwargs)
2012-08-24 17:07:57.049000 >   File "C:\Python27-64\lib\site-packages\twisted\internet\defer.py", line 1043, in _inlineCallbacks
2012-08-24 17:07:57.049000 >     result = result.throwExceptionIntoGenerator(g)
2012-08-24 17:07:57.049000 >   File "C:\Python27-64\lib\site-packages\twisted\python\failure.py", line 382, in throwExceptionIntoGenerator
2012-08-24 17:07:57.049000 >     return g.throw(self.type, self.value, self.tb)
2012-08-24 17:07:57.049000 >   File "D:\forrestv-p2pool\forrestv-p2pool-982a81a\p2pool\main.py", line 306, in submit_block_rpc
2012-08-24 17:07:57.049000 >     result = yield bitcoind.rpc_submitblock(bitcoin_data.block_type.pack(block).encode('hex'))
2012-08-24 17:07:57.049000 >   File "C:\Python27-64\lib\site-packages\twisted\internet\defer.py", line 1043, in _inlineCallbacks
2012-08-24 17:07:57.049000 >     result = result.throwExceptionIntoGenerator(g)
2012-08-24 17:07:57.049000 >   File "C:\Python27-64\lib\site-packages\twisted\python\failure.py", line 382, in throwExceptionIntoGenerator
2012-08-24 17:07:57.049000 >     return g.throw(self.type, self.value, self.tb)
2012-08-24 17:07:57.049000 >   File "D:\forrestv-p2pool\forrestv-p2pool-982a81a\p2pool\util\jsonrpc.py", line 71, in callRemote
2012-08-24 17:07:57.049000 >     raise Error_for_code(resp['error']['code'])(resp['error']['message'], resp['error'].get('data', None))
2012-08-24 17:07:57.049000 > p2pool.util.jsonrpc.NarrowError: -32601 Method not found
legendary
Activity: 1148
Merit: 1008
If you want to walk on water, get out of the boat
Lol are you joking or what? You pay for that connection, you better use it, or you want to give your ISP money for free? "Here ISP, take my money and don't worry i won't use my connection, i promise!  Shocked

They emailing you?  Shocked
full member
Activity: 231
Merit: 100
Is it crazy to see 6.3 gigs upload as a result of P2Pool traffic?  BTC and LTC?
I do know I'd been running into my data cap (150GB per month) almost every month in the recent months that I was running p2pool. I'm not entirely sure that p2pool was the cause though.
Maybe check on the # of connections you guys are allowing, both in p2pool, and in your daemons, and cut them down more.

That should drop the cumulative bandwidth used.

-- Smoov

ps: You have a data cap? ... Does the data cap only count on traffic that goes outside of our network? Do you get free in-network traffic?


NO I have no data cap but they do tend to email me from time to time and say that 168 gigs of download is above the average users hahah... I rebooted machine last night ...  It has been up for 20 hours 11 minutes and uploaded 1.6 Gigs of data... recieved 371 Megs... isn't that a bit excessive... I Might shut down my p2pool nodes and see if it is that before I start blaming p2pool...

Naelr
legendary
Activity: 4592
Merit: 1851
Linux since 1997 RedHat 4
...
How many hours ago? It is not many hours yet since I pulled from github earlier today... I am using version 3.3 I think or something like that due to that pull.

-MarkM-

It was a long time ago that fixed it for me.  Might need to upgrade your miner too.  I'm using cgminer, 2.6.6 is the latest stable version it seems, I'm on 2.7.4 for now.

M
Many moons ago p2pool tried to get it right ... Tongue
And if you look at the API 'stats' in 2.7.4 it will also tell you what is going on with the roll time information
(there are 4 fields describing it)
legendary
Activity: 1540
Merit: 1001
EDIT: I am seeing now some console output looking like this

2012-08-23 12:51:08.201806 > Worker 1xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx @ ##.##.##.## submitted share more than once!

Is this normal? (I see it more than once, presumably once per time they submitted the share, or maybe once per each tiem other than the first time that they submitted the share.) Or is it something they can correct at their end?

-MarkM-

This was fixed in a newer version of p2pool.

M

How many hours ago? It is not many hours yet since I pulled from github earlier today... I am using version 3.3 I think or something like that due to that pull.

-MarkM-

It was a long time ago that fixed it for me.  Might need to upgrade your miner too.  I'm using cgminer, 2.6.6 is the latest stable version it seems, I'm on 2.7.4 for now.

M
legendary
Activity: 2940
Merit: 1090
EDIT: I am seeing now some console output looking like this

2012-08-23 12:51:08.201806 > Worker 1xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx @ ##.##.##.## submitted share more than once!

Is this normal? (I see it more than once, presumably once per time they submitted the share, or maybe once per each tiem other than the first time that they submitted the share.) Or is it something they can correct at their end?

-MarkM-

This was fixed in a newer version of p2pool.

M

How many hours ago? It is not many hours yet since I pulled from github earlier today... I am using version 3.3 I think or something like that due to that pull.

-MarkM-
hero member
Activity: 504
Merit: 500
Scattering my bits around the net since 1980
My provider is Comcast, and I believe we only have a DL limit. When I looked at my account & bill settings online, it showed less than the 250GB limit for the past 3 months, and I'm only at 64gb this month. I don't think they UL is even measured for me.  Tongue

The Comcast/Xfinity limit has been suspended.

Under Users & Settings...

"Note: enforcement of the 250GB data consumption threshold is currently suspended."

I know. Wink The point of me saying that was to show I wasn't anywhere near "high" network utilization like the other member mentioned.
My utilization was based on other traffic I generate too... like when I'm streaming audio/video streams...

-- Smoov
hero member
Activity: 504
Merit: 500
Scattering my bits around the net since 1980
I have been asked how p2pool knows how to pay third party miners who connect to it, and neither the wiki page nr the github page seems to say how that is done. I took a wild ass guess that its done by using a bitcoin address as username but is that correct?

-MarkM-


Yes.  When shares are submitted, they get credited to the address specified in the username (or to the default address if the username is not an address).
However, if you have your fee set to 100%, then 100% of the shares mined, by everybody, gets credited to the default bitcoin address p2pool is using for yourself. You have to leave your fee set to 0%, for your guest miners to get their full payout of bitcoin they have mined.

Set it to 1%, and 1 out of 100 of the shares they find, will be credited to you instead, randomly.

-- Smoov
legendary
Activity: 1540
Merit: 1001
EDIT: I am seeing now some console output looking like this

2012-08-23 12:51:08.201806 > Worker 1xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx @ ##.##.##.## submitted share more than once!

Is this normal? (I see it more than once, presumably once per time they submitted the share, or maybe once per each tiem other than the first time that they submitted the share.) Or is it something they can correct at their end?

-MarkM-

This was fixed in a newer version of p2pool.

M
hero member
Activity: 737
Merit: 500
I am not really too thrilled by the idea of putting an additional front end in front of the p2pool though, and my aim is Massively Merged Mining, with a bunch of blockchains already waiting for enough hashing power to be available for them to come out into the public again...

Merged mining in p2pool is not pooled.  If you want it to be pools (rewards distributed to multiple miners), you're going to have to invent that.  That is what p2pmining.com did.  You can use his code or invent your own, but there is no way to avoid having to add something on top of p2pool.

I am seeing now some console output looking like this

2012-08-23 12:51:08.201806 > Worker 1xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx @ ##.##.##.## submitted share more than once!

Search this thread for that error message to see a long discussion of what is going on.
hero member
Activity: 682
Merit: 500
My provider is Comcast, and I believe we only have a DL limit. When I looked at my account & bill settings online, it showed less than the 250GB limit for the past 3 months, and I'm only at 64gb this month. I don't think they UL is even measured for me.  Tongue

The Comcast/Xfinity limit has been suspended.

Under Users & Settings...

"Note: enforcement of the 250GB data consumption threshold is currently suspended."

I know. Wink The point of me saying that was to show I wasn't anywhere near "high" network utilization like the other member mentioned.
legendary
Activity: 2940
Merit: 1090
Oh cool, thanks.

I am not really too thrilled by the idea of putting an additional front end in front of the p2pool though, and my aim is Massively Merged Mining, with a bunch of blockchains already waiting for enough hashing power to be available for them to come out into the public again...

-MarkM-

EDIT: I am seeing now some console output looking like this

2012-08-23 12:51:08.201806 > Worker 1xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx @ ##.##.##.## submitted share more than once!

Is this normal? (I see it more than once, presumably once per time they submitted the share, or maybe once per each tiem other than the first time that they submitted the share.) Or is it something they can correct at their end?

-MarkM-

EDIT-again: I also just got a couple of times another error I have never seen before:

2012-08-23 13:05:50.746536 > Unhandled Error
2012-08-23 13:05:50.746640 > Traceback (most recent call last):
2012-08-23 13:05:50.746685 >   File "/usr/lib64/python2.7/site-packages/twisted/protocols/basic.py", line 564, in dataReceived
2012-08-23 13:05:50.746728 >     why = self.lineReceived(line)
2012-08-23 13:05:50.746770 >   File "/usr/lib64/python2.7/site-packages/twisted/web/http.py", line 1551, in lineReceived
2012-08-23 13:05:50.746812 >     self.allContentReceived()
2012-08-23 13:05:50.746853 >   File "/usr/lib64/python2.7/site-packages/twisted/web/http.py", line 1619, in allContentReceived
2012-08-23 13:05:50.746895 >     req.requestReceived(command, path, version)
2012-08-23 13:05:50.746952 >   File "/usr/lib64/python2.7/site-packages/twisted/web/http.py", line 773, in requestReceived
2012-08-23 13:05:50.746993 >     self.process()
2012-08-23 13:05:50.747033 > --- ---
2012-08-23 13:05:50.747073 >   File "/usr/lib64/python2.7/site-packages/twisted/web/server.py", line 127, in process
2012-08-23 13:05:50.747114 >     self.render(resrc)
2012-08-23 13:05:50.747154 >   File "/usr/lib64/python2.7/site-packages/twisted/web/server.py", line 147, in render
2012-08-23 13:05:50.747201 >     body = resrc.render(self)
2012-08-23 13:05:50.747242 >   File "/usr/lib64/python2.7/site-packages/twisted/web/resource.py", line 216, in render
2012-08-23 13:05:50.747282 >     return m(request)
2012-08-23 13:05:50.747322 >   File "/home/bitcoin/p2pool-git/p2pool/web.py", line 190, in render_GET
2012-08-23 13:05:50.747362 >     request.setHeader('Access-Control-Allow-Origin', '*')
2012-08-23 13:05:50.747403 >   File "/home/bitcoin/p2pool-git/p2pool/web.py", line 399, in
2012-08-23 13:05:50.747443 >     if dead:
2012-08-23 13:05:50.747482 > exceptions.KeyError: 'last_'

I had done a git pull just a few hours ago, so I am restarting in case this error is due simply to the code having been changed while the pool was running. ( I have seen shell scripts lose their place in the script when the script was changed under them while running so figure maybe python might do that too...)

-MarkM-
sr. member
Activity: 325
Merit: 250
Our highest capital is the Confidence we build.
It seems even by the last page of the thread it was still not open sourced, at https://bitcointalk.org/index.php?topic=66202.460 you can see user shouting please open source it, but I dont see any affirmative response to that...

-MarkM-


The answer was in this very thread Smiley

I will release the code for p2pmining at the end of the month (as soon as I go down to Chicago to get my backup) if anyone wants to implement it. If someone wants to donate a server, I could set it up. If you just wanted to do bitcoin and namecoin merged mning, a VPS would work.
sr. member
Activity: 270
Merit: 250
Is it crazy to see 6.3 gigs upload as a result of P2Pool traffic?  BTC and LTC?

Did you download the whole blockchain?

I've run p2pool for 10 machines on a cellphone ( during a fiber cut ) and only used 300 mb per day.

More likely it was people downloading the blockchain from your bitcoind, I've never noticed too much traffic using p2pool with around 40 connections.
hero member
Activity: 658
Merit: 500
Is it crazy to see 6.3 gigs upload as a result of P2Pool traffic?  BTC and LTC?

Did you download the whole blockchain?

I've run p2pool for 10 machines on a cellphone ( during a fiber cut ) and only used 300 mb per day.
legendary
Activity: 2940
Merit: 1090
It seems even by the last page of the thread it was still not open sourced, at https://bitcointalk.org/index.php?topic=66202.460 you can see user shouting please open source it, but I dont see any affirmative response to that...

-MarkM-
Jump to: