Author

Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool - page 626. (Read 2591920 times)

legendary
Activity: 1540
Merit: 1001
Just use IE to download proper web browser....

I'm not using IE as my main web browser.  

Thanks for the useless comment though! Smiley

M

EDIT: Seriously, I'm thinking the content tag can't be added w/o messing up JSON parsers that don't use IE.  That might mean a whole new URL is needed.  Maybe I can figure it out.
Sorry, I mean no offense ... Smiley IE just sux and when s1 is telling that "something is not working on IE" it is mostly IE feature, not a IE bug Tongue

No offense taken.  IE is awful, just awful, in so many ways.  But it sure makes web scraping easy from .net. Smiley  In this case I think I'll try the direct socket approach.

M
why argue with someone who recommends IE?

Who's recommending IE?

M
legendary
Activity: 1361
Merit: 1003
Don`t panic! Organize!
One interesting thing is there seems to be certain transactions which slow everyone down.. for example a couple hours ago, around 9am EDT, everyones getWork latency went way up. I wonder what causes those spikes?

http://p2pool.stitthappens.com:8336/static/graphs.html?Day
http://p2pool.hopto.org:9332/static/graphs.html?Day
http://imperium.getmyip.com:9332/static/graphs.html?Day
etc
Probably some huge tx which is send in between all nodes and/or some complicated block.

Anyway, on 8. nov all-time luck went to 99.9%! Really good improvement form less than 90% few months back. Sadly that last over-lengh blocks killing it again... :/
hero member
Activity: 675
Merit: 514
I just started p2pool. After about 2 minutes I saw this:
Code:
2012-11-10 20:58:21.431000 Peer sent entire transaction that was already received
2012-11-10 20:58:21.431000 RECV forget_tx 0258b896f65b1e801f318c16e9fa5813b0108240641636349325851b645d40ce025f2874dc8f9342d6ef6a59fb31f1a301008c6d3415996309bddddc9801621728
2012-11-10 20:58:21.451000 > Error handling message: (see RECV line)
2012-11-10 20:58:21.451000 > Traceback (most recent call last):
2012-11-10 20:58:21.451000 >   File "D:\python27\lib\site-packages\twisted\internet\tcp.py", line 209, in _dataReceived
2012-11-10 20:58:21.451000 >     rval = self.protocol.dataReceived(data)
2012-11-10 20:58:21.451000 >   File "D:\p2pool\p2pool-master\p2pool\p2p.py", line 146, in new_dataReceived
2012-11-10 20:58:21.451000 >     old_dataReceived(data)
2012-11-10 20:58:21.451000 >   File "D:\p2pool\p2pool-master\p2pool\util\p2protocol.py", line 39, in dataReceived
2012-11-10 20:58:21.451000 >     self.dataReceived2(data)
2012-11-10 20:58:21.451000 >   File "D:\p2pool\p2pool-master\p2pool\util\datachunker.py", line 40, in _DataChunker
2012-11-10 20:58:21.451000 >     wants = receiver.send(buf.get(wants))
2012-11-10 20:58:21.451000 > --- ---
2012-11-10 20:58:21.451000 >   File "D:\p2pool\p2pool-master\p2pool\util\p2protocol.py", line 66, in dataReceiver
2012-11-10 20:58:21.451000 >     self.packetReceived(command, type_.unpack(payload))
2012-11-10 20:58:21.451000 >   File "D:\p2pool\p2pool-master\p2pool\p2p.py", line 91, in packetReceived
2012-11-10 20:58:21.451000 >     p2protocol.Protocol.packetReceived(self, command, payload2)
2012-11-10 20:58:21.451000 >   File "D:\p2pool\p2pool-master\p2pool\util\p2protocol.py", line 79, in packetReceived
2012-11-10 20:58:21.451000 >     handler(**payload2)
2012-11-10 20:58:21.451000 >   File "D:\p2pool\p2pool-master\p2pool\p2p.py", line 390, in handle_forget_tx
2012-11-10 20:58:21.451000 >     self.remembered_txs_size -= 100 + bitcoin_data.tx_type.packed_size(self.remembered_txs[tx_hash])
2012-11-10 20:58:21.451000 > exceptions.KeyError: 1269040422094664870972422158679581342431664119710372484483215473841054070872L
2012-11-10 20:58:21.451000 Outgoing connection to peer 72.130.76.188:9333 established. p2pool version: 8 '8.2'
2012-11-10 20:58:21.551000 Sending 1 shares to 72.130.76.188:9333
This is the latest version from github (2cb4d8381e).
legendary
Activity: 2912
Merit: 1060
legendary
Activity: 1792
Merit: 1008
/dev/null
Just use IE to download proper web browser....

I'm not using IE as my main web browser.  

Thanks for the useless comment though! Smiley

M

EDIT: Seriously, I'm thinking the content tag can't be added w/o messing up JSON parsers that don't use IE.  That might mean a whole new URL is needed.  Maybe I can figure it out.
Sorry, I mean no offense ... Smiley IE just sux and when s1 is telling that "something is not working on IE" it is mostly IE feature, not a IE bug Tongue

No offense taken.  IE is awful, just awful, in so many ways.  But it sure makes web scraping easy from .net. Smiley  In this case I think I'll try the direct socket approach.

M
why argue with someone who recommends IE?
legendary
Activity: 1540
Merit: 1001
Just use IE to download proper web browser....

I'm not using IE as my main web browser.  

Thanks for the useless comment though! Smiley

M

EDIT: Seriously, I'm thinking the content tag can't be added w/o messing up JSON parsers that don't use IE.  That might mean a whole new URL is needed.  Maybe I can figure it out.
Sorry, I mean no offense ... Smiley IE just sux and when s1 is telling that "something is not working on IE" it is mostly IE feature, not a IE bug Tongue

No offense taken.  IE is awful, just awful, in so many ways.  But it sure makes web scraping easy from .net. Smiley  In this case I think I'll try the direct socket approach.

M
legendary
Activity: 916
Merit: 1003
Just use IE to download proper web browser....

Sadly I'm forced to use IE8 at work.  They're stone-age Nazis.
sr. member
Activity: 604
Merit: 250
One interesting thing is there seems to be certain transactions which slow everyone down.. for example a couple hours ago, around 9am EDT, everyones getWork latency went way up. I wonder what causes those spikes?

http://p2pool.stitthappens.com:8336/static/graphs.html?Day
http://p2pool.hopto.org:9332/static/graphs.html?Day
http://imperium.getmyip.com:9332/static/graphs.html?Day
etc


my bitcoind is on a ram drive and has close to 1000 connections.

This doesn't sound good.  You shouldn't have that many connections opened. AFAIK, the network code of the client isn't good, and having so many connections opened may slow down your connection...
Thats too. Se your /static/graphs.html?Hour page and check getwork latency.
legendary
Activity: 1036
Merit: 1000
DARKNETMARKETS.COM
Just use IE to download proper web browser....

+1  Grin

There's nothing else to say.
legendary
Activity: 1361
Merit: 1003
Don`t panic! Organize!
Just use IE to download proper web browser....

I'm not using IE as my main web browser.  

Thanks for the useless comment though! Smiley

M

EDIT: Seriously, I'm thinking the content tag can't be added w/o messing up JSON parsers that don't use IE.  That might mean a whole new URL is needed.  Maybe I can figure it out.
Sorry, I mean no offense ... Smiley IE just sux and when s1 is telling that "something is not working on IE" it is mostly IE feature, not a IE bug Tongue
legendary
Activity: 1540
Merit: 1001
Just use IE to download proper web browser....

I'm not using IE as my main web browser.  

Thanks for the useless comment though! Smiley

M

EDIT: Seriously, I'm thinking the content tag can't be added w/o messing up JSON parsers that don't use IE.  That might mean a whole new URL is needed.  Maybe I can figure it out.

EDIT #2: I got it figured out with no changes to p2pool.
legendary
Activity: 1361
Merit: 1003
Don`t panic! Organize!
Just use IE to download proper web browser....
legendary
Activity: 1540
Merit: 1001
The JSON outputs from p2pool (like /local_stats) are causing my IE9 to prompt to download the file instead of displaying it on the screen.  Can this be easily fixed?  It looks as if you add a ContentType of HTML/Text or text/plain it fixes it.  I'll have a look at the source and see if I can figure out where this is coming from, but I figured I'd mention it since there are experts here who could do it a lot faster than I can.

Thanks.

M
legendary
Activity: 1540
Merit: 1001
You might want to try these settings in bitcoin.conf to improve your bitcoind performance if it is indeed the bottleneck. I've found processing hundreds of transactions can also slow things down so some of these settings limit the number of transactions to a couple hundred.

Thanks everyone for your suggestions.

I upgraded p2pool to v9 this morning.  Now, 12 hours later, I'm still looking pretty:

Code:
Shares: 36 total (2 orphaned, 0 dead) Efficiency: 105.7%

That's 5.6% stale.  I'm hoping it stays.

M
sr. member
Activity: 604
Merit: 250
You might want to try these settings in bitcoin.conf to improve your bitcoind performance if it is indeed the bottleneck. I've found processing hundreds of transactions can also slow things down so some of these settings limit the number of transactions to a couple hundred.

Code:
#Max number of nodes to connect to. Another possible bottleneck.
maxconnections=20

#Maximum size, in bytes, of blocks you create:
blockmaxsize=100000

#How many bytes of the block should be dedicated to high-priority transactions,                                                                                                 
#included regardless of the fees they pay                                                                                                                                 
blockprioritysize=2000

#Minimum block size you want to create; block will be filled with free transactions                                                                                       
#until there are no more or the block reaches this size:                                                                                                                 
blockminsize=0

#Fee-per-kilobyte amount (in BTC) considered the same as "free"                                                                                                                   
#Be careful setting this: if you set it to zero then                                                                                                                     
#a transaction spammer can cheaply fill blocks using                                                                                                                     
#1-satoshi-fee transactions. It should be set above the real                                                                                                             
#cost to you of processing a transaction.                                                                                                                                 
mintxfee=0.0005
legendary
Activity: 1361
Merit: 1003
Don`t panic! Organize!
my bitcoind is on a ram drive and has close to 1000 connections.

This doesn't sound good.  You shouldn't have that many connections opened. AFAIK, the network code of the client isn't good, and having so many connections opened may slow down your connection...
Thats too. Se your /static/graphs.html?Hour page and check getwork latency.
sr. member
Activity: 325
Merit: 250
Our highest capital is the Confidence we build.
my bitcoind is on a ram drive and has close to 1000 connections.

This doesn't sound good.  You shouldn't have that many connections opened. AFAIK, the network code of the client isn't good, and having so many connections opened may slow down your connection...
legendary
Activity: 1361
Merit: 1003
Don`t panic! Organize!
See your /pings page, how many peers are under 100ms?
Mine are:
Code:
61,87
65,97
70,12
80,00
80,52
85,40
95,61
118,94
145,07
150,26
160,93
163,43
172,75
173,06
190,12
204,10
206,24
214,19
234,54
477,99
581,87
867,02
zvs
legendary
Activity: 1680
Merit: 1000
https://web.archive.org/web/*/nogleg.com
Code:
Shares: 254 total (20 orphaned, 10 dead) Efficiency: 103.6%

What's wrong this picture?  I'm at 11.8% stale, and I'm > 100% efficient.

I've done everything I can do to get the stale rate down, and I hover between 10% and 12%.

I've:

- changed AV to not scan bitcoin folder or p2pool folder
- changed cgminer to run on 1 thread, and 0 queue
- run p2pool on same box as bitcoin
- run p2pool on different box as bitcoin
- grab the newest version of p2pool every week or so.

I was around 5% before v8 came out.  

What's going on here?  Is this considered normal now?

M

were you running close to that 4% dead before?  my # of dead is usually around 0-1%, but last time I tried p2pool, I was getting about 15% orphans.  which has always been the main problem (for me).  doesn't make a lot of sense, since my bitcoind is on a ram drive and has close to 1000 connections.  probably need to use whatever the equivalent of addnode is in bitcoind to my p2pool command line to connect to the top 10 nodes or so (in ghash/s)

(uh, strayed off topic a bit i guess.  your dead % looks high to me, maybe some local network issue w/ higher latency or something?)

ed:

correct me if i'm wrong, but it would work like this?  person x gets a share based on work x, so now people are to have moved on to work y.  1 second later you submit your share based on work x, thus it is recognized as 'dead' by your p2pool client.  for orphans, you would submit your work x and then begin working on work y (as well as anyone else that received your share).  another person submits their work x a second later (not having received yours yet) and sends it to whoever they can on their peer list, and they all begin working on work z.  the people that are working on work z find another share first, so then your submitted share is orphaned

so, then, dead shares would more likely be caused by local network issues or maybe CPU load or something like that, while orphans would more likely be caused by latency outside your local network??

ed2:

err, change the first part to say that you submit your share based on work x, but your p2pool client already recognizes that there's a prior valid solution
legendary
Activity: 1540
Merit: 1001
Code:
Shares: 254 total (20 orphaned, 10 dead) Efficiency: 103.6%

What's wrong this picture?  I'm at 11.8% stale, and I'm > 100% efficient.

I've done everything I can do to get the stale rate down, and I hover between 10% and 12%.

I've:

- changed AV to not scan bitcoin folder or p2pool folder
- changed cgminer to run on 1 thread, and 0 queue
- run p2pool on same box as bitcoin
- run p2pool on different box as bitcoin
- grab the newest version of p2pool every week or so.

I was around 5% before v8 came out. 

What's going on here?  Is this considered normal now?

M

Can you please give your p2pool node address so we can check your stats.

Not public/open.

M
Jump to: