[1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool - page 416.

smooth

legendary

Activity: 2968

Merit: 1198

Quote from: organofcorti on March 13, 2014, 05:09:50 PM

No. It's not 'noticed because someone is looking for it' (which is what I think you meant with your analogy?). It is noticed because the 95% confidence interval for income as a fraction of expected income is much wider for lower hashrates than for higher hashrates.

Yes, as a fraction of expected income but ask yourself why that even matters. If you expect to get 0.003 BTC and you get 0.002 BTC (or even in one instance 0 BTC for that matter) how is your life impacted in some major way? People can stare at numbers on a screen or lines on a chart all day long but at some point you have to relate those numbers and lines to reality, and when you do that shortfalls on hobby mining do not really matter.

irrational

newbie

Activity: 56

Merit: 0

Quote from: smooth on March 12, 2014, 09:22:01 PM

Quote from: irrational on March 12, 2014, 08:10:21 PM

Thinking 22+ GH/s should be sufficient for p2pool :-)

At 22 GH you will still have dry spells on p2pool. As I said, though, don't worry about it, you'll have big payoff days too. Look at it every week or two and you'll be happy with the results.

No worries

From crunching the numbers, I think I'd feel ok with the variance at 22 GH/s at current pool difficulty. It's just a hobby anyway, and it'll all even out in the end.

organofcorti

donator

Activity: 2058

Merit: 1007

Poor impulse control.

Quote from: smooth on March 12, 2014, 09:11:51 PM

Quote from: organofcorti on March 12, 2014, 07:37:18 PM

However variance as a fraction of expectation is much greater when hashrate is lower, which I think is what roy7 meant, and what is generally noticed by most miners.

Noticed, perhaps, if you are watching the pot boil. If you expect to make 50c/day and you make 0c/day, that looks like a big deal, but in reality your actual shortfall is still only 50c. Not going to hurt anybody.

Someone with a somewhat larger rig who expects to make $1000/day and makes $0/day (certainly possible when p2pool has 4+ day rounds), that's a $1000 shortfall, and may or may not be a big deal, depending on your financial situation.

No. It's not 'noticed because someone is looking for it' (which is what I think you meant with your analogy?). It is noticed because the 95% confidence interval for income as a fraction of expected income is much wider for lower hashrates than for higher hashrates.

roy7

sr. member

Activity: 434

Merit: 250

I probably ran into the soft ulimit. Looking at my other node:

Quote

$ lsof -p 9436 | wc -l
228
$ lsof -p 9436 | grep 9171 | wc -l
142

Node has 22 incoming and 10 outgoing peer connections. There are 7 active miners. However there are 142 active file descriptors on the mining port number (vertcoin is 9171).

It appears to be all of the hostnames of the miners who have ever connected to the pool since the last restart. Are those file descriptors never closed?

Looking more closely at the actual list, there are many duplicates to the same actual miners, just on a variety of ports. Such as this guy (his IP address removed):

Quote

$ lsof -p 9436 | grep 9171 | grep xxxxxxxxxxx.dynamic.upc.nl | wc -l
29

29 file handles all for one miner.

roy7

sr. member

Activity: 434

Merit: 250

Quote from: Mobius on July 18, 2013, 12:22:56 PM

I use the following in my setup script for ubuntu

Code:

# Increase open file limits
sudo sh -c 'echo "* soft nofile 16384" >> /etc/security/limits.conf'
sudo sh -c 'echo "* hard nofile 65536" >> /etc/security/limits.conf'
sudo sh -c 'echo "* soft nproc 4096" >> /etc/security/limits.conf'
sudo sh -c 'echo "* hard nproc 16384" >> /etc/security/limits.conf'

for Fedora it's /etc/security/limits.d/90-nproc.conf

Thank you for this!

roy7

sr. member

Activity: 434

Merit: 250

Just got hit with the number of files issue myself.

Quote

2014-03-13 17:36:23.039910 > Failure: twisted.internet.error.ConnectBindError: Couldn't bind: 24: Too many open files.

I google'd how to increase the #, and checked this:

Quote

cat /proc/sys/fs/file-max
165417

But honestly that should be well more than enough? It is possible the file handles to the coin daemon aren't being closed properly? So each RPC call it slowly counts up towards the maximum?

Didn't know to try this before restarting p2pool, but

Quote

cat /proc/sys/fs/file-nr
672 0 165417

only 672 files in use after it was restarted, out of the 165K maximum.

Quote

ulimit -Hn
4096
ulimit -Sn
1024

KyrosKrane

sr. member

Activity: 295

Merit: 250

Quote from: cr1776 on March 13, 2014, 11:25:47 AM

Quote from: MrWong on March 13, 2014, 10:43:52 AM

p2pool.org down for anyone else? Miners seem to roll over to back up pools. Anyone have any details on whats going on?

P2pool itself is up, you can set up other p2pool nodes as backups. As roy7 says, for p2pool.org, you'll have to check with jude

At risk of tooting my own horn, my current P2pool node (in Florida) is in my sig, and I'm bringing up another pool in Germany this weekend (I hope!).

smartbart24

newbie

Activity: 3

Merit: 0

The P2Pool concept seems revolutionary to me so I would really like to understand it in full.

I was trying to review the source code of the P2Pool here: https://github.com/forrestv/p2pool but have slight problems "finding" into the code.
This link brought some light : https://en.bitcoin.it/wiki/P2Pool_code_documentation

Still maybe you could jump start me in two questions:
1) How does the client know which work to do (it is passed to bitcoind via get getblocktemplate right ? - but I still have to know what work has been done by the other shares before)
2) How do I append my payout adress to the script and how is ensured that script is included in the final block ?

Maybe you could hint me to some code sections ?

Thank you in advance for your help

cr1776

legendary

Activity: 4256

Merit: 1313

Quote from: MrWong on March 13, 2014, 10:43:52 AM

p2pool.org down for anyone else? Miners seem to roll over to back up pools. Anyone have any details on whats going on?

P2pool itself is up, you can set up other p2pool nodes as backups. As roy7 says, for p2pool.org, you'll have to check with jude

roy7

sr. member

Activity: 434

Merit: 250

Quote from: MrWong on March 13, 2014, 10:43:52 AM

p2pool.org down for anyone else? Miners seem to roll over to back up pools. Anyone have any details on whats going on?

You might try one of Jude's threads or PM him. This is the general discussion thread for the p2pool software itself. p2pool.org is just a public node someone runs, not an official site of the p2pool developers.

MrWong

member

Activity: 91

Merit: 10

p2pool.org down for anyone else? Miners seem to roll over to back up pools. Anyone have any details on whats going on?

smooth

legendary

Activity: 2968

Merit: 1198

Again, if the pool has a dry spell you are only losing payout on one share, which is really not that much in the way of coin. Bigger miners are losing out on many shares (if the p2pool doesn't get a block in three days). They have more to lose.

But if you really can't take the variance but still want to help p2pool, split off some of your hash rate to one or more of the bigger pools where you get (tiny, tiny) earnings on every few blocks. You'll get some small steady earnings with a nice boost when p2pool has enough luck to generate payouts.

phillipsjk

legendary

Activity: 1008

Merit: 1001

Let the chips fall where they may.

Quote from: smooth on March 12, 2014, 09:11:51 PM

Noticed, perhaps, if you are watching the pot boil. If you expect to make 50c/day and you make 0c/day, that looks like a big deal, but in reality your actual shortfall is still only 50c. Not going to hurt anybody.

Someone with a somewhat larger rig who expects to make $1000/day and makes $0/day (certainly possible when p2pool has 4+ day rounds), that's a $1000 shortfall, and may or may not be a big deal, depending on your financial situation.

Low hash-rate miners get more dry spells because they may not have found a share within 3 days prior the pool finding a block. I was PO'd when my first two shares had a zero pay-out for that reason.

smooth

legendary

Activity: 2968

Merit: 1198

Quote from: irrational on March 12, 2014, 08:10:21 PM

Thinking 22+ GH/s should be sufficient for p2pool :-)

At 22 GH you will still have dry spells on p2pool. As I said, though, don't worry about it, you'll have big payoff days too. Look at it every week or two and you'll be happy with the results.

smooth

legendary

Activity: 2968

Merit: 1198

Quote from: organofcorti on March 12, 2014, 07:37:18 PM

However variance as a fraction of expectation is much greater when hashrate is lower, which I think is what roy7 meant, and what is generally noticed by most miners.

Noticed, perhaps, if you are watching the pot boil. If you expect to make 50c/day and you make 0c/day, that looks like a big deal, but in reality your actual shortfall is still only 50c. Not going to hurt anybody.

Someone with a somewhat larger rig who expects to make $1000/day and makes $0/day (certainly possible when p2pool has 4+ day rounds), that's a $1000 shortfall, and may or may not be a big deal, depending on your financial situation.

irrational

newbie

Activity: 56

Merit: 0

Quote from: organofcorti on March 12, 2014, 07:37:18 PM

Quote from: smooth on March 12, 2014, 06:34:22 PM

Quote from: roy7 on March 11, 2014, 10:15:23 PM

The variance on 2GH on p2pool will, sadly, be massive. You could farm from sha256 alt coins though. Or else you might want to use a normal pool. (The proxy pool project I want to port to sha256 but haven't had time.)

Roy7 is a bit math challenged. The variance in absolute terms (meaning the amount of actual coins you will be above or below expectation) will be smaller the smaller your hash rate.

If you are a very small miner you will be getting very little output no matter what. If you want to help bitcoin and also have some fun with your mining, just treat your p2pool output as a fun raffle. Every once in a while (maybe once per week, possibly more or less often) you will get a nice payout. The rest of the time you will get nothing. Either way you won't make a lot. Just relax and have fun it with.

However variance as a fraction of expectation is much greater when hashrate is lower, which I think is what roy7 meant, and what is generally noticed by most miners.

This is exactly what I meant by variance. The effect of having an excessively low hash rate compared to difficulty such that normal variances in finding shares have a drastic effect on the overall payout frequency of a miner.

Luckily my Antminer U2 arrived today, and I also placed an order for 10 more :-D

Thinking 22+ GH/s should be sufficient for p2pool :-)

organofcorti

donator

Activity: 2058

Merit: 1007

Poor impulse control.

Quote from: smooth on March 12, 2014, 06:34:22 PM

Quote from: roy7 on March 11, 2014, 10:15:23 PM

The variance on 2GH on p2pool will, sadly, be massive. You could farm from sha256 alt coins though. Or else you might want to use a normal pool. (The proxy pool project I want to port to sha256 but haven't had time.)

Roy7 is a bit math challenged. The variance in absolute terms (meaning the amount of actual coins you will be above or below expectation) will be smaller the smaller your hash rate.

If you are a very small miner you will be getting very little output no matter what. If you want to help bitcoin and also have some fun with your mining, just treat your p2pool output as a fun raffle. Every once in a while (maybe once per week, possibly more or less often) you will get a nice payout. The rest of the time you will get nothing. Either way you won't make a lot. Just relax and have fun it with.

However variance as a fraction of expectation is much greater when hashrate is lower, which I think is what roy7 meant, and what is generally noticed by most miners.

roy7

sr. member

Activity: 434

Merit: 250

Well then perhaps I'm using terms wrong. By variance I was referring to the # of shares on the share chain (how often he'll get paid being the concern, not the amount). At his speed he'll rarely find a share, so often blocks will pay out with no payment to him at all. As opposed to a normal pool with a tiny but steady stream of credit.

I thought the rate at which you receive payments was normally what people refer to as "variance" when we're discussing p2pool, and the issue with smaller miners on p2pool is the amount of time you'll have 0 shares when blocks are found, resulting in no payment at all.

Obviously the absolute amount of coins will be larger with larger hash rates.

smooth

legendary

Activity: 2968

Merit: 1198

Quote from: roy7 on March 11, 2014, 10:15:23 PM

The variance on 2GH on p2pool will, sadly, be massive. You could farm from sha256 alt coins though. Or else you might want to use a normal pool. (The proxy pool project I want to port to sha256 but haven't had time.)

Roy7 is a bit math challenged. The variance in absolute terms (meaning the amount of actual coins you will be above or below expectation) will be smaller the smaller your hash rate.

If you are a very small miner you will be getting very little output no matter what. If you want to help bitcoin and also have some fun with your mining, just treat your p2pool output as a fun raffle. Every once in a while (maybe once per week, possibly more or less often) you will get a nice payout. The rest of the time you will get nothing. Either way you won't make a lot. Just relax and have fun it with.

roy7

sr. member

Activity: 434

Merit: 250

Quote from: phillipsjk on March 12, 2014, 11:46:32 AM

I am using the stock one on my P2Pool node, and it has it:

Haha I'm dense. I'm so used to running public nodes it didn't even occur to be a normal miner running their own p2pool will have the time to share on there. Doh!

What I was thinking at the time was how multiple miners on the same public node can't see their personal "time to share" unless the interface breaks that out and there is a patch to add a couple of required API calls to make that happen.

Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool - page 416. (Read 2591964 times)