[20 gh] NMCBit pool 3% fee prop 6.6% PPS - page 29.

DavinciJ15

hero member

Activity: 780

Merit: 510

Bitcoin - helping to end bankster enslavement.

Awesome news!
Found software that will fix the problem for cgminer and others that get "unknown-work"!

http://manpages.ubuntu.com/manpages/hardy/man1/balance.1.html

Key part to read is...

A "%" instead of a "!" as a group separator declares the previous group
   to be of type "hash". This means that instead of a round-robin
   algorithm, a hash distribution based on the client ip address is used
   to determine the destination channel. This allows connecting one client
   always to the same server (e.g. balancing http sessions to a single
   server).

It was built for bitcoin before bitcoin! lol Cheesy

It's late I have not implemented it yet but I will tomorrow.

YES! I am so happy!

This is so cool as it completes the last of the miner side issues other than "not providing work fast enough" but that's caused by the cron job and non-clustered DB!
Right now I have namecoin and pushpool clusted I just add servers as needed, and the web site clustered. Once the SQL is clustered man! I will just need to add servers as more people come! ZERO down time for miners once SQL is clustered. WELL actually I do need to work on DOS attacks!

Example of the "not providing work fast enough" problem...

Code:

[2011-09-08 17:09:09] Accepted 3979040f GPU 0 thread 0
[2011-09-08 17:09:49] Accepted cc1ba909 GPU 0 thread 1
[2011-09-08 17:09:58] Accepted d0c03602 GPU 0 thread 0
[2011-09-08 17:10:20] Accepted 7c9e3606 GPU 0 thread 1
[2011-09-08 17:10:25] Accepted 186d5403 GPU 0 thread 0
[2011-09-08 17:10:29] Accepted e20a9309 GPU 0 thread 1
[2011-09-08 17:11:13] Accepted f689f502 GPU 0 thread 0
[2011-09-08 17:11:46] Accepted 83660100 GPU 0 thread 0
[2011-09-08 17:12:29] Accepted fec0c205 GPU 0 thread 1
[2011-09-08 17:12:34] Accepted 16237302 GPU 0 thread 1
[2011-09-08 17:12:47] Accepted 7ad5a70b GPU 0 thread 1
[2011-09-08 17:12:53] Accepted 33cfa103 GPU 0 thread 1
[2011-09-08 17:13:01] Pool 0 not providing work fast enough
[2011-09-08 17:13:06] Pool 0 not providing work fast enough
[2011-09-08 17:13:10] Accepted 7db66902 GPU 0 thread 0
[2011-09-08 17:13:34] Accepted 30043f08 GPU 0 thread 0
[2011-09-08 17:13:37] Pool 0 not providing work fast enough
[2011-09-08 17:14:34] Pool 0 not providing work fast enough
[2011-09-08 17:14:38] Pool 0 not providing work fast enough
[2011-09-08 17:14:58] Pool 0 not providing work fast enough
[2011-09-08 17:15:02] Rejected e2b4db01 GPU 0 thread 1
[2011-09-08 17:15:32] Accepted 3b101409 GPU 0 thread 0
[2011-09-08 17:16:42] Accepted 4872ad0a GPU 0 thread 1
[2011-09-08 17:17:17] Accepted 3b992608 GPU 0 thread 1
[2011-09-08 17:17:57] Accepted a1b6010c GPU 0 thread 0
[2011-09-08 17:18:31] Accepted aaabc80a GPU 0 thread 0
[2011-09-08 17:19:39] Accepted 5dfa020f GPU 0 thread 1
[2011-09-08 17:20:01] Accepted 7981cc00 GPU 0 thread 1
[2011-09-08 17:20:06] Accepted d83cb909 GPU 0 thread 0
[2011-09-08 17:22:00] Accepted 846ea20b GPU 0 thread 1
[2011-09-08 17:22:07] Accepted c83ff202 GPU 0 thread 0
[2011-09-08 17:22:45] Accepted 2ca50d0e GPU 0 thread 0
[2011-09-08 17:22:51] Accepted c74ef90b GPU 0 thread 0
[2011-09-08 17:22:57] Accepted f016870e GPU 0 thread 1
[2011-09-08 17:23:21] Accepted 4aa86f0b GPU 0 thread 1
[2011-09-08 17:23:35] Accepted 1040ce01 GPU 0 thread 0
[2011-09-08 17:23:49] Accepted a8254a00 GPU 0 thread 0
[2011-09-08 17:24:15] Accepted 4d672705 GPU 0 thread 0

caused when a block is found and CRON job is fired to pay users:
Sep 8 21:12:01 web CRON[3978]: (root) CMD (wget http://www.nmcbit.com/internalcron)

John Tobey

hero member

Activity: 481

Merit: 529

Quote from: DavinciJ15 on September 08, 2011, 08:28:37 PM

I'm going to move on to supporting merged mining since its only 300 blocks away and the main reason I started with namecoins.

Yes, on to merged mining please..

DavinciJ15

hero member

Activity: 780

Merit: 510

Bitcoin - helping to end bankster enslavement.

I have a Rejected shares issue work around...

The issue shows up if you are using cgminer and can be reduced if you change your scan time to 15 seconds or less.

Code:

cgminer -o http://nmcbit.com:8332 -u username -p password -d 0 --no-longpoll -s 15

I know for sure that poclbm works fine with my pool.

I'm going to move on to supporting merged mining since its only 300 blocks away and the main reason I started with namecoins.

Isepick

full member

Activity: 180

Merit: 100

4629 shares/ 51 unknown
4329 shares/ 39 unknown
4422 shares/ 51 unknown
4979 shares/ 51 unknown

Odd that 3 of them have the same amount of unknowns. They were all on the same server (nmcbit.com), I've just now rotated them across the coinservers, leaving the one that had 39 on nmcbit

DutchBrat

hero member

Activity: 868

Merit: 1000

Davinci,

These are my numbers:

28 / 4.100
14 / 3.100
28 / 2.900
0 / 3.200
24 / 2.800

Brat

DavinciJ15

hero member

Activity: 780

Merit: 510

Bitcoin - helping to end bankster enslavement.

I did a quick thing to see how many "unknow-work" people are getting if you click on your stales % on your dashboard you will get a page that has the total unknown-work.

Can anyone let me know how much you have and for a few of your workers?

Let me know for example on of my workers has
6,165 shares and 51 Unknown-work

You do not need to give me the worker name.

If you are getting a lot focus your miners on one of the 3 servers starting at coinserver1.nmcbit.com.

DavinciJ15

hero member

Activity: 780

Merit: 510

Bitcoin - helping to end bankster enslavement.

Quote from: DutchBrat on September 06, 2011, 08:35:15 PM

Davinci,

Last 1 1/2 Hours there has been NO RPC errors, looking good !

Brat

Cool!

Update your profile to add www.nmcbit.com so that your user bar is correct.

DutchBrat

hero member

Activity: 868

Merit: 1000

Davinci,

Last 1 1/2 Hours there has been NO RPC errors, looking good !

Brat

DutchBrat

hero member

Activity: 868

Merit: 1000

Hey Davinci,

I just restarted my miners, will give you an update in about 2 hours to see if all the RPC connection errors have gone

I think it would be productive to see what kind of stales/rejects we get

If you only show the breakdown on the Dashboard page (make an overall total per user) then no one can/wants to do any damage

Might be an idea ?

Looks like you are getting closer to launch !

Great job !

Brat

DavinciJ15

hero member

Activity: 780

Merit: 510

Bitcoin - helping to end bankster enslavement.

Ok I think I have done it! I have fixed the issues where we where getting...

Code:

2011-09-06 18:01:24: Listener for "coinserver1 test": 06/09/2011 18:01:24, Problems communicating with bitcoin RPC 0 2
2011-09-06 18:02:09: Listener for "coinserver3 test": 06/09/2011 18:02:09, Problems communicating with bitcoin RPC 0 2
2011-09-06 18:02:20: Listener for "coinserver1 test": 06/09/2011 18:02:20, Problems communicating with bitcoin RPC 0 2
2011-09-06 18:03:05: Listener for "coinserver3 test": 06/09/2011 18:03:05, Problems communicating with bitcoin RPC 0 2
2011-09-06 18:03:16: Listener for "coinserver1 test": 06/09/2011 18:03:16, Problems communicating with bitcoin RPC 0 2
2011-09-06 18:04:01: Listener for "coinserver3 test": 06/09/2011 18:04:01, Problems communicating with bitcoin RPC 0 2
2011-09-06 18:04:57: Listener for "coinserver3 test": 06/09/2011 18:04:57, Problems communicating with bitcoin RPC 0 2
2011-09-06 18:05:07: Listener for "coinserver1 test": 06/09/2011 18:05:07, Problems communicating with bitcoin RPC 0 2
2011-09-06 18:05:53: Listener for "coinserver3 test": 06/09/2011 18:05:53, Problems communicating with bitcoin RPC 0 2

Restart your miner and see if you get that error.

Now on to rejected shares caused by unknown-work reason!

I think I will add a dashboard feature that breaks down the rejected shares. Something like this...

Code:

stale   |duplicate    |unknown-user    |unknown-work   |time-invalid   |
5       |1            |11              |152            |1              |
------------------------------------------------------------------------

The issue with this is that bad users will have a chance to see more data to hack the system. Ah well maybe I'll disable it after the fix is done?

DavinciJ15

hero member

Activity: 780

Merit: 510

Bitcoin - helping to end bankster enslavement.

Oh BTW if you are mining with nmcbit.com it will work but not if you are mining with the IP or coinserver#.nmcbit.com

DavinciJ15

hero member

Activity: 780

Merit: 510

Bitcoin - helping to end bankster enslavement.

If you restart your miner the error

Code:

 Problems communicating with bitcoin RPC

should go away now let me know if it does not.

DutchBrat

hero member

Activity: 868

Merit: 1000

Davinci thanks,

Everything works like a charm again, nice going !

Let's find us some blocks !

Brat

DavinciJ15

hero member

Activity: 780

Merit: 510

Bitcoin - helping to end bankster enslavement.

Quote from: DutchBrat on September 04, 2011, 10:46:30 AM

Total shares for this round also does not add up

Brat

All fixed. Now.

DavinciJ15

hero member

Activity: 780

Merit: 510

Bitcoin - helping to end bankster enslavement.

Quote from: DutchBrat on September 04, 2011, 10:46:30 AM

Total shares for this round also does not add up

Brat

I will fix that just going to prioritize a few things.

DavinciJ15

hero member

Activity: 780

Merit: 510

Bitcoin - helping to end bankster enslavement.

Pushpool died on coinserver1.nmcbit.com I need to take pushpool off that server because it also serves up the web.

coinserver2, 3 and 4 are dedicated pushpool / namecoin servers.

Also I know the round counts are off not sure why but it's a different counter than the one used for individual miners as I can't do a select count(*) on the shares table as it would take to long.

I will try and implement the same thing I did for the individual workers but that will take time.

Sorry been busy unpacking and fixing up the house the wife was on my ass.

Davinci

DutchBrat

hero member

Activity: 868

Merit: 1000

DutchBrat

hero member

Activity: 868

Merit: 1000

Davinci,

ALL my miners just disconnected !

Haven't seen that in a long long time

Any idea what's up ?

Brat

edit: Upstream RPC errors again. Site is slow again as well... must be database issues

DutchBrat

hero member

Activity: 868

Merit: 1000

Total shares for this round also does not add up

Brat

DutchBrat

hero member

Activity: 868

Merit: 1000

Quote from: DavinciJ15 on September 02, 2011, 09:17:06 PM

As you can see from our stats the total invalid shares are 3500 of 110,000 that's over 3% and although it's not a disaster it's not good. If you have rejects greater than 3% let me know I will look into your shares and see what the reason is.

Davinci

BTW

I am working on the balances and I did have to reboot one of the servers that would end up having a lot of shares go bad.

After rebooting I had no more issues !

Total shares for the round seems to be way off, if you add together the totals for the respective miners of everyone it should be much lower, something like 60K shares less as I write this

Brat

Topic: [20 gh] NMCBit pool 3% fee prop 6.6% PPS - page 29. (Read 63693 times)