Pages:
Author

Topic: An (even more) optimized version of cpuminer (pooler's cpuminer, CPU-only) - page 54. (Read 1958546 times)

member
Activity: 80
Merit: 10
BitcoinRaffle.co
I did that, but then I get:

dyld: Library not loaded: /opt/local/lib/libssl.1.0.0.dylib

I'm running 10.7.4
hero member
Activity: 842
Merit: 507
I'm getting this error on OS X:

dyld: Library not loaded: /opt/local/lib/libidn.11.dylib
  Referenced from: /Users/longdongsilver/./minerd
  Reason: image not found
Trace/BPT trap: 5

Stupid question: did you try installing libidn via macports?
Also, what version of OS X are you running?
full member
Activity: 206
Merit: 100
Mostly Harmless...
I was just wondering if you had it installed.  If not, and it threw that error, it might be a misconfiguration on my part.

Not really sure though.
member
Activity: 80
Merit: 10
BitcoinRaffle.co
Not sure what you mean by "using" macports.  I just installed it, but it still didn't work.  Do I need to build minerd from source? 
full member
Activity: 206
Merit: 100
Mostly Harmless...
I'm getting this error on OS X:

dyld: Library not loaded: /opt/local/lib/libidn.11.dylib
  Referenced from: /Users/longdongsilver/./minerd
  Reason: image not found
Trace/BPT trap: 5

Are you using macports?
member
Activity: 80
Merit: 10
BitcoinRaffle.co
Quote
Just compiled a version for OSX if anyone wants it:

http://bitcoin.phraust.com/CPUMINER-2.2.2-OSX.zip

I'm getting this error on OS X:

dyld: Library not loaded: /opt/local/lib/libidn.11.dylib
  Referenced from: /Users/longdongsilver/./minerd
  Reason: image not found
Trace/BPT trap: 5
sr. member
Activity: 271
Merit: 250
Version 2.2.2

  • On Windows, thread priority is now set instead of process priority. This should solve most problems concerning system responsiveness.

Would this change have any effect on a single GPU dedicated miner running win7. Would a certain number of threads be recommended to ensure the GPU miners performance is never degraded or interfered with?

Currently on a quadcore I dedicate core #3 to phoenix and then allow minerd cores 0,1,2 for mining either litecoin or bitcoin. Anyone have any opinions on a more optimum setting?
full member
Activity: 206
Merit: 100
Mostly Harmless...
Just compiled a version for OSX if anyone wants it:

http://bitcoin.phraust.com/CPUMINER-2.2.2-OSX.zip

**EDIT**

Been running it for about 15 minutes now, it's running about 2-3 khps faster!  yay!

**EDIT-EDIT**

With some help from pooler, I've recompiled it with the AVX instruction set, so it's even faster (was 2.4 kh per thread, now it's 3.7!!)
hero member
Activity: 842
Merit: 507
Will those speedups be visible while running on a 32 bit OS underneath ?
The short answer is: only for Intel Atom. Other CPUs running in 32-bit mode shouldn't see any significant difference in performance.

Nevertheless, all Windows users are encouraged to upgrade, because of point #2 above:
  • On Windows, thread priority is now set instead of process priority. This should solve most problems concerning system responsiveness.
hero member
Activity: 518
Merit: 500
Version 2.2.2

  • Modest speedups for all x86-64 processors, ranging in most cases from 1% to 3%; about 4% for AMD K8, and about 8% for Intel Atom.
  • On Windows, thread priority is now set instead of process priority. This should solve most problems concerning system responsiveness.
  • scrypt is now about 12% faster on ARM11.
  • Fixed a bug that only made one CPU core accessible on Android.
  • A new option (--background) is available to start minerd as a daemon on *nix systems.

The source code is, as always, available at GitHub. Windows binaries are available here. Please note that I have updated DLLs to the latest version of libcurl; older DLLs are no longer needed.

Thanks go to guruvan, xurious and aaa801!

Will those speedups be visible while running on a 32 bit OS underneath ?

In summary, any benefit upgrading to this version for mostly Intel 64 bit CPUs running on 32 bit Windows OSes ?

Thanks !
hero member
Activity: 842
Merit: 507
Version 2.2.2

  • Modest speedups for all x86-64 processors, ranging in most cases from 1% to 3%; about 4% for AMD K8, and about 8% for Intel Atom.
  • On Windows, thread priority is now set instead of process priority. This should solve most problems concerning system responsiveness.
  • scrypt is now about 12% faster on ARM11.
  • Fixed a bug that only made one CPU core accessible on Android.
  • A new option (--background) is available to start minerd as a daemon on *nix systems.

The source code is, as always, available at GitHub. Windows binaries are available here. Please note that I have updated DLLs to the latest version of libcurl; older DLLs are no longer needed.

Thanks go to guruvan, xurious and aaa801!
hero member
Activity: 842
Merit: 507
Running with "--no-longpoll" gives no HTTP errors at all.
But also no shares (neither valid or invalid but zero shares, even when playing with the scantime).
That is the strangest thing of all, and even though I tried I cannot reproduce the problem. With or without long polling, with or without a proxy, I always get shares. It is possible that some of the shares are detected to be stale and are not submitted, but unless the server (or the proxy) is very slow to respond that shouldn't happen frequently. Try using the -D option to see if that is the case.

Now, let me try to make a list of the various errors that have been reported.

Code:
HTTP request failed: The requested URL returned error: 503
I tried mining at MaxBTC for a couple hours, but I was unable to reproduce the problem. I'll keep trying.

Code:
HTTP request failed: Recv failure: Connection reset by peer
If we are to believe libcurl, this means that the connection was closed by the remote server.
I don't think there's much the miner can do to avoid the error, apart from silently ignoring it. Maybe I should consider doing that for the long polling connection?

Code:
HTTP request failed: necessary data rewind wasn't possible
Under "normal" conditions, data rewind shouldn't be needed: it is usually only necessary for resuming interrupted uploads or for multi-pass authentication.
I suppose the "Operation timed out after 30001 milliseconds with 0 bytes received" error is linked to this.
Implementing data rewind is pretty simple in our case, and cannot do any harm, so I will try to implement it and see if anything changes.
full member
Activity: 225
Merit: 100
Pontius, have you tried disabling long polling to see if you still get the same kind of errors?

Running with "--no-longpoll" gives no HTTP errors at all.
But also no shares (neither valid or invalid but zero shares, even when playing with the scantime).
hero member
Activity: 842
Merit: 507
Pontius, have you tried disabling long polling to see if you still get the same kind of errors?
full member
Activity: 225
Merit: 100
Oh, sorry for the confusion, I guess I forgot to mention that the 503 only occur while mining with MaxBTC.

Here's a dump with HTTP/503:
Code:
* Re-using existing connection! (#0) with host 
* Connected to () port 8080 (#0)
* Server auth using Basic with user 'pontius-X'
> POST http://pool.maxbtc.com HTTP/1.1
Authorization: Basic xxxxxxx
Host: pool.maxbtc.com
Accept-Encoding: deflate, gzip
Proxy-Connection: Keep-Alive
Content-Type: application/json
Content-Length: 45
User-Agent: cpuminer 2.2.1
X-Mining-Extensions: midstate

< HTTP/1.1 200 ok
< Content-Type: application/json
< X-Long-Polling: /LP
< X-Roll-NTime: Y
< Date: Thu, 07 Jun 2012 05:42:29 GMT
< Cache-Control: proxy-revalidate
< Content-Length: 591
< Proxy-Connection: Keep-Alive
< Connection: Keep-Alive
<
* Connection #0 to host left intact
[2012-06-07 07:42:29] JSON protocol response:
{
   "id": 0,
   "result": {
      "target": "000000000000000000000000000000000000000000000000ffffffff00000000",
      "midstate": "9fa7831e50c9e43a92f2aaa7e86cbf2d62836150ac678514ab5d31a9838a633d",
      "hash1": "00000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000010
000",
      "data": "00000001407cc21cd077099d5c944dbce6384bf58e2c129d23a490d20000043100000000cbc3af0622980995aa5f88581cea83e60ba4774cb8cfd331f92d6b
176d23ae834fd03f3e1a0a8b5f00000000000000800000000000000000000000000000000000000000000000000000000000000000000000000000000080020000"
   },
   "error": null
}
* The requested URL returned error: 503
* Closing connection #0
[2012-06-07 07:42:30] HTTP request failed: The requested URL returned error: 503
[2012-06-07 07:42:30] JSON protocol request:
{"method": "getwork", "params": [], "id":0}

About the proxy  - it is a NetCache NetApp/6.0.5 and is non-public, no chance for you to use it.
hero member
Activity: 842
Merit: 507
Pontius: regarding 503 errors, they must be generated by the proxy you're connecting through. I contacted p2k, the author of the ecoinpool software used by OzCoin, and he said that under no circumstance the server emits 503 errors.

This one looks like a proxy issue. But if so why is this only with cpuminer?
That is the question. Smiley

Just for testing, I tried mining against eu.ozco.in through a public proxy server for a few hours, but I got no errors. At this point I wonder if this is an issue with the particular proxy you're connecting to. Is it a public one, or is there any way I could connect to it to do some direct testing?
full member
Activity: 225
Merit: 100
No, this doesn't occur at startup but during runtime (might be after a few seconds, might be after minutes of mining).

Code:
* Re-using existing connection! (#0) with host 
* Connected to (proxy ip) port 8080 (#0)
* Server auth using Basic with user 'pontius.X'
> POST http://eu.ozco.in HTTP/1.1
Authorization: Basic xxxx
Host: eu.ozco.in
Accept-Encoding: deflate, gzip
Proxy-Connection: Keep-Alive
Content-Type: application/json
Content-Length: 45
User-Agent: cpuminer 2.2.1
X-Mining-Extensions: midstate

< HTTP/1.1 200 OK
< X-Long-Polling: /LP
< X-Blocknum: 183252
< Server: ecoinpool/0.3.17
< Date: Wed, 06 Jun 2012 08:32:48 GMT
< Content-Type: application/json
< Cache-Control: proxy-revalidate
< Content-Length: 374
< Proxy-Connection: Keep-Alive
< Connection: Keep-Alive
<
* Recv failure: Connection reset by peer
* Closing connection #0
[2012-06-06 10:31:59] HTTP request failed: Recv failure: Connection reset by peer
* Connection #0 to host left intact
[2012-06-06 10:32:00] JSON protocol response:
{
   "error": null,
   "result": {
      "data": "00000001528fa730126f0141b1f42c33b968e0d3cde2e9e171c4a221000007fa00000000c65a5758e232e448e1d1848014c1da7ce2d2604e5466c0342b402d7440d8fcef4fcf15991a0a8b5f0000000000000080000000000000000000000000000000
0000000000000000000000000000000000000000000000000080020000",
      "target": "ffffffffffffffffffffffffffffffffffffffffffffffffffffffff00000000"
   },
   "id": 0
}
[2012-06-06 10:32:00] JSON protocol request:
{"method": "getwork", "params": [], "id":0}

And here's another one:
Code:
* Connection died, retrying a fresh connect
* necessary data rewind wasn't possible
* Closing connection #0
* Issue another request to this URL: 'http://eu.ozco.in'
* About to connect() to proxy port 8080 (#0)
*   Trying ... * TCP_NODELAY set
* connected
* Connected to port 8080 (#0)
* Server auth using Basic with user 'pontius.X'
> POST http://eu.ozco.in HTTP/1.1
Authorization: Basic xxxxxx
Host: eu.ozco.in
Accept-Encoding: deflate, gzip
Proxy-Connection: Keep-Alive
Content-Type: application/json
Content-Length: 45
User-Agent: cpuminer 2.2.1
X-Mining-Extensions: midstate

* Operation timed out after 30001 milliseconds with 0 bytes received
* Closing connection #0
[2012-06-06 14:44:27] HTTP request failed: necessary data rewind wasn't possible
[2012-06-06 14:44:27] json_rpc_call failed, retry after 30 seconds
[2012-06-06 14:44:57] JSON protocol request:
{"method": "getwork", "params": [], "id":0}

This one looks like a proxy issue. But if so why is this only with cpuminer?
hero member
Activity: 842
Merit: 507
Pontius, that's strange. I have briefly tested Bitcoin mining at OzCoin and BTCGuild and everything seems to work fine.
Do you get the error as soon as you start the miner, or only after some time?

By the way, I ignore what those pools' particular software mean by 503, but usually status code 503 means "The server is currently unable to handle the request due to a temporary overloading or maintenance of the server".

I would try running the miner with the protocol dump turned on  (-P flag), maybe that could provide some clue as to what's going on.
full member
Activity: 225
Merit: 100
pooler, there seems to be a problem with cpuminer when connecting (mining):

Code:
[2012-06-05 14:35:55] HTTP request failed: The requested URL returned error: 503
[2012-06-05 14:36:25] Long-polling activated for
[2012-06-05 14:41:59] HTTP request failed: The requested URL returned error: 503
[2012-06-05 14:43:22] HTTP request failed: necessary data rewind wasn't possible
[2012-06-05 14:43:22] json_rpc_call failed, retry after 30 seconds
[2012-06-05 14:44:23] HTTP request failed: necessary data rewind wasn't possible
[2012-06-05 14:44:23] json_rpc_call failed, retry after 30 seconds
[2012-06-05 14:45:32] HTTP request failed: The requested URL returned error: 503
[2012-06-05 14:46:02] Long-polling activated for

I tried with three different pools (OzCoin, MaxBTC, BTCGuild) and three different miners (cpuminer, cgminer, ufasoft) and I get those HTTP errors only with cpuminer.
Setups to reproduce this:

Quote
minerd -V
cpuminer 2.2.1
libcurl/7.22.0 GnuTLS/2.12.14 zlib/1.2.3.4 libidn/1.23 librtmp/2.3

Quote
minerd -V
cpuminer 2.2.1
libcurl/7.21.7 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6

Any idea what's going on here?
hero member
Activity: 1596
Merit: 502

Well, to be honest I doubt RAM can affect the miner's performance. All the memory used by the miner should fit into L2 cache.

I am not speaking of memory in terms but talking about the memory timings, tighter-lower ram timings = greater performance in any application Smiley.

If you have several different sticks of ram "value to performance" and test it with the same processor, I bet you will see a noticable increase of mining with performance ram.
No, you won't see an increase if the memory you need is smaller than cache size because the memory won't be read because the cache knows whats in it.
Pages:
Jump to: