I've noticed that some algos misreport their benchmark results if you run it under --benchmark with --time-limit.
A good example is c11:
cpuminer-opt --benchmark --time-limit 120 -a c11
This will run and will show steady 700kHs on my i7 4770, but at the end it will spur up and report 1791kHs.
I am automating the benchmarks and caught this too late -- cpuminers show a single-line result as last line in hashes per second.
I extract that and put into mining profitability calculation as seen here:
https://hmage.net/minerstats.php#cpu_i7_4770_ocI then graph that to see the trends here:
http://grafana.hmage.net/dashboard/db/miner-statsAs a result, I will need to manually rerun all benchmarks that showed cpuminer-opt as favourable.
[EDIT]: Same with sib -- last line reports 1333333, but real speed is 486350.
I haven't paid any attention to benchmark other than a sanity test before connecting to a pool.
Didn't realize anyone was using it for anything useful.
I know of one change I made that can affect first and last result, I moved the share submission up
before the hash display. The change never produced a significant improvement but I never backed
it out. I'll look into it further when I solve the ZR5 problem,
Edit: I presume the error you are seeing is in the "Benchmark:" hashrate display. I don't see how the change
I mentioned above could have caused this. Furthermore this display uses a unique formatting function.
I don't think it's my bug. I had made another change which would show a lower benchmark rate because I
was counting the entire miner thread loop time instead of just the scan time but, again, I don't see how that change
could have produce the error you are seeing.
The "Benchmark" rate should be the same number as the previous "Total" rate because it is using the same variable.
This suggests a formatting error. Anyway I'll have to investigate further tomorrow.
Edit2: This is what I get, I don't see the problem.
[2016-05-11 09:39:03] CPU #5: 246.93 kH, 47.87 kH/s
[2016-05-11 09:39:03] CPU #2: 122.98 kH, 50.54 kH/s
[2016-05-11 09:39:03] CPU #0: 55.23 kH, 48.31 kH/s
[2016-05-11 09:39:04] CPU #6: 52.29 kH, 48.96 kH/s
[2016-05-11 09:39:04] CPU #1: 167.29 kH, 55.89 kH/s
[2016-05-11 09:39:04] CPU #3: 260.19 kH, 46.91 kH/s
[2016-05-11 09:39:04] CPU #7: 49.19 kH, 57.17 kH/s
[2016-05-11 09:39:04] Total: 1206.99 kH, 406.06 kH/s
[2016-05-11 09:39:06] CPU #7: 262.14 kH, 115.02 kH/s
[2016-05-11 09:39:06] Total: 1419.94 kH, 463.92 kH/s
[2016-05-11 09:39:07] CPU #5: 262.14 kH, 67.54 kH/s
[2016-05-11 09:39:08] CPU #4: 262.14 kH, 52.88 kH/s
[2016-05-11 09:39:08] CPU #0: 262.14 kH, 55.62 kH/s
[2016-05-11 09:39:08] Benchmark: 463.92 kH/s
463916
Edit3: I ran the test several times with both algos and alway produced the correct result.
Could your script be misinterpreting? Without further information on how to reproduce
I consider this issue closed.