OK, finally gone thru all the logs to work out why we got a second orphan
There's really no reason other than block distribution within China must have some bias ... ... ...
For all relay nodes, our block was there first, including on the Beijing relay node ...
The non-Chinese nodes we were well ahead.
The Beijing node we were 1.169s ahead.
The relay itself has been pretty fucked for the last few days, and US-West has been dead for about 3 days (and still is)
Beijing relay node has been only sending blocks, no transactions, for a few days and that was only fixed 20 minutes before our orphan.
Also note that the Beijing relay says "This node sponsored by: f2pool" ... ... ...
That's probably not the cause, but I thought I'd mention all that.
I started setting up a second CN node last night, I'll make sure it's complete today, to see if that can help in any way.
Here's the run down of what happened:
Block: 417949
Our orphan: 000000000000000005077915f4248c8a9628ccdb32f707707682f78db3154b65
HaoBTC: 00000000000000000138e9108b99f844734c4471818ab2cedecad27622d4e3f6
Confirmed by: FUPool (266kB block)
Our share arrived on the main node:
19:05:21.158
Our block arrived on the CN node
19:05:21.254
Our block accepted by CN node
19:05:22.853 (yep clearly a bit of a delay there, 1.599s)
block processing times on the CN node last 233 blocks: avg 0.361s
Our block sent to CN relay
19:05:22.912
HaoBTC block from the CN relay:
19:05:24.081 (1.169s later)
For the rest of the relays I directly monitor:
19:05:21.626 Us on US-East
19:05:22.029 Us on JP
19:05:22.511 Us on EU
19:05:23.770 HaoBTC on EU
19:05:24.935 HaoBTC on JP
19:05:25.074 HaoBTC on US-East
(N.B. US-West has been dead for about 3 days)