I upgraded the firmware on all the machines when I first set them up. See the details from the overview screen below.
Its showing you have zero fans from that screenshot which will cause all kinds of odd problems. Im not sure how you have an uptime over a few minutes with no fans reporting in
It loses the fan speed response when it locks up. The uptime doesn't keep ticking past the point when it errors out, the ASIC individual chip readings don't come up, and the fans show no speed. Any of these are big red flags, but I have no reason to believe the fan speed just stopped reading and that is causing the rest of it, I think it is another symptom of whatever is going on here. Anything you can think of that would be causing it? In each of these cases, there are tons of HW in the pool section, but not necessarily on the bottom section where each board reports its errors.
Does anyone know of an S9 status page manual? The user guide isn't very thorough. I can't find anything on the HW section under pools.
If you can paste your kernel logs here or in paste.com and put the link here we will try to check if the miner is a software related issue or hardware issue...
Assuming that was the firmware you wanted to see, here is a REALLLLY long log that I hope helps shine some light on the issue. This is so strange!
https://drive.google.com/file/d/1eNrP9_NyB8gPdfHLrDxRWnDiEdd6Qwo8/view?usp=sharing