I sorted it by comparing the output of
nvidia-smi
to the output of
nvidia-smi -q
instead of
nvidia-smi -q -d clock
The second command shows all the detail on the GPUs, while the third one only showed clock info.
With all detail, I was able to match up current fan speeds and temps to confirm that this is correct for my case:
GPU 1 = GPU 00000000:02:00.0
GPU 2 = GPU 00000000:03:00.0
GPU 3 = GPU 00000000:04:00.0
GPU 4 = GPU 00000000:06:00.0
GPU 5 = GPU 00000000:07:00.0
GPU 6 = GPU 00000000:08:00.0
I've also learned that my mixed 1070's have different power requirements, so I'm going to tweak that in 1bash and see if that can help me optimize further:
Min Power Limit : 75.00 W
Max Power Limit : 170.00 W
GPU 00000000:02:00.0
Min Power Limit : 92.50 W
Max Power Limit : 208.00 W
GPU 00000000:03:00.0
Min Power Limit : 92.50 W
Max Power Limit : 226.00 W
GPU 00000000:04:00.0
Min Power Limit : 110.00 W
Max Power Limit : 264.00 W
GPU 00000000:06:00.0
Min Power Limit : 110.00 W
Max Power Limit : 264.00 W
GPU 00000000:07:00.0
Min Power Limit : 92.50 W
Max Power Limit : 208.00 W
GPU 00000000:08:00.0
Min Power Limit : 75.00 W
Max Power Limit : 170.00 W