Yeah, there must be something wrong, I assume all gpu''s are with same settings right? Maybe some of them have not applied the settings at all, some gpus do not apply settings until it can be applied, nvidia is different than amd in that sense. I would check each one of them with HWiNFO64. If all are okay then maybe your psu is burning heat without using it, maybe one of your psu is done for, the psu's you are using are gold, 90% efficiency even on 127v outlet for that kind load.
2900w divided by 12 = 241w, this is not right if you set 125w on each. Just to make sure do this on all gpu's command line as administrator --> nvidia-smi -i 0 -pl 125
Hi Metroid, yeah all are set by a script on startup to pl 125 and pm 1, i opened nvidia-smi and it does indeed show all at 125w, when mining its like 125/125w or 124/125w, fans are set at 75%
Could be PSU also.. but i've got them for less then a month, shouldn't be whacked so fast..
I'm on a 220v, if it helps
I'm also mining with 220V, I set power limit at 80%, each card 1070 draws about 125-130W constantly, my rig includes 6 cards 1070, PSU 1300W.
Ubuntu OS should be good for mining, so I think your kill a watt might get problem, you may try to test with running only 6 cards with 1PSU, then 2PSU to check power.