"The 1060's fan seems to want to spin up, but then doesn't and seems to have this constant fan jiggle/wiggle like it's trying to start up. "
Theres your tattletail right there. You dont haven enough power available from your one 1000w to power all those cards, motherboard and hard drive. The jerking motion of the fan is a symptom of not enough output of the PSU.
Before overclock and undervolting
(6) 1070 @ 150w ea =900w
(2) 1050 @ 75w ea =150w
(4) 1060 @120w ea=480w
Total 1530w.
You are well over the 1000w rating of the PSU. In your post you mention that you got another 1000w PSU so if you are running 2 we need know what all you have connected to PSU#1 and #2. Dont forget the motherboard, cpu/fan and hard drive all draw power too. Most use 200w for those combined as a value when figuring out a mining rig setup.
If he has another configuration it would be best to actually test that GTX 1060 and get confirmation that card is working normally outside this rig. That rig is little to big to make test on it before he can test all non working components outside of that combo.
Nah. I have 2 of these motherboards (3rd is on the way) and ive seen his symptoms. He has a PSU overloaded. The stereotypical sign is the fans herking and jerking, red on the PCIE status boot up screen for the slots affected . 6 of those 1070s AND the motherboard powered by just one 1000w PSU and you have an overloaded PSU. He needs to split he 1070s up by powering 3 of them to each PSU.
Heres what I would do....
PSU 1
(3) 1070 @150w =450w
(2) 1060 @120w =240w
(2) 1050 @75w =150w
Total 840w
PSU 2
(3) 1070 @150w =450w
(2) 1060 @120w =240w
Motherboard @200w
Total 890w
And of course after overclocking and undervolting (Reduced TDP for Nvidia cards) the total power draw will be even less.
I would use TDP of 65% and +150/+500 for the 1070&1060 cards and 75% TDP and +150/+500 for the 1050 TI cards. This will reduce power consumption substantially without slaughtering hash rates. These settings have worked well for me. My rig#2 is all Nvidia cards (1080,1060,1050TI) and its stable as hell.
Thank you for your input.
I decided to follow your input and break up the cards to different PSU's, but still have an issue:
ATTEMPT 1PSU 1 (EVGA GQ 1000w):
(3) 1070 ti @ 140w
(2) 1060 @ 100w
Motherboard @ 200w
<----- everything worksPSU 2 (EVGA G2 1000w)
(3) 1070 ti @ 140w <-------- 2 cards power up normally, but
the 3rd has that fan wiggle/jiggle... swapped it out for a 1060... same issue...
ATTEMPT 2:PSU 1 (EVGA GQ 1000w)
(4) 1070 ti @ 140w
Motherboard @ 200w <---- everything works
PSU 2 (EVGA G2 1000w)
(2) 1070 ti @ 140w
(2) 1060 @ 100w <------- both 1060's (previously worked in Attempt 1) fail to spin up fully and both have that wiggle/jiggle...
ATTEMPT 3:PSU 1
(4) 1070 ti @ 140w
Motherboard @ 200w <---- everything works
PSU 2 (EVGA G2 1000w) changes:
(2) 1070 ti @ 140w
(2) 1050 @ 75w <----- everything works...
Could it be that the G2 PSU isn't supplying enough power and may be faulty?
I can't see why the second PSU, which is a newer model and also is gold rated at 1000w from EVGA is unable to power up three 1070 ti video cards, or even two 1070 ti and two 1060 cards.
I am stumped
Thanks for your time and help.
Excellent troubleshooting and detailed results along with test setup. Your results all point to the PSU#2 being bad. Internally we know (with your info provided) That all common points in the power conditioning of the PSU are good. The output current capacity is doubled by paralleling rectifiers (this cheaper than installing just one high current output). It sounds like you lost one of them or the controlling electronics but I believe those are common to both rectifiers.
To totally prove PUS#2 as bad just swap PSU 1 and 2 position and see if all the problems move to PSU#1 spot. If the problems do move to there then PSU #2 (previous) is bad.
EVGA has 1000w PSU's for $119 and $149 (the price just went up, they were around $109. I just got 2 in last week. Great deal. They are located in B-stock on their website. Limit of 2 each type. I have the feeling my mother is going to be receiving shipment of some power supplies for me in the next state over once I hit my limit. hahahaha
EVGA sold out of the one model. But they still have the one for $119. Both of mine came with everything they do when bought new.
https://www.evga.com/products/product.aspx?pn=210-GQ-1000-RXWell, I received an identical brand new replacement EVGA G2 1000w PSU within less than 24 hours... gotta love Amazon's customer service!
I am still encountering the issue. I removed all of the old cables, and used all of the new ones from the new PSU.
Attempt 1:
PSU 1 (EVGA GQ 1000w)
(4) 1070 ti @ 140w
Motherboard @ 200w <---- everything works
PSU 2 (NEW EVGA G2 1000w) changes:
(2) 1070 ti @ 140w
(1) 1060 @ 100w <----- 1060 wiggles and jiggles, have tried the other three and they do the same...
or
(2) 1070 ti @ 140w
(2) 1050 @ 75w <---- everything works
I can for the life of me figure out what is going on... perhaps some kind of circuitry protection for the G2?
I have noticed something interesting that I may have originally missed.
In the VGA cable configuration, the manual states:
1.) VGA1-VGA4 should be 4 x PCI-E 8(6+2)-pin
2.) VGA5-VGA6 should be 2 x PCI-E 6-Pin + 8(6+2)-Pin
I connected cables to suggested connectors on the PSU. No Change.
My last attempt will be to swap the G2 as PSU 1 for the motherboard, cpu, ram, usb thumbrive and 4 1070 ti video cards to rule out PSU.
The only other thing is the BIOS, as it may be a finicky motherboard issue with the current 1010 BIOS and possibly downgrading the BIOS to version 1006.
Any other thoughts?
Thanks for the help and time