How do you rate the performance of that dual-white-fan in the middle? How do you rate the performance of your various cooling methods? The best and quietest one for cooling the chips would seem to me to be the tower style one in front but I notice you've got a little fan blowing at the vrm's. Have you tried putting a second fan on the back of the tower in a push-pull formation to try and get more airflow over the vrm's? would heatsinks like the ones they have on motherboards be helpful?
Are there any reference type coolers (the ones with the blower on one end) that would be feasible on this platform?
(btw, awesome job with this you guys. BFL should just send their "monarch" chips directly to you so this can be done right!
I don't think there's enough of a difference between the closed loop water cooler, the Hyper212 Evo and the Arctic Cooling Twin Turbo II to make a difference at least with my setup. You are probably better off spending the money on improving the thermal interface of your gap filler pad.
I would say
this one is good (note that with careful cutting that's enough to do 12 boards) while
this one (enough for 24 boards) is the best. They make smaller sizes too.
I don't recommend greases; while I'm pretty confident the pro assembly house will have more consistent ASIC heights than me doing the test boards by hand I am still not confident enough myself that I will get good contact on 8 chips that way.
Also note that whatever cooler you have really needs to have a backplate. You just won't be able to get adequate pressure on the ASICs without introducing too much board flex if you don't.
I would say that the Hyper 212 Evo is a good reference cooler based on price and performance, my only reservation about it is that it can be kind of fiddly to mount since the ASICs are much lower than a CPU would sit. The included standoffs are a little too long, but replacing them with
four of these fixes the problem nicely.
The GPU coolers are easier to use, since they're designed to have a die that's ~1mm off the PCB. The biggest thing is finding one that has a large enough mounting pad to cover all 8 ASICs. I know both the Arctic Cooling Twin Turbo II and the Mono Plus both work. I would guess some of the other AC ones might as well, but they're more money and you really don't need that much cooling.
Also, some people have asked me where you can get PCI brackets. I got mine at Mouser, they're Keystone item 9203
http://ca.mouser.com/ProductDetail/Keystone-Electronics/9203/?qs=sGAEpiMZZMtzcnMBgC2bs6gC270mlsjAcmixu2SULFc%3d