Pages:
Author

Topic: A journey of extreme watercooling: Cooling a rack of GPU servers without AC. - page 8. (Read 27312 times)

donator
Activity: 1218
Merit: 1079
Gerald Davis
Are you keeping that in a DataCenter ?

No although my office is looking more and more like a datacenter.  Got to get some sleep but 24 5970s produce a lot of heat and AC cuts into my profits.  If this 1 rig test goes good my goal is to rack of 6 of these in standard server rack with a heat exchanger to a secondary cooling loop which runs outside to a very large radiator.  Dump 6KW of heat directly outside.  We will see how this 1 unit experiment goes. 
member
Activity: 73
Merit: 10
Are you keeping that in a DataCenter ?
legendary
Activity: 1764
Merit: 1006
donator
Activity: 1218
Merit: 1079
Gerald Davis
Finally got it stable and hashing.  It was brutal trying to get 4x5970 working in Linux.  Sadly BAMT doesn't work (no dice for 8 GPU in 32bit kernel).  I tried xubuntu but hosed something up installing SDK 2.1.  Tried to restore from an image I made and it wouldn't boot.  Ended up grabbing LinuxCoin (x64) and dropping in cgminer.  I don't like it but it works for now.

Code:
  cgminer version 2.3.1 - Started: [2012-02-28 12:30:03]
--------------------------------------------------------------------------------
 (5s):2935.9 (avg):2952.6 Mh/s | Q:11590  A:3272  R:57  HW:0  E:28%  U:15.06/m
 TQ: 8  ST: 9  SS: 26  DW: 1950  NB: 17  LW: 15248  GF: 0  RF: 0
 Connected to http://192.168.0.189:9332 with LP as user user
 Block: 000007200ebc4183c7cefd4ed93eea81...  Started: [16:04:46]
--------------------------------------------------------------------------------
 [P]ool management [G]PU management [S]ettings [D]isplay options [Q]uit
 GPU 0:  52.0C  960RPM | 378.0/378.7Mh/s | A:445 R: 7 HW:0 U: 2.05/m I: 8
 GPU 1:  52.5C  960RPM | 378.0/378.7Mh/s | A:399 R:10 HW:0 U: 1.84/m I: 8
 GPU 2:  49.0C  960RPM | 378.1/378.7Mh/s | A:431 R: 4 HW:0 U: 1.98/m I: 8
 GPU 3:  54.0C  960RPM | 378.0/378.7Mh/s | A:403 R: 3 HW:0 U: 1.85/m I: 8
 GPU 4:  59.0C  960RPM | 352.8/353.3Mh/s | A:396 R:10 HW:0 U: 1.82/m I: 8
 GPU 5:  58.0C  960RPM | 378.0/378.6Mh/s | A:407 R: 9 HW:0 U: 1.87/m I: 8
 GPU 6:  55.0C  960RPM | 378.1/378.6Mh/s | A:413 R: 8 HW:0 U: 1.90/m I: 8
 GPU 7:  53.5C  960RPM | 327.8/328.2Mh/s | A:378 R: 6 HW:0 U: 1.74/m I: 8
--------------------------------------------------------------------------------

Clocks are somewhat conservative but it is running @ ~3GH/s and pulling 1112W at the wall (120V).  Once it is stable it will move to the 240V PDU so it should be 20-25W less there.  One of the eight cores wouldn't clock to 835 (went sick 0Mh/s instantly) since I was tired I just left it @ 750 Mhz for right now.  It is pointed at p2pool which makes share count, U, etc "weird" due to dynamic share difficulty.

Total System Load: 1112W
Total System Hashing Rate: :2.95 GH/s
System efficiency: 2.67 MH/W
Measured (not calculated) no-GPU (not even installed in rig) system idle: 190W
GPU AC load:  230W ea
GPU DC load: ~200W ea
Total System thermal load on water loop: 800W
GPU efficiency: 3.21 MH/W.  

On edit: old pic removed (better pics below)

Note:
I don't have 30GH/s the figure comes from the potential.  3GH/s per 4U.  45U in a rack.  1U for switch, 2U for PDUs, 2U for "watchdog" server leaves enough space for 10 4U rigs.  
Pages:
Jump to: