Topic: Mining server room (cooling development help) - page 5. (Read 22824 times)

I'm looking at your load (non cooled) to be around 75amps@120v assuming the quantity of graphics cards noted by the OP - this comes out to about 9000 watts.

At this density you need about 2.5 tons of AC to cool this properly (that's 30,000 btu unit) which will draw roughly 40 amps @120v (though mostly likely it will come in a 230V configuration).

Your total consumption is about 115 amps - leaving around 50-60 amps or so before you reach your new 200 amp limit.

In short, sure it's mechanically feasible. Looking at the project and the overhead required along with the lower density (read not as efficient) machines there is probably some room for improvement.

Personally your "finished" cost per MH should be around $1. That is a machine that does 1.2/GigH should be $1200.

 drastically small estimate -- NOT -- 1W=3.414 btu
 x48 machines -- NOT -- 48 gpu's not 48 machines

the 690w you misquote and use for your bad calculations Was a complete system with three 5870's
5870 draw 188w - 5850 draw almost 10% less 170w

48 gpu's 3 per system = 16 systems
even 16 x 2356 btu/hr = 37,632 btu/hr  less than 1/3 of your 115,000 btu

Now why the hell would you make a statement like that ? you don't know me or what I am capable of or not .. or the budget in which im doing this so why would you even assume im in over my head ?

I do have a cooling solution one that will work just fine .. what I'm asking for is Idea's on possible alternatives that may be cheaper and more cost effective

secondly did you not see by reading my posts that the power company is coming to run a new 200+ amp line to the place as currently the service is only 100 amp ? so with that combined with a electrical engineer and city permit's I do not have to worry about the "FED's" kicking in my door this has already been thought of and both the power company and the local Law Enforcement have been notified of the goings on and are welcome to come out and inspect provided they have a warrant for entry as we nixed there "Reasonable probable grounds" of entry by notifying them of what was transpiring so they can not unlawfully enter without warrant now  

lol you are so in over your head I hope you actually make it

each system is 690watts = 2400btu/hr (a drastically small estimate IMO)
x48 machines = 115,000 btu
so you will need 8 of these window air conditioners
http://www.amazon.com/LG-Electronics-LW1511ER-Window-Conditioner/dp/B004U4MLYU

I would just cool with outside air, build a wall of box fans, remove the fan from the box and grills, make a custom wall with round holes to increase fan efficiency, air comes in one window, out another, prepare for the FEDs to show up a few weeks later due to energy usage and IR imaging...

Intresting ok I'm no pro so I don't have a leg to stand on i shall talk to the partner and give open air a shot an see results and can test as nessicary to see optimal results thanks for the input

I tend to agree with this.

Years of working in poorly designed/maintained datacenters and a few good ones has taught me that "open air" only works with an overabundance of space and airflow (inefficient and more inefficient).

Yes just hook up the 1260 CFM fans to one of the output pins on the Arduino, use analogWrite() and you are good to go.  Don't forget the flyback diode.

Another thought was to incorporate it into the existing heating system at the location to warm it during the winter rather then waste all the heat

Arduino that takes temp readings across multiple probes and adjust the fan speed based on a set base temp

Just reduce the flow rate.  Get a thermostat (and a relay) for the fans.

Sounds like a plan to me
consider filters/cover the intake side.. you don't need any dust
in the winter exhaust back into the room you need the heat
in summer exhaust it outside

i mean using open stand is no-go situation: not cooling benefits, no management benefits, except visual state control, not dust/bio-proof&etc and less energy efficient[to cool it down].

Open board is the way we would like to keep it cases are not a option we have found the making small intake fans with cowling to provide a steady air intake to the cards open air cools more efficiently then a case would and we like the open air concept both for space and the modular ease of replacing dead hardware I think that by increaseing the air movement in the given room we can keep a mean ambient average and keep hot spots minimal again AC is certainly a option but I think we can effectively cool at this point with a intake exhaust system I like the partition idea simply because we can keep better control of the temperature due to segmentation I shall talk with my partner tonight and will do some more 3d modeling while we wait for the extra hardware to arrive as there is a bunch more to include in the design aspect of things


To the last person who posted please see original post in Edmonton Alberta Canada temp swings from +30 c in summer to -30c in winter so hard so not super easy to design for

36 5850s clocked to 900 and 13 5870s at 950 at the present moment awaiting to run

The current "rack" dimensions will support up to 3 rigs per shelf for a total of  72 machines I think the idea thou is to stay under 50 depending one the power our provider will give us because at I think it is 48 machines the calculated load average was 98 amps ? I think I'm going off my memory from my partner

it all depends on how many - how much power
will a dozen cased systems with dryer hose out the window do the job
all year   What works in New York is a bust is California
We can hardly guess if the person that asked for help cant provide any details

I like the mid-tower case option. You can get pretty decent (for this purpose) cases for $35 each. It wouldn't add a huge amount to the overall cost but it would make arranging the units much easier and provide a mount for exhaust tubes.

It's a shame the Supermicro GPU-centric server cases are to expensive and geared towards Tesla.  I imagine some old Dell 6X50 cases could be turned into a nice GPU rackmount with a little effort.

Just what were you trying to say
your options may not be reasonable...cost effective
It's not like I'm getting paid for designing a system

starter:
dont put it that way. or you need something like 2x3400mm "fan" just ensure. for consistent airflow[let alone exhaust].
instead:
1. put/mount in in standard[19''] rack, close it and attach to air conditioner.
2 or use usual office/from-the-shelf midi-tower PC-cases and attack 120mm pvc/composite tubes for hot exhaust, backed by external fans. at each step.

Consider fans/forced air only work if the ambient air is cooler than what you want to cool
If its 100 degrees outside its most likely warmer inside and forcing 100+ degree air on gpu's ain't gonna cool much

also from past experience if its not an air tight enclosure its better to exhaust hot air than blow in cooler air
sealing makes the difference 

Just wondered .. was doing btu conversion

you rig is about 2356 btu/hr of heat

Manufacturer is 188W, but that is about what they draw at 100% load as I have 3 of them. My rig (exc monitor) draws 690 Watts at the plug for 3 HD5870 (at 950/300).  

You'll be much more efficient with directed cooling, as you need to increase the air flow to the GPU fan, not just reduce the temperature. As an example, taking my case off and having a cold wind blow onto the rig, the GPUs reached 100 degrees (as they are close together). Putting the case on and adding 2 fans that blow the air directly onto the GPUs dropped the temperature to 76 degrees. You may not have this issue if you have lots of space, but it may help with cost effective cooling, by reducing the volume of air you need to cool.