Topic: [Klondike] Case design thread for K16 - page 7. (Read 37921 times)

http://www.supermicro.com.tw/products/system/1u/6015/sys-6015x-8.cfm  <---- Casing for the 1U design. http://www.mkl.co.id/ <--- can get them in Indonesia here.

So can a Raspberry Pi, Arduino or BeagleBone run this server or the K64 Cube can you put it somewhere in your modular design?

Revised 1U Rack Mount




Love the K64 CUBE... stacking them and placing them in a room you can save on heating costs or use them in greenhouses. I am imagining them in cylinders.
Those heat sinks might be very expensive but in a cold climate you could certainly use that extra heat. Might want to see if there are some off the shelf heat sinks that can do the same thing or can be extruded. Change the angle of the heat sinks and get penta, hex, hepta and octogonal shapes.

You can cut existing heat sinks on a bevel... and I bet you can even have that design in an extruded version without having to cut it. It definitely would not be as pretty but it could be done and it would look a bit more utilitarian but would work very well.

Nice! That's genius

Here's an idea I had. It's not really feasible since the heat sinks aren't readily available and would be crazy stupid to custom make. It was fun to put it together in Sketchup though.

What if you could make a heatsink like this?


They would fit together with the Klondike 16 board on the back, like this:

Notice how the pin placement is more dense towards one end of the heat sink.

When you put four together, they create a tunnel:


Less dense end. This is where you blow air in:


Dense end. This is where you want the air to come out:


Now, since there are more pins towards one end of the tunnel, more heat will be given off in the denser end. Thus, the board temperature is the same in both ends.

So, make a case of plexiglass boards and some screws/rods:


Put some fans and feet on, and you are good to go:


Those are two 140mm fans, which will ensure good airflow both inside the heat sink tunnel and over the top of the boards. Air is sucked in at the bottom, and pushed out on top, working with the natural flow of hot air.

Voilla! The K64 cube.

So, the heatsink I made up for this design is, as I said, not feasible. However, it would be possible to use the same tunnel design with a normal heatsink - but the chips towards the top of the cube would get a little warmer than the chips on the bottom.

The cubes could be arranged in a square at least 2x2 for a 256W space heater.

beagleboard? coinninja looks to have a nice anubis + cgminer cum mobile phone distro.

I am working on the idea of a 1U for 256+ chips the 512 would need to be at least 2U to fit 50mm fans. Search online for the specs as there are number of different configurations.

As for heat there are two banks of fans push and pull so there won't be too much of an issue with that given some of the server designs I have seen that utilize this same design even with more restricted airflow and generate as much or more heat given the PSUs they use as I stated above the GPU servers are much hotter. Have to remember the design is spread out over a much wider surface area and fans blowing over the entire area so heat should not be such an issue given the CFM is proabably more than sufficient. Anyhow having looked at various cases the max in a 1U could be a K256 with only 512W so no heat issue then.

I will post some new mock ups for that tomorrow.

Need something to fit in the case?  http://cubieboard.org/

That 512 chip monster would be pulling more than 1kW. That's a lot of heat. Yes, the rear will be very hot.

I'm working on my own design for four K16 boards in Sketchup now, will post it later tonight.

I think you're going to have too much heat near the rear of that... Maybe a second row of fans in the middle to help move the air?
I think the higher velocity fans are about twice as thick as those too...

Re: the rackmount chassis -- excellent design, great work. How long is that design? It'd be nice if there was some extra room for some sort of controller -- maybe we could cram a raspberry pi in there?

Ya I didn't add that to the model... I was using an older BKKCoin design... need to add that for the next one. Also parts are not to scale just eyeballed except the QFN48 size. Just wanted something that I can mock up fast not too detailed. But yes need that has to be added just so that cabling can be assessed. Problem with the design as well boards are not oriented to the KLego design that BKKCoins specified. Just trying to fit the boards into the space and orient the heat sinks along the axis flow of the air.

Hi ,
Just small remark
I do not see the power connector in your 3D

You guys have some great case ideas! I have several hundred chips on order which are destined to be K16's and I can't wait to pick a beautiful home for them

SketchUp 8. I will post up some models in a few days when I get time.

http://www.sketchup.com/
http://sketchup.google.com/3dwarehouse/

It is smooth not very turbulent through the fins it is basically less turbulent than the Avalon design given the proximate distance to the fins and as the fans are face mounted this will provide a much more stable and direct airflow across the fins even without baffles. Unless you have a simulator shows airflow I suspect you are speculating just as much as I am?

Testing this will not be an issue since the modular design of the boards means break down and re-configuring is simple. So I will be testing it with and without baffles to see what happens and get temp readings. Having a larger opening (volume) at the front and smaller space (volume) at the back along with having 2 banks of fans I don't think there will be any issues given this is based right off other server designs with a lot more obstruction of the airflow. I don't see this being an issue at all but again I will test it out and provide feed back. If it works I'll throw up the SketchUp plans so people can modify them for KICAD or what not be keen to see others work on this as well.

The heat would be trapped then... again having the larger space above will allow heat to dissipate faster... heat rises. Flipping the design as it is would trap more heat I think. Again I can test all this out and run various configurations and see. I think the best solution is to get airflow into both the upper and lower cavity and push the air out and I think I might have to given the ambient temperatures here in Indonesia. I am not interested in air-conditioning the floor just for a single unit so I will have to be very concerned with airflow. The 3 - X6500 I have at home seem to do well although they run at between 40C - 52C all the time. I suspect with the right heat sink, fan configuration the K256 in a 1U should be more than adequate without AC. If have multiple units however then I think the collocation will have to be the option or build my own data center on the 3rd floor.

The Avalon boxes have a lot of air blowing at chips and board as well as fins in their vertical configuration. The poor goop job results in less efficient heat transfer as indicated in the thread of the Avalon user who pulled the heat sinks from the PCB. But it seems Avalon is really trying to tunnel the air into a very very tight space I just want to see if I can compact this down into something that is manageable size wise. I am really keen on what might be possible with a GEN2 Avalon chip so Blade Servers or SATA Hot swappable cards could be something that works as well with the preexisting server chassis. We will see what BKKCoins finds when he gets testing boards and heat sinks but I think the Klondike is easily configured so testing this will be quite easy. Personally seeing things like the TESLA 8 GPU server in a 3U/4U configuration and some of the 2 GPU Teslas crammed into a 1U gives me confidence that if you get the air flow and heat sinks right it is possible to get this sort of density.

15% Air Flow Top (Left)
-----------
70% Air Flow Middle Fin-2-Fin Tunnel
-----------
15% Air Flow Bottom (Right)

That way you only need the fan banks front and back. 16 Fans for 16 boards seems right as that is what people will do in stack configuration anyhow. It is such an amazing design that BKKCoins has come up with. Even if you are not going to do a lot of DIY board building just configuring cases etc is going to be great fun and I bet GEN2 Klondikes will be even more versatile.

Isolated view of the low profile fin-2-fin tunnel concept for a K32 section:

I am in Indonesia and I know this is a huge issue then again our problems here are air conditioning as ambient is 28C to 33C everyday, power outages and security. So for the extra electricity costs it might be well work a collocation set up. I am checking that out now and will definitely get back to you guys about it. The other issue for me is I don't want to have to deal with having it in my school over the longer term more of a space issue. I can put a few of these K256's together but I really don't want to house them all here... I suspect that if you have any number of these the cost of water blocks and maintenance might make it worth a look to collocate if the price is right. Always about the price.

Again you can do a K256 @ 512 W and get what 72.192 GH/s in a 1U... so that is certainly not going to be an issue. As a solution 1U makes sense if you can get PSU and a empty 1U barebones chassis at a good price. Must be plenty of chassis laying around somewhere at a great price. Group Buy? I am still going to try for a more dense K512 in a 1.5U / 2U and test it out at school.

I really don't think this is the "venturi" layout you're looking for. There is no significant reduction in cross section, just a hell of a lot of turbulent flow. I really think that even with a middle row of fans you'd struggle to remove that crazy amount of heat from there.

Not flipping the boards. Take the whole box *as is* and turn it upside down. You don't change the current layout, just put it on its head.

Power IS a problem. Standard racks are 20A redundant (230V). I have 1U servers that need a half rack just for themselves, it's getting ridiculous. You can ask for more power but the prices are through the roof.

I'm seriously thinking of getting a DC in Texas or Washington (state).

The thing is typically a datacenter will bill you per rack unit, and a particular amount of power(and hence cooling expense) comes with it. Generally people that need more power buy more rack units than they need. Ive never investigated this point, but thats my understanding.

hmm... after writing the above i googled a little... it seems power is not an issue.

https://www.stackpop.com/search/colocation  hit search without entering anything, choose cabinet space 1U .. there is a provider offering 15A even...