Pages:
Author

Topic: [Reward FOR answers] 50TH S1 Farm - page 2. (Read 3067 times)

newbie
Activity: 2
Merit: 0
May 09, 2014, 11:53:10 AM
#35
Hi Everyone,


I am setting up a 50TH S1 Farm

Those of you with experience on setting up larger S1 FARMS, are there anything I should be aware of?

I read that you can use server power supplies as they are cheaper, but it looks like there's quite a bit of work behind setting up the PSU for 278 machines.

What would be the most cost efficient PSU setup? What type of networking Issues should I be aware of? What is the most efficient set up? How would you deal with airflow and heat?

What is the best type of RACK to set up on?

I look forward to all your experiences, creative solutions, and help.


BTCBuyer

First you be careful with heat from ants. You can make a tower with the ants and create a wind tunnel effect to easily exhaust the heat from building you can put a big fan.

In the electric problem each ant eat 360w from the wall so if you put 278 miners you need a 100Kw line in 220v.. You needs many main switches for isolate electric problems. Dell server power supply make extreme noise. Really EXTREME. Consider hp 1000W server power supply have less noise and it's more easily for hack and make the wire connections...

For 278 ants you possibly have to pay a bill near to 5000USD / month.. nice

Additional you need control the humidity of the air and playing with this you can increase the refrigeration of the facility.

For the network you need a gigabit main router you need a gigabit enterprise router o business router. And many 48th lines 100mb switches with less than 1 gigabit line to connect with the main router. And can use a watchdog for reset automatically every ant when this stop mining for any reason.

Happy mining!
hero member
Activity: 635
Merit: 500
May 09, 2014, 09:53:22 AM
#34




But trust me, better go for larger machines in smaller quantities...  Wink



The long solid shelf you use make for a nice wind tunnel effect along with side by side for 10 or 12 miners.   those look like mdf so they won't allow heat to rise much


that setup could be improved using simple 20 inch box fans on the pull side venting much of the heat out of the building.

   obviously I am trying to get the op to avoid/lower ac cost as much as possible.

you have close to 40 in that setup the op would need 5 to 7  racks like that.  his biggest problem with your setup is access to the gear. but with 200 plus s-'1 anything other then a line of lunch tables makes the same problem.

 btw  if he gets some 1th machines it is less work.

I have an 22000 air m3/h industrial fan in the wall at the back of the shelf to suck out the warm air. Smiley

I've made the height of the shelf small because I didn't had more space. The new shelf is higher, have more space at the top of the miners, but no space between them because the cooling is better this way.

I have an other shelf but it's not shown at the picture.

I'll try to make a paint but don't laugh hard.  Grin



Had had to do this way because of the spec of the room.

If I'll able to make a new room, and If i were op i'd do this. (I'll sure do it when I arrive that point to make a new room.)



You still have enough room to check the miners.

But I'll definitely go for 1 th or bigger machines.

legendary
Activity: 4326
Merit: 8950
'The right to privacy matters'
May 09, 2014, 06:49:06 AM
#33




But trust me, better go for larger machines in smaller quantities...  Wink



The long solid shelf you use make for a nice wind tunnel effect along with side by side for 10 or 12 miners.   those look like mdf so they won't allow heat to rise much


that setup could be improved using simple 20 inch box fans on the pull side venting much of the heat out of the building.

   obviously I am trying to get the op to avoid/lower ac cost as much as possible.

you have close to 40 in that setup the op would need 5 to 7  racks like that.  his biggest problem with your setup is access to the gear. but with 200 plus s-'1 anything other then a line of lunch tables makes the same problem.

 btw  if he gets some 1th machines it is less work.
hero member
Activity: 635
Merit: 500
May 09, 2014, 02:16:57 AM
#32
If it were me, I would certainly not hesitate to use a wireless connection, even if it will be difficult to manage

Never mine with wi-fi....

But to stay on topic

Just a small batch:



And a part of...



But trust me, better go for larger machines in smaller quantities...  Wink

legendary
Activity: 1666
Merit: 1185
dogiecoin.com
May 09, 2014, 01:07:33 AM
#31
See my Sig for setup guide. 200 is the same as 1.
full member
Activity: 127
Merit: 100
May 09, 2014, 12:26:20 AM
#30
If it were me, I would certainly not hesitate to use a wireless connection, even if it will be difficult to manage
full member
Activity: 158
Merit: 100
May 09, 2014, 12:15:49 AM
#29
oh you need two internet lines not one if you go over 250 or 256.

a router taps out at  amax of 256 including the router     192.168.0.   1- 256     these 1-256 are the most you can do on 1 router.


Learn how to internets.

Use the 10.x.x.x and setup a Class A or B network. 

sr. member
Activity: 486
Merit: 262
rm -rf stupidity
May 08, 2014, 10:48:32 PM
#28
How do you plan on cooling the usable 400A of power.  Have to have power reserved for that.

I skimmed most of the post and only thing mentioned is fans.  Which with the amount of Antminers or hell any miner you have to have proper cooling for it.

Watts to BTU/hr = 3.412141633 x Watts
RT (Refrigerated Tons) from BTU/hr = BTU/hr / 12000

Or at that scale you would be buying an AC setup for a datacenter style where you would be looking at it as kW being used like with a Liebert, etc. unit.
hero member
Activity: 574
Merit: 500
May 08, 2014, 10:30:19 PM
#27
theres a really weird mix of advice in this thread, a lot of it coming from people with less than 5 antminers.

I currently run 17 antminers (and have run/sold several more on top of that). Here is my advice.

1) go with 208V power. If you are industrial you likely have 600V mains, and 208V is the most common transformer output. Its also about 3-5% more efficient than 120V.
2) use L6-30 outlets and find some PDUs (power distribution units) that match it. This gives ~4.98kW of power per outlet (after the 20% safety threshold) and is a common style that is cheap to find and install
3) get a few 48-port network switches that are 10/100 outputs. Most of these are build with a gigabit trunk so they can all daisy chain while providing plenty of good connections.
4) forget the secondary fans. Its an extra cost, wastes time to install, and is totally unnecessary in the setup you are going for.

5) you NEED the ability to ventilate the heat directly outside. a closed building requires much more air conditioning and thus even more power usage.
5b) use a hot/cold aisle design. 2 rows of shelves, exhaust from both pinted inwards, with strong fans pushing all the heat out the aforementioned ventilation to outside.
5c) you will still need a lot of AC to keep things cool, probably about 15% of the ASIC power draw if you can vent to outdoors, 30% otherwise.

6) go with DPS-2000 power supplies. These are the most effective use of space and time for getting the massive 12V amperage you will need. Alternatively, the DPS-800 can put out 1000W on a 208V input. (gigampz.com has some nice, but slightly pricy, breakout boards to make using this PSU easy)
6b) soldering fat wires to a PSU is a huge pain. either follow a method that requires minimal soldering, or invest in a proper 120W+ soldering gun that is at least $40. anything cheaper will burn up with extended use.
6c) I sell custom 16awg PCIe cables with tinned ends. They are thick wires and can handle more than enough current (beware 18awg labelled stuff from china). see my sig if you are interested in getting some - they work well if you splice a few onto thicker 10 or 12 awg wires for use with the DPS-2000.
6ci) PCIe connectors will make life easy if something needs swapping. the screw terminals are impossible to access if you stack miners or have them side by side.

7) stack the miners on thier sides,with bottoms facing the bottoms of those in the neighbouring stack. (see picture).  This will allow you to pack miners in with good density and contain the airflow across the units nicely.





Yes, the SP10 is smaller and more efficient. But it costs almost twice the $/GH. If you are bullish on BTC prices rising the S1 is by far the best option. (if you feel that in 6 months from now we will still be <$500, then by all means go for the more efficient hardware). The S1 is a solid unit with nice 120mm fans, and if you have the space and power for them they are my #1 pick.    You can always undervolt them (takes about 5-10 min per machine to do) to get <1.3w/GH when the time comes  (about 2 months by my estimate if $/BTC doesn't jump up first)

+1
legendary
Activity: 2128
Merit: 1005
ASIC Wannabe
May 08, 2014, 10:21:32 PM
#26
theres a really weird mix of advice in this thread, a lot of it coming from people with less than 5 antminers.

I currently run 17 antminers (and have run/sold several more on top of that). Here is my advice.

1) go with 208V power. If you are industrial you likely have 600V mains, and 208V is the most common transformer output. Its also about 3-5% more efficient than 120V.
2) use L6-30 outlets and find some PDUs (power distribution units) that match it. This gives ~4.98kW of power per outlet (after the 20% safety threshold) and is a common style that is cheap to find and install
3) get a few 48-port network switches that are 10/100 outputs. Most of these are build with a gigabit trunk so they can all daisy chain while providing plenty of good connections.
4) forget the secondary fans. Its an extra cost, wastes time to install, and is totally unnecessary in the setup you are going for.

5) you NEED the ability to ventilate the heat directly outside. a closed building requires much more air conditioning and thus even more power usage.
5b) use a hot/cold aisle design. 2 rows of shelves, exhaust from both pinted inwards, with strong fans pushing all the heat out the aforementioned ventilation to outside.
5c) you will still need a lot of AC to keep things cool, probably about 15% of the ASIC power draw if you can vent to outdoors, 30% otherwise.

6) go with DPS-2000 power supplies. These are the most effective use of space and time for getting the massive 12V amperage you will need. Alternatively, the DPS-800 can put out 1000W on a 208V input. (gigampz.com has some nice, but slightly pricy, breakout boards to make using this PSU easy)
6b) soldering fat wires to a PSU is a huge pain. either follow a method that requires minimal soldering, or invest in a proper 120W+ soldering gun that is at least $40. anything cheaper will burn up with extended use.
6c) I sell custom 16awg PCIe cables with tinned ends. They are thick wires and can handle more than enough current (beware 18awg labelled stuff from china). see my sig if you are interested in getting some - they work well if you splice a few onto thicker 10 or 12 awg wires for use with the DPS-2000.
6ci) PCIe connectors will make life easy if something needs swapping. the screw terminals are impossible to access if you stack miners or have them side by side.

7) stack the miners on thier sides,with bottoms facing the bottoms of those in the neighbouring stack. (see picture).  This will allow you to pack miners in with good density and contain the airflow across the units nicely.





Yes, the SP10 is smaller and more efficient. But it costs almost twice the $/GH. If you are bullish on BTC prices rising the S1 is by far the best option. (if you feel that in 6 months from now we will still be <$500, then by all means go for the more efficient hardware). The S1 is a solid unit with nice 120mm fans, and if you have the space and power for them they are my #1 pick.    You can always undervolt them (takes about 5-10 min per machine to do) to get <1.3w/GH when the time comes  (about 2 months by my estimate if $/BTC doesn't jump up first)
hero member
Activity: 574
Merit: 500
May 08, 2014, 10:02:23 PM
#25
Yoshi at Bitmain is recommending Either Dell 750W Server PSU or the HP 1200W Server PSU, for the most economic solution. Your thoughts?
We used the Dell 750's on all the S1's for our hosting customers
full member
Activity: 177
Merit: 100
May 08, 2014, 09:55:55 PM
#24
Yoshi at Bitmain is recommending Either Dell 750W Server PSU or the HP 1200W Server PSU, for the most economic solution. Your thoughts?
hero member
Activity: 658
Merit: 500
CCNA: There i fixed the internet.
May 08, 2014, 09:31:54 PM
#23
There's a new 1500 watt psu from corsair that 80 PLUS TITANIUM CERTIFIED

94% peak efficiency, 125 amps at 12 volts, single rail


Corsair ax1500i. It's an absolute monster
legendary
Activity: 4326
Merit: 8950
'The right to privacy matters'
May 08, 2014, 08:40:51 PM
#22
kendog is correct that 400 amps does not  do  100k watts unless the power is 440 multi phase   but at 220 208 or 110 not enough power.

oh my last shot of  the six ants running

you want ant monitor  the monitor I am using  link

https://bitcointalksearch.org/topic/m.6548589

but start small  maybe 15  or get 3 of the 16 port switches.

  do 1 into 2.  check for latency issues   since 1 switch can do 15 switches giving you 200 plus ants.

feel free to ask me in a pm about setting up but frankly I am not a fan of the dells



member
Activity: 119
Merit: 10
May 08, 2014, 08:39:36 PM
#21
Maybe Industrial with 440V or 575V
hero member
Activity: 742
Merit: 500
May 08, 2014, 08:33:12 PM
#20
I read the dell Server PSU are the best.

To clarify, I have 400Amps, There's more than enough juice to run 100,000watts.

Is it hard to convert the 750W Dell PSU to run S1s?

400 amps is not enough to run 100 kW

Only 80% is useable, which means this is the max:
400A * .8 * 240V = 76.8 kW
400A * .8 * 208V = 66.5 kW
legendary
Activity: 4326
Merit: 8950
'The right to privacy matters'
May 08, 2014, 08:22:48 PM
#19
Well 50th is not a toy farm

I wish I had a space to run 100 or so.

 2  more  shots  four more  powered by an evga 1300 and a sea sonic 1000




these have the two fans  each.
One is  stock and the second is the delta running flat out.  you always want the pull fan running faster then the push fan.

  they run loud but cool in the garage.
 The  solid shelf with all four  stacked side by side with the double fan creates powerful wind tunnels. I did find there is a ton of heat above the row of s-1s a fan above would help to cool the gear down



member
Activity: 119
Merit: 10
May 08, 2014, 08:16:00 PM
#18
Well 50th is not a toy farm
legendary
Activity: 4326
Merit: 8950
'The right to privacy matters'
May 08, 2014, 08:09:27 PM
#17
 Thanks trends    I think your idea has merit if the op has the correct people set it up.


To the op these miners are better off side by side on a solid surface in long rows.  think lunch room tables.

when the miner is side by side to a second miner they make a wind tunnel so ten side by side have  only 2 blades not in a wind tunnel the left and right ends do not get a wind tunnel effect every other blade in the long row best the wind tunnel.  the solid surface  also helps that tunnel effect.

I will take a shot of a very small s-1 farm to show what I mean

the center blades  have a wind tunnel


ten in a row with the psu out of the way would be ideal

member
Activity: 119
Merit: 10
May 08, 2014, 08:01:39 PM
#16
No I don't have any Pictures, I'll leave that to the OP to research if he understands the concept! if not he should hire a EE or a good electrician
Pages:
Jump to: