Topic: Data Center Mining Garage and Man Mining Cave ( PART 2 !!!!!!!!) - page 31. (Read 106695 times)
March 11, 2017, 04:35:52 PM
Question to anyone Running Asrock H81 Pro BTC V2 boards, what do you guys do for headless starts?
March 11, 2017, 01:45:00 PM
@ ysylung - Waiting on more components to arrive to complete the Prototypes. For the HP Solution it will portable. Designed to be compact. You can pretty much pick them up and move them anywhere you want easily. You can also slide them into racks or shelves compartments and put an Orion Fan behind it to control heat flow. Hopefully that will help with the NOISE. These things required a Noise canceling headset for their high Pitch as my office is at 76F and I'm not even powering more then 3 GPUs. They are LOUD. I have no intentions to going back to using BOX fans unless absolutely necessary so hopefully the Orion fan designs will help keep them cool and quieter. The same prototypes can by used with any other Server PSU, it will just be different PSU placements. The 4KW will be able to drive the same solution with just PCI cables running along the side and can easily be covered for an even slicker look. I don't like noisy work environment as it's running in my garage and I have a Bitchy neighbor next to my shed.
@ Searing - Pretty cool Box - Do you have a spare Motherboard where you can place one in to give us a better idea of size? Maybe this would be great for a Racing 7 x 4 GPU setup?? If you can give me the dimensions it would be good.
@ shield132 and MettalMag - Yes the Data center picture design will work but you have to remove the recirculation part and exhaust all the HOT air outside since you're not using AC. For Intake it depends on your layout. You don't really need to go fancy and do it below ground which will be very expensive for existing infrastructure. Just plan your layout and make sure Cool air go into 1 side which is the Intake - Hot air goes to another side where you would block it off like a Chimney / Oven wall. Put your massive Exhaust fan there and remove the heat out. This way it doesn't recirculate back into the room. You don't need AC if you do it this way. The stronger your exhaust and heat wall is sealed, the closer you can get to Ambient temperature as you're not recirculating back the heat. GPUs are designed to handle over 40C ambient so you should be fine as your racks will also be cool with the flow going thru them. Just make sure intake air matches exhaust or is higher, otherwise the exhaust fans won't be at optimal performance.
To be profitable mining, it's best to keep things as simple as possible. Less to buy, less to manage, less operating cost. If you're spending too much time and money just building the infrastructure, not only are you losing money on opportunity loss but you're also leaving less $$ left over for what matters which is revenue generating HASH. Speaking of which, I need to get my idle GPU installs. Going to be a busy month.
@Hawkfish007 - Your PCI Risers selling like HOT CAKES. HURRY and ADD more. I need at least 50 more risers and all the friends I refer to your links are complaining you're out. They need at least 150+ combined so please stock up more FAST.
@ Finksy - Welcome back from Vacation - Hurry and get me more 4KWs and Picos. The readers are waiting to see the different prototypes coming from my Labs. After I'm done with all this, I'm going to need to take a vacation too. =)
@ Searing - Pretty cool Box - Do you have a spare Motherboard where you can place one in to give us a better idea of size? Maybe this would be great for a Racing 7 x 4 GPU setup?? If you can give me the dimensions it would be good.
@ shield132 and MettalMag - Yes the Data center picture design will work but you have to remove the recirculation part and exhaust all the HOT air outside since you're not using AC. For Intake it depends on your layout. You don't really need to go fancy and do it below ground which will be very expensive for existing infrastructure. Just plan your layout and make sure Cool air go into 1 side which is the Intake - Hot air goes to another side where you would block it off like a Chimney / Oven wall. Put your massive Exhaust fan there and remove the heat out. This way it doesn't recirculate back into the room. You don't need AC if you do it this way. The stronger your exhaust and heat wall is sealed, the closer you can get to Ambient temperature as you're not recirculating back the heat. GPUs are designed to handle over 40C ambient so you should be fine as your racks will also be cool with the flow going thru them. Just make sure intake air matches exhaust or is higher, otherwise the exhaust fans won't be at optimal performance.
To be profitable mining, it's best to keep things as simple as possible. Less to buy, less to manage, less operating cost. If you're spending too much time and money just building the infrastructure, not only are you losing money on opportunity loss but you're also leaving less $$ left over for what matters which is revenue generating HASH. Speaking of which, I need to get my idle GPU installs. Going to be a busy month.
@Hawkfish007 - Your PCI Risers selling like HOT CAKES. HURRY and ADD more. I need at least 50 more risers and all the friends I refer to your links are complaining you're out. They need at least 150+ combined so please stock up more FAST.
@ Finksy - Welcome back from Vacation - Hurry and get me more 4KWs and Picos. The readers are waiting to see the different prototypes coming from my Labs. After I'm done with all this, I'm going to need to take a vacation too. =)
Sorry, my travel plan got into its way. I sent my remaining stocks to Amazon since I will be gone but I will have a big batch of 6-pin risers ready to be shipped out from March 25. Sata to Molex risers are in stock and can be shipped today and tomorrow.
Can't wait to see your prototypes!
March 11, 2017, 01:13:26 PM
@ ysylung - Waiting on more components to arrive to complete the Prototypes. For the HP Solution it will portable. Designed to be compact. You can pretty much pick them up and move them anywhere you want easily. You can also slide them into racks or shelves compartments and put an Orion Fan behind it to control heat flow. Hopefully that will help with the NOISE. These things required a Noise canceling headset for their high Pitch as my office is at 76F and I'm not even powering more then 3 GPUs. They are LOUD. I have no intentions to going back to using BOX fans unless absolutely necessary so hopefully the Orion fan designs will help keep them cool and quieter. The same prototypes can by used with any other Server PSU, it will just be different PSU placements. The 4KW will be able to drive the same solution with just PCI cables running along the side and can easily be covered for an even slicker look. I don't like noisy work environment as it's running in my garage and I have a Bitchy neighbor next to my shed.
@ Searing - Pretty cool Box - Do you have a spare Motherboard where you can place one in to give us a better idea of size? Maybe this would be great for a Racing 7 x 4 GPU setup?? If you can give me the dimensions it would be good.
@ shield132 and MettalMag - Yes the Data center picture design will work but you have to remove the recirculation part and exhaust all the HOT air outside since you're not using AC. For Intake it depends on your layout. You don't really need to go fancy and do it below ground which will be very expensive for existing infrastructure. Just plan your layout and make sure Cool air go into 1 side which is the Intake - Hot air goes to another side where you would block it off like a Chimney / Oven wall. Put your massive Exhaust fan there and remove the heat out. This way it doesn't recirculate back into the room. You don't need AC if you do it this way. The stronger your exhaust and heat wall is sealed, the closer you can get to Ambient temperature as you're not recirculating back the heat. GPUs are designed to handle over 40C ambient so you should be fine as your racks will also be cool with the flow going thru them. Just make sure intake air matches exhaust or is higher, otherwise the exhaust fans won't be at optimal performance.
To be profitable mining, it's best to keep things as simple as possible. Less to buy, less to manage, less operating cost. If you're spending too much time and money just building the infrastructure, not only are you losing money on opportunity loss but you're also leaving less $$ left over for what matters which is revenue generating HASH. Speaking of which, I need to get my idle GPU installs. Going to be a busy month.
@Hawkfish007 - Your PCI Risers selling like HOT CAKES. HURRY and ADD more. I need at least 50 more risers and all the friends I refer to your links are complaining you're out. They need at least 150+ combined so please stock up more FAST.
@ Finksy - Welcome back from Vacation - Hurry and get me more 4KWs and Picos. The readers are waiting to see the different prototypes coming from my Labs. After I'm done with all this, I'm going to need to take a vacation too. =)
@ Searing - Pretty cool Box - Do you have a spare Motherboard where you can place one in to give us a better idea of size? Maybe this would be great for a Racing 7 x 4 GPU setup?? If you can give me the dimensions it would be good.
@ shield132 and MettalMag - Yes the Data center picture design will work but you have to remove the recirculation part and exhaust all the HOT air outside since you're not using AC. For Intake it depends on your layout. You don't really need to go fancy and do it below ground which will be very expensive for existing infrastructure. Just plan your layout and make sure Cool air go into 1 side which is the Intake - Hot air goes to another side where you would block it off like a Chimney / Oven wall. Put your massive Exhaust fan there and remove the heat out. This way it doesn't recirculate back into the room. You don't need AC if you do it this way. The stronger your exhaust and heat wall is sealed, the closer you can get to Ambient temperature as you're not recirculating back the heat. GPUs are designed to handle over 40C ambient so you should be fine as your racks will also be cool with the flow going thru them. Just make sure intake air matches exhaust or is higher, otherwise the exhaust fans won't be at optimal performance.
To be profitable mining, it's best to keep things as simple as possible. Less to buy, less to manage, less operating cost. If you're spending too much time and money just building the infrastructure, not only are you losing money on opportunity loss but you're also leaving less $$ left over for what matters which is revenue generating HASH. Speaking of which, I need to get my idle GPU installs. Going to be a busy month.
@Hawkfish007 - Your PCI Risers selling like HOT CAKES. HURRY and ADD more. I need at least 50 more risers and all the friends I refer to your links are complaining you're out. They need at least 150+ combined so please stock up more FAST.
@ Finksy - Welcome back from Vacation - Hurry and get me more 4KWs and Picos. The readers are waiting to see the different prototypes coming from my Labs. After I'm done with all this, I'm going to need to take a vacation too. =)
March 11, 2017, 09:08:46 AM
not an issue if cooling/exhaust airflow are well planned & designed, yeah for the 120V guys it's a pity only 900W but as far as i can recall for the ibm 2000/2500 bb's or larger psu's won't even run on 110/120V. well you know where i'm at so it's always hot & humid here all year long, so far it's doing fine for dual mining pulling roughly 915W off the wall so there's still a minimum of 20% or more allowance for the little psu.
i think the prices (that you roughly estimated above) are reasonable for a single or few small orders. i can get lower prices too if the order is large enough. i don't intend to keep too much stock atm in hand as i my inventory list gets longer by the day with the daily orders for various stuffs ranging from an m3 screw to a full customized rack of 3 rigs.
well, yeah totally agree, there's no 1 solution that fits all, really depends on each individual's setup. btw, can you get a platinum 1200W atx psu for USD 105 ? well probably during some sales period with limited purchases. an ATX psu will never be as reliable as a server PSU. ATX psu's still have issues such as not enough cables for the setup or poorer quality cables or too short. well, all the yadaa yadaa yadaa will go on haha.
yeah the fans (temp & load sensing) can be noisy IF there's insufficient airflow on the intake but so far they're ok, remember with the new setup, the entire rig will be much cleaner, less or almost no clutter hence the improved cooling + better airflow.
i'm working on couple of revisions going with 1500W platinum+ psu or a dual server psu setup for better efficiency & to maximize a 7 gpu setup, when i have the time, i'll mess with the spare bb 2000's & the breakout boards i have laying around.
do keep us updated on the new setup & i'm pretty interested to see other setups/ideas/solutions. some pics to share yet ? do test the hp's that you have & see how does it play out on your side. the 1500W platinum+ just arrived for R&D purposes.
while we are/were on the topic of PSU's discussing abt their various setups, pros & cons, configs etc here are some of them that I have used/still using/yet to use/to be tested.
i think the prices (that you roughly estimated above) are reasonable for a single or few small orders. i can get lower prices too if the order is large enough. i don't intend to keep too much stock atm in hand as i my inventory list gets longer by the day with the daily orders for various stuffs ranging from an m3 screw to a full customized rack of 3 rigs.
well, yeah totally agree, there's no 1 solution that fits all, really depends on each individual's setup. btw, can you get a platinum 1200W atx psu for USD 105 ? well probably during some sales period with limited purchases. an ATX psu will never be as reliable as a server PSU. ATX psu's still have issues such as not enough cables for the setup or poorer quality cables or too short. well, all the yadaa yadaa yadaa will go on haha.
yeah the fans (temp & load sensing) can be noisy IF there's insufficient airflow on the intake but so far they're ok, remember with the new setup, the entire rig will be much cleaner, less or almost no clutter hence the improved cooling + better airflow.
i'm working on couple of revisions going with 1500W platinum+ psu or a dual server psu setup for better efficiency & to maximize a 7 gpu setup, when i have the time, i'll mess with the spare bb 2000's & the breakout boards i have laying around.
do keep us updated on the new setup & i'm pretty interested to see other setups/ideas/solutions. some pics to share yet ? do test the hp's that you have & see how does it play out on your side. the 1500W platinum+ just arrived for R&D purposes.
while we are/were on the topic of PSU's discussing abt their various setups, pros & cons, configs etc here are some of them that I have used/still using/yet to use/to be tested.
@yslyung looks good when will you release for sale ?
March 11, 2017, 04:54:31 AM
@metalmag = For Mining, if you need to use AC, you're not doing it right. Especially if your region upper temperature is that cool. Again I'm in the 40C in the summer and others are even higher in Arizona and we can do it fine. Even if you have free Electricity the cost of buying, installing, maintenance, etc is very high. Let's do some quick math.
Assuming Free electricity.
10 Rigs = 4 TON AC @ $4-7K each depending brand and SEER levels installed.
100 Rigs = 4 x 4 Ton AC $40-70K.
1 x 4 Ton uses at peak up to 60AMP. So you're wasting 600AMP just for AC alone! Now you have to factor in that you will need around 600-800AMP more for your 100 Rigs so the total is up to 1400AMP. Even Commercial space the transformer may not be powerful enough to handle 1400AMP as you're sharing with other tenants. You can request for more power if it's available but they will charge you for it. Now this isn't even taking the consideration of the 80% rule which means you really need at least 1700AMP. This is taking you into Industrial spaces which requires very large warehouses. So you're talking about something you can achieve for less than $40K which includes 600AMP of power to drive your rigs into something well north over over $200K and require special zoning to accommodate. If you design your environment right, you SHOULD NOT need AC. Mining is a Mathematical game. Even at 3cents / kw, you won't even be able to compete against someone with 10 cents KW even you have to use AC. I would invest that money into more RIGs and a better layout / exhaust strategy. If you have that kind of budget, it shouldn't be hard. To win in this game you must keep your cost low and invest the rest into HASH.
@yslylung - Yes Finksy just got his 150 Picos in. Your price is very competitive for a custom solution. Finksy's cost is actually still lower so there's a small margin for reseller on top but his goal is to keep the cost as low as possible for the community. He's sending me 20 units to test for my different Prototypes designs. I have 10 of the HP 1200W including the V6 breakout boards plus more 4KW to play. There's never a 1 size fit all solutions and always pros and cons with every options. The HP solution is best if you can get them in bulk for $20 or less each as there's breakout boards $25-30, Pico $30 and cabling cost $18-25. That brings you to about $105 for the normal consumer. People will always argue that you can buy a ATX for almost the same price with better future resales, yadda yadda. Maybe you can during hot sales but the cabling and configuration will not be as sexy. The issue with this solution is that many people in America use 120V which this PSU can only deliver 900W vs the world on 240 which this PSU can deliver 1200W. I don't have this issue so I'm not concern. Also the HP 1200W have only 1 TINY fan, I'm not sure how well it can handle the heat but man does that fan make a LOUD pitch noise!! This thing is definitely not something I want to run inside my house.
For large miners the 4KW is important as they don't want to rearrange rigs after it's installed in the RACK. They also want be future proof and plug things in and never have to really think about power usage later one. Heck most people didn't even know that ZEC and ETH first version and current version consumes WAY MORE power. So if they're sizing based on original estimates, they're screwed. However as you said, if you have a PSU go down, you're not just affecting 1 rig but multiple. That's the downside, the upside is that each breakout board and PSU is so cheap, there's no reason why you shouldn't have at least 1 spare bundle if you're a large miner. Swapping is super fast and simple. Efficiency for PSU is also better when you're using less than 70% of load and that will be harder to do on the HP. I like bother solutions and at the end of the day, paired with PCI Risers and Picos, I'm really liking the Server PSU setup so so much better. No more clutters.
I have design prototypes that will take advantages of both the PROs on each solution. At the end of the day, if you're a large farmer, you will have a variety. There's no solution that can meet every need. But I do think that once people see more of the cool server PSU and PICO designs now that we PCI Powered risers, they will LOVE TO GET their hands on these PICOs.
I and metalmag, we are from same country. Well, in summer temperature here mostly is between 35-40 degree Celsius. Electricity isn't free but if you have contract with bitfury (gldani free zone, both are one shit), than it's cheap, at least good for mining. Well, I agree you that investing in HASH is the main will. If I amn't wrong, BitFury and metalmag are doing thing similarly, than that means something is wrong on BitFury's side? Why didn't they choose that?Assuming Free electricity.
10 Rigs = 4 TON AC @ $4-7K each depending brand and SEER levels installed.
100 Rigs = 4 x 4 Ton AC $40-70K.
1 x 4 Ton uses at peak up to 60AMP. So you're wasting 600AMP just for AC alone! Now you have to factor in that you will need around 600-800AMP more for your 100 Rigs so the total is up to 1400AMP. Even Commercial space the transformer may not be powerful enough to handle 1400AMP as you're sharing with other tenants. You can request for more power if it's available but they will charge you for it. Now this isn't even taking the consideration of the 80% rule which means you really need at least 1700AMP. This is taking you into Industrial spaces which requires very large warehouses. So you're talking about something you can achieve for less than $40K which includes 600AMP of power to drive your rigs into something well north over over $200K and require special zoning to accommodate. If you design your environment right, you SHOULD NOT need AC. Mining is a Mathematical game. Even at 3cents / kw, you won't even be able to compete against someone with 10 cents KW even you have to use AC. I would invest that money into more RIGs and a better layout / exhaust strategy. If you have that kind of budget, it shouldn't be hard. To win in this game you must keep your cost low and invest the rest into HASH.
@yslylung - Yes Finksy just got his 150 Picos in. Your price is very competitive for a custom solution. Finksy's cost is actually still lower so there's a small margin for reseller on top but his goal is to keep the cost as low as possible for the community. He's sending me 20 units to test for my different Prototypes designs. I have 10 of the HP 1200W including the V6 breakout boards plus more 4KW to play. There's never a 1 size fit all solutions and always pros and cons with every options. The HP solution is best if you can get them in bulk for $20 or less each as there's breakout boards $25-30, Pico $30 and cabling cost $18-25. That brings you to about $105 for the normal consumer. People will always argue that you can buy a ATX for almost the same price with better future resales, yadda yadda. Maybe you can during hot sales but the cabling and configuration will not be as sexy. The issue with this solution is that many people in America use 120V which this PSU can only deliver 900W vs the world on 240 which this PSU can deliver 1200W. I don't have this issue so I'm not concern. Also the HP 1200W have only 1 TINY fan, I'm not sure how well it can handle the heat but man does that fan make a LOUD pitch noise!! This thing is definitely not something I want to run inside my house.
For large miners the 4KW is important as they don't want to rearrange rigs after it's installed in the RACK. They also want be future proof and plug things in and never have to really think about power usage later one. Heck most people didn't even know that ZEC and ETH first version and current version consumes WAY MORE power. So if they're sizing based on original estimates, they're screwed. However as you said, if you have a PSU go down, you're not just affecting 1 rig but multiple. That's the downside, the upside is that each breakout board and PSU is so cheap, there's no reason why you shouldn't have at least 1 spare bundle if you're a large miner. Swapping is super fast and simple. Efficiency for PSU is also better when you're using less than 70% of load and that will be harder to do on the HP. I like bother solutions and at the end of the day, paired with PCI Risers and Picos, I'm really liking the Server PSU setup so so much better. No more clutters.
I have design prototypes that will take advantages of both the PROs on each solution. At the end of the day, if you're a large farmer, you will have a variety. There's no solution that can meet every need. But I do think that once people see more of the cool server PSU and PICO designs now that we PCI Powered risers, they will LOVE TO GET their hands on these PICOs.
Hope metalmag will come and answer us of course. P.S your suggests are very good and thanks again.
March 11, 2017, 04:48:49 AM
not an issue if cooling/exhaust airflow are well planned & designed, yeah for the 120V guys it's a pity only 900W but as far as i can recall for the ibm 2000/2500 bb's or larger psu's won't even run on 110/120V. well you know where i'm at so it's always hot & humid here all year long, so far it's doing fine for dual mining pulling roughly 915W off the wall so there's still a minimum of 20% or more allowance for the little psu.
i think the prices (that you roughly estimated above) are reasonable for a single or few small orders. i can get lower prices too if the order is large enough. i don't intend to keep too much stock atm in hand as i my inventory list gets longer by the day with the daily orders for various stuffs ranging from an m3 screw to a full customized rack of 3 rigs.
well, yeah totally agree, there's no 1 solution that fits all, really depends on each individual's setup. btw, can you get a platinum 1200W atx psu for USD 105 ? well probably during some sales period with limited purchases. an ATX psu will never be as reliable as a server PSU. ATX psu's still have issues such as not enough cables for the setup or poorer quality cables or too short. well, all the yadaa yadaa yadaa will go on haha.
yeah the fans (temp & load sensing) can be noisy IF there's insufficient airflow on the intake but so far they're ok, remember with the new setup, the entire rig will be much cleaner, less or almost no clutter hence the improved cooling + better airflow.
i'm working on couple of revisions going with 1500W platinum+ psu or a dual server psu setup for better efficiency & to maximize a 7 gpu setup, when i have the time, i'll mess with the spare bb 2000's & the breakout boards i have laying around.
do keep us updated on the new setup & i'm pretty interested to see other setups/ideas/solutions. some pics to share yet ? do test the hp's that you have & see how does it play out on your side. the 1500W platinum+ just arrived for R&D purposes.
while we are/were on the topic of PSU's discussing abt their various setups, pros & cons, configs etc here are some of them that I have used/still using/yet to use/to be tested.
i think the prices (that you roughly estimated above) are reasonable for a single or few small orders. i can get lower prices too if the order is large enough. i don't intend to keep too much stock atm in hand as i my inventory list gets longer by the day with the daily orders for various stuffs ranging from an m3 screw to a full customized rack of 3 rigs.
well, yeah totally agree, there's no 1 solution that fits all, really depends on each individual's setup. btw, can you get a platinum 1200W atx psu for USD 105 ? well probably during some sales period with limited purchases. an ATX psu will never be as reliable as a server PSU. ATX psu's still have issues such as not enough cables for the setup or poorer quality cables or too short. well, all the yadaa yadaa yadaa will go on haha.
yeah the fans (temp & load sensing) can be noisy IF there's insufficient airflow on the intake but so far they're ok, remember with the new setup, the entire rig will be much cleaner, less or almost no clutter hence the improved cooling + better airflow.
i'm working on couple of revisions going with 1500W platinum+ psu or a dual server psu setup for better efficiency & to maximize a 7 gpu setup, when i have the time, i'll mess with the spare bb 2000's & the breakout boards i have laying around.
do keep us updated on the new setup & i'm pretty interested to see other setups/ideas/solutions. some pics to share yet ? do test the hp's that you have & see how does it play out on your side. the 1500W platinum+ just arrived for R&D purposes.
while we are/were on the topic of PSU's discussing abt their various setups, pros & cons, configs etc here are some of them that I have used/still using/yet to use/to be tested.
KNC 550gh BTC Case *used ebay like 30 bucks with shipping* most folk just packing tape them up....clumbersome but I can move them as a unit easily
My setup using off the shelf 2 blade breakout boxes (not sure what they are called anymore) for server rack psu setup...have all the guts of regular psu with all the safety etc
of off the shelf psu etc....slick if you can find them....my buddy and me have been running such for a year no burnt psu cables or other works slick
I hacked mine into an old knc jupiter case just in case I have to lug it about....you can just tape them and zip tie them to a rack thou
my imgur page with the psu's direct
http://imgur.com/a/6lUya
my setup complete (less 2 titans 8 cubes in the other room and the 24 titan cubes I have with maxumark at data hall)
lostgonzo.imgur.com
again if you can find these blade server (2) ...these are 94% platinum eff and 2560 watts (2 psu's at 1280) was same price as ONE corsair 1200i and 15 awg wire vs 16 awg wire on the corsair 1200i....also allows us to NEVER USE knc Y adapters (16 awg ..2 cables per psu) again!
slick..anyway again was a zip tie them together hack and make the leads..6 leads to a 2 psu unit is possible
any questions ask maxumark on here ..pm him....questions...if no answer prod me and I'll get him to check his pm's
I would have had to have paid for 18 corsairs to use the 9 server setups I have made for my stuff..thus instead of 18 x 300 usd for a 1200i corsair on sale 1x a month on www.newegg.com offered 1x a month with rebate card of $30 bucks..I got 2x the amount at same price (again this was a year ago ..the price may be more
and perhaps the 2 blade boxes are harder to find...again contact maxumark for info)
so 18x 300 is $5400.00 usd vs 9x 300 $2700 usd made quite a diff on my stuff (knc liquidation sale and upgrading old psu's) an of course at 15 awg NO FRIGGING KNC y adapters
needed (no burnt anymore...knc bad design)
anyway..stuff to look for .this stuff has been running for almost a year..so no issues if you find the stuff we used...micro-science 94% eff server psu 1280 watts and the corresponding
2 blade unit (server rack) psu breaker box with regular psu guts (see pics)
anyway just tossing it out there for those in need ..the stuff pictured in the thread by you guys is likely equiv to what we have done
anyway good luck on the hack
March 11, 2017, 04:48:15 AM
Yes of course, im not talking about having AC cooled down mining rigs, just about the principle of cold/hot air aisles, the "cool air" can be either AC coming from the ground or normal air, the importance is to have a separation between hot & cold 
But in the case of not using AC air, you have to increase the negative pressure and the air flow, because when you use what we call "passive air" you have to increase the circulation of it, because it will obviously heat up faster, air exchange rate is the key.
But in the case of not using AC air, you have to increase the negative pressure and the air flow, because when you use what we call "passive air" you have to increase the circulation of it, because it will obviously heat up faster, air exchange rate is the key. 
March 11, 2017, 02:38:08 AM
not an issue if cooling/exhaust airflow are well planned & designed, yeah for the 120V guys it's a pity only 900W but as far as i can recall for the ibm 2000/2500 bb's or larger psu's won't even run on 110/120V. well you know where i'm at so it's always hot & humid here all year long, so far it's doing fine for dual mining pulling roughly 915W off the wall so there's still a minimum of 20% or more allowance for the little psu.
i think the prices (that you roughly estimated above) are reasonable for a single or few small orders. i can get lower prices too if the order is large enough. i don't intend to keep too much stock atm in hand as i my inventory list gets longer by the day with the daily orders for various stuffs ranging from an m3 screw to a full customized rack of 3 rigs.
well, yeah totally agree, there's no 1 solution that fits all, really depends on each individual's setup. btw, can you get a platinum 1200W atx psu for USD 105 ? well probably during some sales period with limited purchases. an ATX psu will never be as reliable as a server PSU. ATX psu's still have issues such as not enough cables for the setup or poorer quality cables or too short. well, all the yadaa yadaa yadaa will go on haha.
yeah the fans (temp & load sensing) can be noisy IF there's insufficient airflow on the intake but so far they're ok, remember with the new setup, the entire rig will be much cleaner, less or almost no clutter hence the improved cooling + better airflow.
i'm working on couple of revisions going with 1500W platinum+ psu or a dual server psu setup for better efficiency & to maximize a 7 gpu setup, when i have the time, i'll mess with the spare bb 2000's & the breakout boards i have laying around.
do keep us updated on the new setup & i'm pretty interested to see other setups/ideas/solutions. some pics to share yet ? do test the hp's that you have & see how does it play out on your side. the 1500W platinum+ just arrived for R&D purposes.
while we are/were on the topic of PSU's discussing abt their various setups, pros & cons, configs etc here are some of them that I have used/still using/yet to use/to be tested.
i think the prices (that you roughly estimated above) are reasonable for a single or few small orders. i can get lower prices too if the order is large enough. i don't intend to keep too much stock atm in hand as i my inventory list gets longer by the day with the daily orders for various stuffs ranging from an m3 screw to a full customized rack of 3 rigs.
well, yeah totally agree, there's no 1 solution that fits all, really depends on each individual's setup. btw, can you get a platinum 1200W atx psu for USD 105 ? well probably during some sales period with limited purchases. an ATX psu will never be as reliable as a server PSU. ATX psu's still have issues such as not enough cables for the setup or poorer quality cables or too short. well, all the yadaa yadaa yadaa will go on haha.
yeah the fans (temp & load sensing) can be noisy IF there's insufficient airflow on the intake but so far they're ok, remember with the new setup, the entire rig will be much cleaner, less or almost no clutter hence the improved cooling + better airflow.
i'm working on couple of revisions going with 1500W platinum+ psu or a dual server psu setup for better efficiency & to maximize a 7 gpu setup, when i have the time, i'll mess with the spare bb 2000's & the breakout boards i have laying around.
do keep us updated on the new setup & i'm pretty interested to see other setups/ideas/solutions. some pics to share yet ? do test the hp's that you have & see how does it play out on your side. the 1500W platinum+ just arrived for R&D purposes.
while we are/were on the topic of PSU's discussing abt their various setups, pros & cons, configs etc here are some of them that I have used/still using/yet to use/to be tested.
March 10, 2017, 10:33:30 PM
geeze what motherboard can do 16 gpus?
With any standard motherboard and some pcie multiplier you can do same thing !
Its been asked many times and he is not giving up the gold. The motherboard is a MSI Z97 gaming 5 but he did his own bios and very low level linux kernel changes.
Not quiet, but the prototype systems I have run a Z97 variant. The host boards for the production systems will most likely be a Z170 or C236 board.
@ jstefanop = Too much teasing.......................... =) WHEN WILL IT BE AVAIL................. This will be so SEXY FOR MY PROTOTYPE with the 4KW................ HOOK ME UP JSTEFANOP. P.M me. I want 1 in my FARM soon.................. I can test all variations of GPUs u desire.
March 10, 2017, 10:22:29 PM
geeze what motherboard can do 16 gpus?
With any standard motherboard and some pcie multiplier you can do same thing !
Its been asked many times and he is not giving up the gold. The motherboard is a MSI Z97 gaming 5 but he did his own bios and very low level linux kernel changes.
Not quiet, but the prototype systems I have run a Z97 variant. The host boards for the production systems will most likely be a Z170 or C236 board.
March 10, 2017, 10:18:51 PM
I P.M asking him for 1. Hahah. I want 1 of these bad boy!!! Although..............that would increase my odds of 1 of them crashing rig much higher but seems like Linux handle it better than windows. It would probably best on very stable unmod cards. Although I wouldnt mind running 16 x Furies for bragging rights. The Sexy designs I can do with it..................... =)
It will actually decrease your crash rate even compared to a 4-7 GPU rig setup. I engineered these boards to be built for GPU hashing from the ground up...the cheap Chinese risers were never designed for that purpose( or at least USB 3 cables used to carry the sensitive differential pairs in PCIe lanes is a horrible way to do it). Unfortunanlty I have to reboot these mutiple times for testing otherwise id post a screeny of them running for a week straight (oh and all GPUs have modded bioses on them).
March 10, 2017, 10:13:37 PM
geeze what motherboard can do 16 gpus?
With any standard motherboard and some pcie multiplier you can do same thing !
unless its something like http://amfeltec.com/products/gpu-oriented-cluster/
which I have to say is pretty neat, but im sure its not cheap
Nope...this is a complete custom board engineered by me.
March 10, 2017, 09:37:52 PM
@metalmag = For Mining, if you need to use AC, you're not doing it right. Especially if your region upper temperature is that cool. Again I'm in the 40C in the summer and others are even higher in Arizona and we can do it fine. Even if you have free Electricity the cost of buying, installing, maintenance, etc is very high. Let's do some quick math.
Assuming Free electricity.
10 Rigs = 4 TON AC @ $4-7K each depending brand and SEER levels installed.
100 Rigs = 4 x 4 Ton AC $40-70K.
1 x 4 Ton uses at peak up to 60AMP. So you're wasting 600AMP just for AC alone! Now you have to factor in that you will need around 600-800AMP more for your 100 Rigs so the total is up to 1400AMP. Even Commercial space the transformer may not be powerful enough to handle 1400AMP as you're sharing with other tenants. You can request for more power if it's available but they will charge you for it. Now this isn't even taking the consideration of the 80% rule which means you really need at least 1700AMP. This is taking you into Industrial spaces which requires very large warehouses. So you're talking about something you can achieve for less than $40K which includes 600AMP of power to drive your rigs into something well north over over $200K and require special zoning to accommodate. If you design your environment right, you SHOULD NOT need AC. Mining is a Mathematical game. Even at 3cents / kw, you won't even be able to compete against someone with 10 cents KW even you have to use AC. I would invest that money into more RIGs and a better layout / exhaust strategy. If you have that kind of budget, it shouldn't be hard. To win in this game you must keep your cost low and invest the rest into HASH.
@yslylung - Yes Finksy just got his 150 Picos in. Your price is very competitive for a custom solution. Finksy's cost is actually still lower so there's a small margin for reseller on top but his goal is to keep the cost as low as possible for the community. He's sending me 20 units to test for my different Prototypes designs. I have 10 of the HP 1200W including the V6 breakout boards plus more 4KW to play. There's never a 1 size fit all solutions and always pros and cons with every options. The HP solution is best if you can get them in bulk for $20 or less each as there's breakout boards $25-30, Pico $30 and cabling cost $18-25. That brings you to about $105 for the normal consumer. People will always argue that you can buy a ATX for almost the same price with better future resales, yadda yadda. Maybe you can during hot sales but the cabling and configuration will not be as sexy. The issue with this solution is that many people in America use 120V which this PSU can only deliver 900W vs the world on 240 which this PSU can deliver 1200W. I don't have this issue so I'm not concern. Also the HP 1200W have only 1 TINY fan, I'm not sure how well it can handle the heat but man does that fan make a LOUD pitch noise!! This thing is definitely not something I want to run inside my house.
For large miners the 4KW is important as they don't want to rearrange rigs after it's installed in the RACK. They also want be future proof and plug things in and never have to really think about power usage later one. Heck most people didn't even know that ZEC and ETH first version and current version consumes WAY MORE power. So if they're sizing based on original estimates, they're screwed. However as you said, if you have a PSU go down, you're not just affecting 1 rig but multiple. That's the downside, the upside is that each breakout board and PSU is so cheap, there's no reason why you shouldn't have at least 1 spare bundle if you're a large miner. Swapping is super fast and simple. Efficiency for PSU is also better when you're using less than 70% of load and that will be harder to do on the HP. I like bother solutions and at the end of the day, paired with PCI Risers and Picos, I'm really liking the Server PSU setup so so much better. No more clutters.
I have design prototypes that will take advantages of both the PROs on each solution. At the end of the day, if you're a large farmer, you will have a variety. There's no solution that can meet every need. But I do think that once people see more of the cool server PSU and PICO designs now that we PCI Powered risers, they will LOVE TO GET their hands on these PICOs.
Assuming Free electricity.
10 Rigs = 4 TON AC @ $4-7K each depending brand and SEER levels installed.
100 Rigs = 4 x 4 Ton AC $40-70K.
1 x 4 Ton uses at peak up to 60AMP. So you're wasting 600AMP just for AC alone! Now you have to factor in that you will need around 600-800AMP more for your 100 Rigs so the total is up to 1400AMP. Even Commercial space the transformer may not be powerful enough to handle 1400AMP as you're sharing with other tenants. You can request for more power if it's available but they will charge you for it. Now this isn't even taking the consideration of the 80% rule which means you really need at least 1700AMP. This is taking you into Industrial spaces which requires very large warehouses. So you're talking about something you can achieve for less than $40K which includes 600AMP of power to drive your rigs into something well north over over $200K and require special zoning to accommodate. If you design your environment right, you SHOULD NOT need AC. Mining is a Mathematical game. Even at 3cents / kw, you won't even be able to compete against someone with 10 cents KW even you have to use AC. I would invest that money into more RIGs and a better layout / exhaust strategy. If you have that kind of budget, it shouldn't be hard. To win in this game you must keep your cost low and invest the rest into HASH.
@yslylung - Yes Finksy just got his 150 Picos in. Your price is very competitive for a custom solution. Finksy's cost is actually still lower so there's a small margin for reseller on top but his goal is to keep the cost as low as possible for the community. He's sending me 20 units to test for my different Prototypes designs. I have 10 of the HP 1200W including the V6 breakout boards plus more 4KW to play. There's never a 1 size fit all solutions and always pros and cons with every options. The HP solution is best if you can get them in bulk for $20 or less each as there's breakout boards $25-30, Pico $30 and cabling cost $18-25. That brings you to about $105 for the normal consumer. People will always argue that you can buy a ATX for almost the same price with better future resales, yadda yadda. Maybe you can during hot sales but the cabling and configuration will not be as sexy. The issue with this solution is that many people in America use 120V which this PSU can only deliver 900W vs the world on 240 which this PSU can deliver 1200W. I don't have this issue so I'm not concern. Also the HP 1200W have only 1 TINY fan, I'm not sure how well it can handle the heat but man does that fan make a LOUD pitch noise!! This thing is definitely not something I want to run inside my house.
For large miners the 4KW is important as they don't want to rearrange rigs after it's installed in the RACK. They also want be future proof and plug things in and never have to really think about power usage later one. Heck most people didn't even know that ZEC and ETH first version and current version consumes WAY MORE power. So if they're sizing based on original estimates, they're screwed. However as you said, if you have a PSU go down, you're not just affecting 1 rig but multiple. That's the downside, the upside is that each breakout board and PSU is so cheap, there's no reason why you shouldn't have at least 1 spare bundle if you're a large miner. Swapping is super fast and simple. Efficiency for PSU is also better when you're using less than 70% of load and that will be harder to do on the HP. I like bother solutions and at the end of the day, paired with PCI Risers and Picos, I'm really liking the Server PSU setup so so much better. No more clutters.
I have design prototypes that will take advantages of both the PROs on each solution. At the end of the day, if you're a large farmer, you will have a variety. There's no solution that can meet every need. But I do think that once people see more of the cool server PSU and PICO designs now that we PCI Powered risers, they will LOVE TO GET their hands on these PICOs.
March 10, 2017, 05:50:41 PM
This is some nice airflow setup, can you be more specific about pulling the AC air from the ground?
This is a typical DC airflow diagram bro, most if not all data centers are designed like this ...
The air is pulsed from the ground through grilled plates that replace the normal floor plates and pulled by negative pressure, made from the racks intakes and the hot aisle separation/ceiling air-pull, this is the most efficient design as air cooling goes, and the sad part is that you have plenty of datacenters that aren't respecting it fully, even though it has been invented for nearly 25+ years now. You also have some system variant, but the principles are the same.
As I know Bitfury is using air flow system as I know because mettalmag has mining center here, near bitfury.
March 10, 2017, 05:24:40 PM
I will show step by step on that. Here is short idea.
OLD WAY
Baby ATX PSU (Crap efficiency and reliability) powers risers and MB. Bulky, cheap but not cheap enough and if you go really cheap (Below $45-50), it's more headache then it's worth. More wires and a big ATX PSU behind your rig blocking flow and your acccessibility to the GPUs.
PICO OLD Way
Expensive and the built in CPU connector is too short to reach our mining Rig CPU connection. You need to use bulky AC adapter which makes it more expensive and more connections and things to plug in and hide. $40-60 each! Too much money
*********PICO NEW WAY***************
Powered completely by Server PSU via 6 pin direct to soldered PICO connection or via 2.5MM Barrel connector. It would also split to power the CPU connections. The PICO PSU comes with at least 1 molex and 1 SATA connection so you can power SSD, etc. 98% of your power will come from the SERVER PSU. Even if you got a crappy Pico, if it dies. It's a cheap $20-25 replacement. The PICO PSU is tiny and the size of the motherboard connector head. You won't see it. The server PSU cable can go up to 48" easily. Using PCI powered risers and splitters, you reduce all the SATA, MOLEX, MB cable clutters. Also no ATX PSU in the rear of the rig. So better airflow. I will have lots of examples later but look at my previous examples on the Ebay PICO I bought.
OLD WAY
Baby ATX PSU (Crap efficiency and reliability) powers risers and MB. Bulky, cheap but not cheap enough and if you go really cheap (Below $45-50), it's more headache then it's worth. More wires and a big ATX PSU behind your rig blocking flow and your acccessibility to the GPUs.
PICO OLD Way
Expensive and the built in CPU connector is too short to reach our mining Rig CPU connection. You need to use bulky AC adapter which makes it more expensive and more connections and things to plug in and hide. $40-60 each! Too much money
*********PICO NEW WAY***************
Powered completely by Server PSU via 6 pin direct to soldered PICO connection or via 2.5MM Barrel connector. It would also split to power the CPU connections. The PICO PSU comes with at least 1 molex and 1 SATA connection so you can power SSD, etc. 98% of your power will come from the SERVER PSU. Even if you got a crappy Pico, if it dies. It's a cheap $20-25 replacement. The PICO PSU is tiny and the size of the motherboard connector head. You won't see it. The server PSU cable can go up to 48" easily. Using PCI powered risers and splitters, you reduce all the SATA, MOLEX, MB cable clutters. Also no ATX PSU in the rear of the rig. So better airflow. I will have lots of examples later but look at my previous examples on the Ebay PICO I bought.
just a prototype i made with some free time to work on. pcie cable is a 16 awg cable. cpu power is original 18 awg, long enough for most mobo even on the msi gaming 5's. sata cables are a little smaller. sorry for the late reply, tied up with building rigs & was feeling a bit unwell. chk pm.
hope you get the ones from finsky soon and test them out. so far on my side they have been working well even with the stock cables.
speaking of more gpu's per mobo is good & can lower operating costs + saving up some space but if 1 or more gpu decides to fail or acts up, the entire system will be down. imo best is still a 6 gpu setup per rig & per psu per rig. more gpu per rig sometimes causes more issues instead of a better solution.
issues that i've experienced are such as rig design (need a bigger rig), weight, heat, more clutter of cables just to name a few but of course it does depends on each individuals setup & preferences.
i like the 4kw setup, i still have the very early version of breakout boards from j4bberwock for the ibm 200 bb's about 3 years ago. they still work very well.
they are reliable psu's but what if (it happened to me before during asic days, using load sharing) either 1 of the pair fails, then affected rigs will also be affected & won't have enough power. maybe there's a solution for that on gpu mining ?
that's 1 of the reason i decided to use a dedicated PSU for each rig, the pico idea (been using it for a little over 6 months or so including some tests + r&d) for a more efficient in terms of psu efficiency, cost & reliability.
still trying to improve by making more efficient rigs in terms of power, cost, reliability & minimal downtime.
March 10, 2017, 05:15:03 PM
Only 30C? I live in Texas where it can get to 40C. The key is your exhaust. You need to be able to pull the heat out well especially since your layout is so massive and you're using Open air frames which is spreading the heat everywhere. This just means you have a higher total CFM area to exhaust out vs funneling where you're only covering a small portion. Exhaust via ceiling or up top is efficient for Open air, similar to Genesis mining.
I want to cover the ceiling with exhaust tubes, because upper miners get higher temps because of the set up style itself, but the thing I want to give up on this and build another place like data center, that's why I'm asking for cost effective solution for getting cool air, the best part about this is the proce of kw per hour which in my case is roughly 3 Cents. March 10, 2017, 05:05:20 PM
Only 30C? I live in Texas where it can get to 40C. The key is your exhaust. You need to be able to pull the heat out well especially since your layout is so massive and you're using Open air frames which is spreading the heat everywhere. This just means you have a higher total CFM area to exhaust out vs funneling where you're only covering a small portion. Exhaust via ceiling or up top is efficient for Open air, similar to Genesis mining.
March 10, 2017, 04:53:11 PM
@ Marvell1 - I got it from liquidation place. You just have to search local listings like Craigslist, you'll be surprise what you can find. Some are Gems at cheap prices and may come with rails. Rails are not cheap x 9 or 10. They can cost more than the racks!
@ m1n1ngP4d4w4n - You may confuse him more. Mining is not the same as Data Center! But I'll be very happy if the day comes where it pays well enough to be used with AC cooling.
@ Mettalmag - You will never find a profitable miner who is using AC to cool his gears unless he's operating under 2 cents per kw. But even then the cost for the kind of AC you would need would cost you a fortune. Just to give you an idea 10 rigs at 1200W each on the average. = 12KW. The general rule of cooling heat is 3.4 btu per watt. It's a very general rule and depends on your layout and how sealed the room is, etc. Noticed key word is sealed. So just for 10 rigs you need a 4 TON AC! That's something you cool your entire 2K SF house with. No miner is going to be putting many 4 TON ACs to keep their rig cool and be profitable.
Data center is different as they operates as a COST, not base on profits from the mining or gear. AC is also designed as a CLOSE system, it won't work with a Open Air flow design where you're venting out the heat. The key to battling heat for Mining is not with AC, it's by how to get the heat out quickly enough so it doesn't accumulate so you can be as close to Ambient temp as possible. Our GPUs can run under 105F Ambients without issues. Keep in mind it's not exactly that cool inside a computer case. The only thing you can add to a good open air system regardless of server cases or regular racks is a Swamp cooler but if your flow and design is good enough, that shouldn't be required.
ATM we are using only air flow system and GPUs are feeling quite cool, but I'm not sure what will happen in summer when outside temp reaches 30+C.@ m1n1ngP4d4w4n - You may confuse him more. Mining is not the same as Data Center! But I'll be very happy if the day comes where it pays well enough to be used with AC cooling.
@ Mettalmag - You will never find a profitable miner who is using AC to cool his gears unless he's operating under 2 cents per kw. But even then the cost for the kind of AC you would need would cost you a fortune. Just to give you an idea 10 rigs at 1200W each on the average. = 12KW. The general rule of cooling heat is 3.4 btu per watt. It's a very general rule and depends on your layout and how sealed the room is, etc. Noticed key word is sealed. So just for 10 rigs you need a 4 TON AC! That's something you cool your entire 2K SF house with. No miner is going to be putting many 4 TON ACs to keep their rig cool and be profitable.
Data center is different as they operates as a COST, not base on profits from the mining or gear. AC is also designed as a CLOSE system, it won't work with a Open Air flow design where you're venting out the heat. The key to battling heat for Mining is not with AC, it's by how to get the heat out quickly enough so it doesn't accumulate so you can be as close to Ambient temp as possible. Our GPUs can run under 105F Ambients without issues. Keep in mind it's not exactly that cool inside a computer case. The only thing you can add to a good open air system regardless of server cases or regular racks is a Swamp cooler but if your flow and design is good enough, that shouldn't be required.
March 10, 2017, 04:49:03 PM
@ Marvell1 - I got it from liquidation place. You just have to search local listings like Craigslist, you'll be surprise what you can find. Some are Gems at cheap prices and may come with rails. Rails are not cheap x 9 or 10. They can cost more than the racks!
@ m1n1ngP4d4w4n - You may confuse him more. Mining is not the same as Data Center! But I'll be very happy if the day comes where it pays well enough to be used with AC cooling.
@ Mettalmag - You will never find a profitable miner who is using AC to cool his gears unless he's operating under 2 cents per kw. But even then the cost for the kind of AC you would need would cost you a fortune. Just to give you an idea 10 rigs at 1200W each on the average. = 12KW. The general rule of cooling heat is 3.4 btu per watt. It's a very general rule and depends on your layout and how sealed the room is, etc. Noticed key word is sealed. So just for 10 rigs you need a 4 TON AC! That's something you cool your entire 2K SF house with. No miner is going to be putting many 4 TON ACs to keep their rig cool and be profitable.
Data center is different as they operates as a COST, not base on profits from the mining or gear. AC is also designed as a CLOSE system, it won't work with a Open Air flow design where you're venting out the heat. Hence why it can't keep up if you have a few windows open in the office on hot days. The key to battling heat for Mining is not with AC, it's by how to get the heat out quickly enough so it doesn't accumulate so you can be as close to Ambient temp as possible. Our GPUs can run under 105F Ambients without issues. Keep in mind it's not exactly that cool inside a computer case. The only thing you can add to a good open air system regardless of server cases or regular racks is a Swamp cooler but if your flow and design is good enough, that shouldn't be required.
@ m1n1ngP4d4w4n - You may confuse him more. Mining is not the same as Data Center! But I'll be very happy if the day comes where it pays well enough to be used with AC cooling.
@ Mettalmag - You will never find a profitable miner who is using AC to cool his gears unless he's operating under 2 cents per kw. But even then the cost for the kind of AC you would need would cost you a fortune. Just to give you an idea 10 rigs at 1200W each on the average. = 12KW. The general rule of cooling heat is 3.4 btu per watt. It's a very general rule and depends on your layout and how sealed the room is, etc. Noticed key word is sealed. So just for 10 rigs you need a 4 TON AC! That's something you cool your entire 2K SF house with. No miner is going to be putting many 4 TON ACs to keep their rig cool and be profitable.
Data center is different as they operates as a COST, not base on profits from the mining or gear. AC is also designed as a CLOSE system, it won't work with a Open Air flow design where you're venting out the heat. Hence why it can't keep up if you have a few windows open in the office on hot days. The key to battling heat for Mining is not with AC, it's by how to get the heat out quickly enough so it doesn't accumulate so you can be as close to Ambient temp as possible. Our GPUs can run under 105F Ambients without issues. Keep in mind it's not exactly that cool inside a computer case. The only thing you can add to a good open air system regardless of server cases or regular racks is a Swamp cooler but if your flow and design is good enough, that shouldn't be required.
March 10, 2017, 04:33:45 PM
This is some nice airflow setup, can you be more specific about pulling the AC air from the ground?
This is a typical DC airflow diagram bro, most if not all data centers are designed like this ...
The air is pulsed from the ground through grilled plates that replace the normal floor plates and pulled by negative pressure, made from the racks intakes and the hot aisle separation/ceiling air-pull, this is the most efficient design as air cooling goes, and the sad part is that you have plenty of datacenters that aren't respecting it fully, even though it has been invented for nearly 25+ years now. You also have some system variant, but the principles are the same.
Jump to: