Topic: Data Center Mining Garage and Man Mining Cave ( PART 2 !!!!!!!!) - page 9. (Read 106684 times)
WOW uray, nice job man! Sexy in its own way. What is the outside temperature in your area, is it gonna become hotter next months and what are your plans for additional cooling solutions? Are you gonna install AC or stick with more blowers? Cheers
No, it shouldn't matter. Each power supply is taking the input voltage and stepping it down anyways. As long as the GPU and Risers are on first I don't see any issues with that. Although, most ATX power supplies these days take up to 240V input as well so plugging it into the PDU would actually be beneficial and allow it to run more efficiently.
I did want to connect the ATX PSUs to the PDU as well, but it only has 6 plugs, 4 of which will be used by server PSUs, so that's not an option at this point. We will have other equipment using 120v in the same area, so it won't be a big deal to have ATX PSUs running the motherboard plugged in with them.
holy mama I want my room to look like that! Amazing job wow thanks for the inspiring pics!!!
No, it shouldn't matter. Each power supply is taking the input voltage and stepping it down anyways. As long as the GPU and Risers are on first I don't see any issues with that. Although, most ATX power supplies these days take up to 240V input as well so plugging it into the PDU would actually be beneficial and allow it to run more efficiently.
This may be a dumb question, but this is the first time I have dealt with PDUs of any kind so I figured I should ask just to be safe.... Is there anything wrong with having a 2400 watt 240v server PSU powering the GPUs + risers (plugged into a 240v 40 amp PDU) and a 120v ATX PSU powering the motherboard, CPU, SSD, etc, plugged into a simple 120v surge protector? Basically, is it ok to have a PSU running off 120v paired with one running off 240v on the same rig?
are you pool mining all these gpu's?
yup i don't have time to self manage and update eth wallet, downloading blockchain, etc
are you pool mining all these gpu's?
I am trying to fit 150 GPUs into room of 3 meters x 2 meters x 2 meters as fast and as cheap as I can
- 80GB SSD for network disk (all 30 rigs running without hdd, its O/S are all loaded from this tiny cheap ssd via PXE Boot)
- PoE switch for my IP Camera to monitor this room
- ARM Based board to run network disk and boot server, it use only 10W via USB powered
- Mikrotik Router for my main internet via Fiber network, and also attached USB dongle for LTE modem as backup internet
- All Glued to the wall using 3M double tape!
Wow, that's an impressive build
Can you please reveal more info on the network boot? Also, what OS are you running on the rigs?
Thanks
I use ubuntu server 16.04.02, I choose "server" edition one, because it has no graphical desktop, and disk usage is under 2GB
then just install AMDGPU-Pro Driver for linux, for network boot setup, I follow this guide https://www.gadgetdaily.xyz/boot-linux-from-an-nfs-server/
I am trying to fit 150 GPUs into room of 3 meters x 2 meters x 2 meters as fast and as cheap as I can
- 80GB SSD for network disk (all 30 rigs running without hdd, its O/S are all loaded from this tiny cheap ssd via PXE Boot)
- PoE switch for my IP Camera to monitor this room
- ARM Based board to run network disk and boot server, it use only 10W via USB powered
- Mikrotik Router for my main internet via Fiber network, and also attached USB dongle for LTE modem as backup internet
- All Glued to the wall using 3M double tape!
hey uray -- any primers on how get the PXE boot solution and HDD-less rigs up and running? thanks
you can just follow this guide https://www.gadgetdaily.xyz/boot-linux-from-an-nfs-server/
you need to run all rigs on linux, a dhcp server, and a hdd attached to that dhcp server and its done
thanks
...
pls share too on how do you deal with heat and solutions to get the farm cool
my initial plan was for each rig, I will use dual 120mm fan to blow air out of frame
I need to use best airflow and air pressure fan available, since i can't put huge fan on rear side and on front side, since there are simply no space to put those fans, so after some research I see this Nidec VA450DC
it can even hover on itself, lift up and fly !
https://www.youtube.com/watch?v=FXFnQsIoB5A
I can get these fans just 8$ each from china, for 30 rigs i need to have 60 of these, which 480$ for these 60 fans is good deal, so I ordered one just to test it, but the noise was... so awful, its so annoying and my wife yelling at me, so instead of using nidec, I use regular pc desktop 120mm fans which doing nothing for the heat LOL
for temporary solution I just put 3x 18" fan on the table, and break my window open
room temperature at midday from 46C+ drop to 43C still not good enough, and i am still working on it
I am trying to fit 150 GPUs into room of 3 meters x 2 meters x 2 meters as fast and as cheap as I can
- 80GB SSD for network disk (all 30 rigs running without hdd, its O/S are all loaded from this tiny cheap ssd via PXE Boot)
- PoE switch for my IP Camera to monitor this room
- ARM Based board to run network disk and boot server, it use only 10W via USB powered
- Mikrotik Router for my main internet via Fiber network, and also attached USB dongle for LTE modem as backup internet
- All Glued to the wall using 3M double tape!
Wow, that's an impressive build
Can you please reveal more info on the network boot? Also, what OS are you running on the rigs?
Thanks
I am trying to fit 150 GPUs into room of 3 meters x 2 meters x 2 meters as fast and as cheap as I can
- 80GB SSD for network disk (all 30 rigs running without hdd, its O/S are all loaded from this tiny cheap ssd via PXE Boot)
- PoE switch for my IP Camera to monitor this room
- ARM Based board to run network disk and boot server, it use only 10W via USB powered
- Mikrotik Router for my main internet via Fiber network, and also attached USB dongle for LTE modem as backup internet
- All Glued to the wall using 3M double tape!
hey uray -- any primers on how get the PXE boot solution and HDD-less rigs up and running? thanks
you can just follow this guide https://www.gadgetdaily.xyz/boot-linux-from-an-nfs-server/
you need to run all rigs on linux, a dhcp server, and a hdd attached to that dhcp server and its done
thanks
your farm is awesome - esp those hanging on the wall - it wont win any sexy rigs competition but truly a beast of a GPU farm.
pls share too on how do you deal with heat and solutions to get the farm cool
I am trying to fit 150 GPUs into room of 3 meters x 2 meters x 2 meters as fast and as cheap as I can
- 80GB SSD for network disk (all 30 rigs running without hdd, its O/S are all loaded from this tiny cheap ssd via PXE Boot)
- PoE switch for my IP Camera to monitor this room
- ARM Based board to run network disk and boot server, it use only 10W via USB powered
- Mikrotik Router for my main internet via Fiber network, and also attached USB dongle for LTE modem as backup internet
- All Glued to the wall using 3M double tape!
hey uray -- any primers on how get the PXE boot solution and HDD-less rigs up and running? thanks
you can just follow this guide https://www.gadgetdaily.xyz/boot-linux-from-an-nfs-server/
you need to run all rigs on linux, a dhcp server, and a hdd attached to that dhcp server and its done
Looking forward for the update #3 after this!
I am trying to fit 150 GPUs into room of 3 meters x 2 meters x 2 meters as fast and as cheap as I can
- 80GB SSD for network disk (all 30 rigs running without hdd, its O/S are all loaded from this tiny cheap ssd via PXE Boot)
- PoE switch for my IP Camera to monitor this room
- ARM Based board to run network disk and boot server, it use only 10W via USB powered
- Mikrotik Router for my main internet via Fiber network, and also attached USB dongle for LTE modem as backup internet
- All Glued to the wall using 3M double tape!
hey uray -- any primers on how get the PXE boot solution and HDD-less rigs up and running? thanks
you can just follow this guide https://www.gadgetdaily.xyz/boot-linux-from-an-nfs-server/
you need to run all rigs on linux, a dhcp server, and a hdd attached to that dhcp server and its done
I am trying to fit 150 GPUs into room of 3 meters x 2 meters x 2 meters as fast and as cheap as I can
- 80GB SSD for network disk (all 30 rigs running without hdd, its O/S are all loaded from this tiny cheap ssd via PXE Boot)
- PoE switch for my IP Camera to monitor this room
- ARM Based board to run network disk and boot server, it use only 10W via USB powered
- Mikrotik Router for my main internet via Fiber network, and also attached USB dongle for LTE modem as backup internet
- All Glued to the wall using 3M double tape!
hey uray -- any primers on how get the PXE boot solution and HDD-less rigs up and running? thanks
Nice work Nhan.
Btw, I stupidly sold off my Asrock PRO BTC board and cpu for $40 a while ago. I shouldve kept it. I was curious to see how a cheap 6 pci APU board would do so Ive ordered one to try it out. Since AMD is usually a cheaper option we'll see if this can hang with the Pro BTC INtel board. Plus, an apu has those gpu cores. Extra 1.5mh/s!!!
Btw, I stupidly sold off my Asrock PRO BTC board and cpu for $40 a while ago. I shouldve kept it. I was curious to see how a cheap 6 pci APU board would do so Ive ordered one to try it out. Since AMD is usually a cheaper option we'll see if this can hang with the Pro BTC INtel board. Plus, an apu has those gpu cores. Extra 1.5mh/s!!!
I am trying to fit 150 GPUs into room of 3 meters x 2 meters x 2 meters as fast and as cheap as I can
this was my work room
work preparation
initial frame
MCB and Power Meter board
Mining Rig Initial Fitting Test
PSU Preparation
Start installing GPU, one row at a time
Rear Side
Room Temperature at mid day, most GPUs ran at 75+C
Had to break my window because of heat!
150 GPU's almost done!
need a ladder to install later rigs
Rear Side, need more blower
Had to redo my network wiring..
cramped with cables
Power meter read 26kVA for 130 GPUs, soon will be 30kVA for all 150 GPUs
Network infrastructure :
this was my work room
work preparation
initial frame
MCB and Power Meter board
Mining Rig Initial Fitting Test
PSU Preparation
Start installing GPU, one row at a time
Rear Side
Room Temperature at mid day, most GPUs ran at 75+C
Had to break my window because of heat!
150 GPU's almost done!
need a ladder to install later rigs
Rear Side, need more blower
Had to redo my network wiring..
cramped with cables
Power meter read 26kVA for 130 GPUs, soon will be 30kVA for all 150 GPUs
Network infrastructure :
- 80GB SSD for network disk (all 30 rigs running without hdd, its O/S are all loaded from this tiny cheap ssd via PXE Boot)
- PoE switch for my IP Camera to monitor this room
- ARM Based board to run network disk and boot server, it use only 10W via USB powered
- Mikrotik Router for my main internet via Fiber network, and also attached USB dongle for LTE modem as backup internet
- All Glued to the wall using 3M double tape!
Hi!
This thread is just awesome. thanks for sharing all the quality informations!
I wanted to ask, because i just can't see it properly, those Rosewill cases :
1) Which model are you using?
2) How do you hook the GPUs on the frame? you make holes in the frame? i can see there is a flat metal bar but i can't see if there is holes made for that purpose or if you guys are drilling the holes yourself.
thanks!
This thread is just awesome. thanks for sharing all the quality informations!
I wanted to ask, because i just can't see it properly, those Rosewill cases :
1) Which model are you using?
2) How do you hook the GPUs on the frame? you make holes in the frame? i can see there is a flat metal bar but i can't see if there is holes made for that purpose or if you guys are drilling the holes yourself.
thanks!
This is what I want to know this same thing , please
Can someone explain how the tower with 10 rigs gets its power from the wall? I see yunn has 17x 30 amp outlet but I don't understand how the tower pdus can run 5 rigs on each pdu. I guess in asking how do you plug each tower rig into the wall? Thanks for the help
Runner
Runner
Can somebody suggest where to buy breakout board + picopsu with cables for HP 1200W PSU in good price?
Anybody tried make breakout board/picopsu or something for hp 2450W? As i know they are not so loudy and more efficient then HP 1200W.
Anybody tried make breakout board/picopsu or something for hp 2450W? As i know they are not so loudy and more efficient then HP 1200W.
So, when you use the 1200w server PSU, we would need a regular PSU like, a 650 or something else for the MB, CPU etc. If I were to use one, and have all the GPUs on the server PSU, where do the riser cables need to be plugged into? Do the need to be plugged in the ATX PSU or Server PSU?
if you by picopsu, you do not need atx psu and it is the best way (without atx psu) - server psu, picopsu, breakout board (risers powered from breakout board/server psu) + ssd m.2 = clean and effective rig
Can somebody suggest where to buy breakout board + picopsu with cables for HP 1200W PSU in good price?
Anybody tried make breakout board/picopsu or something for hp 2450W? As i know they are not so loudy and more efficient then HP 1200W.
Anybody tried make breakout board/picopsu or something for hp 2450W? As i know they are not so loudy and more efficient then HP 1200W.
So, when you use the 1200w server PSU, we would need a regular PSU like, a 650 or something else for the MB, CPU etc. If I were to use one, and have all the GPUs on the server PSU, where do the riser cables need to be plugged into? Do the need to be plugged in the ATX PSU or Server PSU?
Jump to: