Topic: Data Center Mining Garage and Man Mining Cave ( PART 2 !!!!!!!!) - page 19. (Read 106684 times)

Hi,

Sorry about that, 6-pin risers should be available anytime now. They were delivered to Amazon yesterday and I am waiting on them to make them available. Molex to Sata should be available next Monday on Amazon, I will be shipping a bunch to Amazon tomorrow. However, both of these risers are available on eBay (search my seller ID hawkfish007). I am also stocking 6-pin to  2x 6+2 pin splitters and 133 CFM 120x38 cm double ball bearing fans.

Thanks.

I Believe Finksey was going to upgrade his 4k and 2880 PSU bundles with picoPSU's soon.

can i get a link for the picos you sell as well as your amazon risers too hawkfish ?

Hi Hawkfish 

I see that your USB riser on amazon are sold out. Will you be geting any more? I hope that shiping to Europe is not a problem.
I heard you guys talk about risers, that have a power converstion from 12V to 5V so that it prevents burning cables? Are yours with the conversion?
How can we spot risers that have that, could you point them out on Amazon for me please.
I will be building a few rigs in the future and would realy like some advice about risers, so i can get some quality ones, as i don't know how to spot the good ones
Example:
https://www.amazon.de/PCI-E-Powered-3-0-Verl%C3%A4ngerung-Kabel-GPU-Extender/dp/B01N3UVJHM/ref=sr_1_6?ie=UTF8&qid=1490771302&sr=8-6&keywords=USB+riser

https://www.amazon.de/Demiawaking-Express-Extender-Adapterkabel-Stromkabel/dp/B01N6JZ3O4/ref=sr_1_16?ie=UTF8&qid=1490771180&sr=8-16&keywords=USB+riser

Tnx in advance.

Are there any plug and play type cases and risers?
You provide the computer and cards?
I have a mix of 3 16x and 3 1x pcie, wanting to put 6 cards raised in an open or closed case.

Custom designed cable, plus the chipset I am using allows for custom PCIe lane tuning, which is the reason why I am able to have this rock solid. Gotta open them eyes (anyone thats done high speed signal engineering will know what I mean).

For people asking about dimensions I will have all that info in my announcement thread soon. But its designed to fit in a rackmount demensions.

@ yslyung - YOU DA MAN.  Now P.M me on where to buy or how much for those standing breakout boards.  Since my lay flat one definitely won't work with fan flow.  I still have 10 HP PSU I want to use.   The breakout board will work with the HP 1500W correct?  Is there specific version of HP 1500 revs only?  Great job as usual.  

sorry guys, been really busy & some unscheduled urgent appointments showed up. i'm around though. those who pm'ed me, i did reply & will deal with shipping by this coming friday. apologies.

OP i solved the HighPitch  solution for you hahaha ... psu is cooler, less load + better efficiency too.



single 1200w platinum server psu is not enough for your power hungry multiple gpu setup? well the capt got a dual solution! *ordered a small batch of customized dual c13 cables*



running your miner in a hot environment? hot psu? fans are screeching? no problem cooling solution is here too...**i'm running & testing 2 sets now without the extra fan, it's cool & quiet



some stock arrived, SOLD OUT ! 100 risers, gonna order another batch, this time round 50 shorter usb cables & another 50 regular 60cm ones. rigs will me much cleaner !



after some drilling then continue with lots of screwing

more work to be done, enjoy folks.

as for multiple gpus setup more than the regular 7, i won't really recommend to most people due to :

1) you will need NOT only custom BIOS but probably some mods in WIN too but for more than 8 it has to be linux for sure

2) for the 16 or even 32 gpu setup, it's amazing development but still no pix & it's a meh for me tbh.
YES there are some indicator on the boards if a GPU hangs & the mining continues, good job, -wd 0 can do that as of now too but nevertheless the operator still have to RESTART the mining software in order to get all gpus up & running = longer startup time for DAG generation = more gpus will be down = more downtime. what we actually want to know is more towards which gpu is down & which is the one that needs to be adjusted ie in WattTool or in any other software or parameters.

3) Extensions are good for up to 2 gpu or probably even 3 on a single extension BUT either BIOS or WIN limit will hit ya (WIN will be something like NOT enough resources)

4) then it could be fleet of psu's that an operator will need to run & or to figure out the cables & wiring mess, sorry folks & yes i am NOT a fan of messy cables.

5) the boards will be quite BIG in size to fit all gpus = a new design for a rig/rack to fit all of them. say to fit all 16 gpus side by side with a decent amount of spacing between them for adequate cooling the width has to be a minimum 130cm or more.

6) i'd really like the no risers idea & the capability to run many gpus at 1 time but as the old saying goes, do not keep all your eggs in 1 basket.

KISS is sometimes the BEST solution to most problems.

OP i did NOT buy all the mobos HAHAHA.

**again, i DO NOT intend to be the "bad guy" here with regards to the 16 gpu setup but it's just my personal opinions i hope it's being viewed & taken as a constructive criticism**

  

I also asked for a simple mechanical drawing of the board.  Just the overall dimensions and mounting hole information would be a good start.   

I was working on a similar solution as stefanop (we are far away to have it ready) our setup is a PCIx1 child board that plugged to the motherboard and linked with eSata Express cables to an board using moreless the same chip in 1-3x switches ( PI7C9X2G404SL ), with 3 PCIe x1 ports with open ends so the GPU are plugged directly to the PCIe Swith board 3 GPUs (to keep the board practical for production, each board is about 9" and provides about 1 inch per gpu clearance for cooling, is powered by the eSata Express cable draws no power from the motherboard, and we hope it could be stable enoug. my plan is to plug 6 of these on Biostar Motherboards (assuming we solve the bios issue), each 3 ports board inlcuding cable has a BOM cost about 45$ (not including manufacturing) so out target numbers are close to that from stefano, of course I follow stefano development singe he has solved the gruesome dirty development we just started, in case their boards are good enough I'll not mess with my design and buy/commission from stefano.

I'd like to know about stefano approach to solve the link issue (custom flat ribbon cable, eSata Express, U.2 even multiple USB-C are valid as long has enough lines to full link the PCIe port (18-20 lines total, but it could be less w/o redundant lines, but not so few as with USB3 10 lines).

I did answer your question, did you miss it? Pasting it here just for reference.


Anyways, no harm in building a custom setup, don't forget to share pics here. Best of Luck.

Nobody answered my question.

With these 4k PSU setups, its really nice to support so many GPUS, but it looks like you would have to disconnect a large number of cables to take a rig out of service.  I'm thinking about building a custom setup with 2 Mother boards, 16GPUs, and one FINKSY 2880 PSU all in one custom case.  This way the connection to that case is just power and network.

Hey Man, could you share some pics, even a sketchup that would tell us about the size/layout of the daughter boards and the motherboards? I'm asking because it would give us a head start on building cases/frames for these boards.

Nice link Keith, looks like AMD has a working MB with 16 S9150 made by Cirascale. But damn, those GPUs seem too close.

A motherboard config that is riser free and have a GPU Fault LED / sensor?  Plus it's competitively priced against normal config?  Hmm, now I'm interested again.  Haaha

I could find someone interested on 300 of these switches, or maybe a revision since we are on the same R&D line we have some ideas about the switch-gpu link (the cable) our biggest issue to date, but we are faraway from have it ready. now working on other support H/W as Rig Resseter (with ESP8266/Relay modules) and our custom PSU breakout since none in the market satisfy us, even today we considered to integrate the ESP8266 with the PSU breakout thus having an integral Rig Manager, this is not rocket-science compared with the Switches.

Take my money now!

Any idea when you will be ready for pre orders?

Setup is built around a 8 GPUs per daughterboard(the actual board I'm building). Two of my boards are connected to the mainboard (~$150). My current estimates are around 150 per board..so 300+100 = $450...I guess my estimate price is a bit too low for you then  huh The current board I'm testing can physically connect a total of 18 GPUs since it has two extra PCIE slots...youll will just need risers for that last two (there is a possibility a future BIOS update I could make it to post with 3 or even 4 of my boards for a total of 32 GPUs, but I'm just working on 16 for now...plus I would need to work closely with miner devs for anything more than 16...I have slowly hinted them improvements which they have already implemented for multi GPU setups in the past year).

Also the board has status LEDs per GPU lane...if a GPU goes down you'll know right away which one it is, and yes if one GPU crashes the board will still work. This is no different than any other mutigpu setup, other than it having just more GPU lanes. Your doing something wrong if one GPU crash brings down your whole system.

Keep in mind that this price is mostly dependent on the quantities I can order for parts on the first batch. Obviously more boards = less price per board. I am also pretty much charging the cost of components + a small profit margin for me. The design + dev + testing + prototyping etc is all done by me so thats why I can price it so low.

I don't see OP even touching that, doubt you would see it for $500 and honestly with the setup having so many gpu's it just brings up a whole different set of failure points, as some have mentioned before. what if one gpu fails it could affect the whole rig and that could end up being costly, gpu's down is money lost. what about trouble shooting to figure out which one has failed, that wont be an easy task.

That's not what he was saying, though...

Using the typical 6-GPU setup, the motherboard ($80), CPU ($40), RAM ($30), OS drive ($20), and risers ($50) add up to $220 (may be more or less depending on sales and availability, but this is about as low as you're going to go most of the time while using a free OS).  Divide that by 6, and you have a per-GPU cost of $36.67.  I'm not considering power supplies, because you'll need almost the same amount of power for either of these options, though needing only one ATX connection would further reduce costs.  I'm also not considering the labor cost of setting up 3 systems with risers vs 1 system without risers.

For the 16-GPU board to be viable, the cost of the board, CPU, RAM, and OS drive combined must be less per GPU than $36.67.  That means about $586, minus CPU, RAM, and OS drive (let's say ~$90 for those items).  At around $500, this board would be comparable if you're using 3 consumer PSUs.  If you're using one of the 4K + PICO PSU configurations, the board is comparable at $550-$600.  If you are using a paid OS, you're saving 2x the cost of that, as well, so potentially $700-$800.  Personally, I think the time and troubleshooting savings of not dealing with risers, and their myriad potential points of failure, is probably worth another $200 itself for bigger farmers.

I would be shocked to see a custom 16-GPU solution like this at $500, but even double that would probably have a good market among folks like OP.