Pages:
Author

Topic: Mining rig extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] - page 9. (Read 169522 times)

hero member
Activity: 812
Merit: 510
BAMT is worthless shit if it isn't  a 64 bit Debian build already. You can't even get more than 4 cards working in 32 bit Linux, sometimes only 3.

I have 7 GPU cores on my 32 bit BAMT 0.5c install...
sr. member
Activity: 378
Merit: 250
Why is it so damn hot in here?

BAMT is worthless shit if it isn't  a 64 bit Debian build already. You can't even get more than 4 cards working in 32 bit Linux, sometimes only 3.
I *think* (not sure though) that the current BAMT is 64-bit, but I had been trying with the previous version which wasn't.

To lazy to SSH in to check, but I run 5 and 6 cards rigs on BAMT 0.5c.
legendary
Activity: 1162
Merit: 1000
DiabloMiner author

BAMT is worthless shit if it isn't  a 64 bit Debian build already. You can't even get more than 4 cards working in 32 bit Linux, sometimes only 3.
I *think* (not sure though) that the current BAMT is 64-bit, but I had been trying with the previous version which wasn't.

Open xterm, uname -a
rjk
sr. member
Activity: 448
Merit: 250
1ngldh

BAMT is worthless shit if it isn't  a 64 bit Debian build already. You can't even get more than 4 cards working in 32 bit Linux, sometimes only 3.
I *think* (not sure though) that the current BAMT is 64-bit, but I had been trying with the previous version which wasn't.
legendary
Activity: 1162
Merit: 1000
DiabloMiner author
Do you guys know what is the limit of GPUs that a typical mobo(bios) can initialize? The fastra2 had 13 GPUs and they needed a custom bios to boot.
I have tried to look into this virtualization business and damn there's a little of good howtos available. The esxi could have been an easy solution but 5970s won't play nice with that.

Depends on the CPU arch's address space (hint: 64 bit processors, internally, do not have 64 bits of address space, its usually something like 40 or 48 bit). It also depends on how the BIOS allocates space for the PCI-E GART window, some blindly select huge address spaces no matter what the device will actually use leaving you enough room for 8-10 devices.
My BIOS has an option that I can enable that allows for the use of a 64-bit address table to map devices with, instead of the usual 32-bit table. However, it is an option that I have never seen on any other device, and I do not yet know whether it will work correctly, or even what operating systems support it. When I turned it on and attempted to boot BAMT, the screen filled with corruption and I didn't get too far. Similarly, Windows refused to install, citing some unknown hardware capabilities.

I think a 64-bit flavor of linux should work though.

BAMT is worthless shit if it isn't  a 64 bit Debian build already. You can't even get more than 4 cards working in 32 bit Linux, sometimes only 3.
rjk
sr. member
Activity: 448
Merit: 250
1ngldh
Do you guys know what is the limit of GPUs that a typical mobo(bios) can initialize? The fastra2 had 13 GPUs and they needed a custom bios to boot.
I have tried to look into this virtualization business and damn there's a little of good howtos available. The esxi could have been an easy solution but 5970s won't play nice with that.

Depends on the CPU arch's address space (hint: 64 bit processors, internally, do not have 64 bits of address space, its usually something like 40 or 48 bit). It also depends on how the BIOS allocates space for the PCI-E GART window, some blindly select huge address spaces no matter what the device will actually use leaving you enough room for 8-10 devices.
My BIOS has an option that I can enable that allows for the use of a 64-bit address table to map devices with, instead of the usual 32-bit table. However, it is an option that I have never seen on any other device, and I do not yet know whether it will work correctly, or even what operating systems support it. When I turned it on and attempted to boot BAMT, the screen filled with corruption and I didn't get too far. Similarly, Windows refused to install, citing some unknown hardware capabilities.

I think a 64-bit flavor of linux should work though.
hero member
Activity: 529
Merit: 500
legendary
Activity: 1162
Merit: 1000
DiabloMiner author
Do you guys know what is the limit of GPUs that a typical mobo(bios) can initialize? The fastra2 had 13 GPUs and they needed a custom bios to boot.
I have tried to look into this virtualization business and damn there's a little of good howtos available. The esxi could have been an easy solution but 5970s won't play nice with that.

Depends on the CPU arch's address space (hint: 64 bit processors, internally, do not have 64 bits of address space, its usually something like 40 or 48 bit). It also depends on how the BIOS allocates space for the PCI-E GART window, some blindly select huge address spaces no matter what the device will actually use leaving you enough room for 8-10 devices.
member
Activity: 85
Merit: 10
Do you guys know what is the limit of GPUs that a typical mobo(bios) can initialize? The fastra2 had 13 GPUs and they needed a custom bios to boot.
I have tried to look into this virtualization business and damn there's a little of good howtos available. The esxi could have been an easy solution but 5970s won't play nice with that.
rjk
sr. member
Activity: 448
Merit: 250
1ngldh
I got your fans today, along with a bunch of x6500s and risers. Christmas at Garrett's!

Anyway, I'm going to get started on that controller tonight.
Sweet!

Yeah, maybe I'll have a go at the single slot bracket. What you guys may not have noticed is the ingenious system that Rich used to secure the video cards. Instead of pre-drilling a bunch of holes, he just made an aluminum bar "sandwich" with some felt or soft foam in between, and screws to squeeze it together. The brackets get trapped in between and don't move at all. (only 1 small issue is that the middle screws don't line up with the holes in the bracket tabs, so I can only use the ones on the end - but this works out fine)
legendary
Activity: 938
Merit: 1000
What's a GPU?
I got your fans today, along with a bunch of x6500s and risers. Christmas at Garrett's!

Anyway, I'm going to get started on that controller tonight.
legendary
Activity: 1162
Merit: 1000
DiabloMiner author
Either that, or cut the backplanes and only leave the very top screw mount and the overhang (so it balances on the beam).
This is the part that I want to get fabricated, so I can keep the original brackets for resale. Unless someone wants to sell me a bunch of brackets? They could actually be from any reference card model, as long as it has the 2 screws at the top, since the rest would be getting chopped off.

Would this single wide bracket work?  EDIT: More info here.

Available here for ~$2 each.
Well, the top of the card/bracket has 2 screws, and it would be ideal to attach both, since I don't want the card flopping around on one screw. Also I would have to drill some holes in those - is there a double-slot version of the same thing that i could chop the top off of?

You know, you wouldnt really need the double slot version. You could trim these, and then use the backplane screw that you normally use when plugging cards into real machines (which exist to do exactly that: keep it from flopping around).
rjk
sr. member
Activity: 448
Merit: 250
1ngldh
Either that, or cut the backplanes and only leave the very top screw mount and the overhang (so it balances on the beam).
This is the part that I want to get fabricated, so I can keep the original brackets for resale. Unless someone wants to sell me a bunch of brackets? They could actually be from any reference card model, as long as it has the 2 screws at the top, since the rest would be getting chopped off.

Would this single wide bracket work?  EDIT: More info here.

Available here for ~$2 each.
Well, the top of the card/bracket has 2 screws, and it would be ideal to attach both, since I don't want the card flopping around on one screw. Also I would have to drill some holes in those - is there a double-slot version of the same thing that i could chop the top off of?
sr. member
Activity: 512
Merit: 250
Either that, or cut the backplanes and only leave the very top screw mount and the overhang (so it balances on the beam).
This is the part that I want to get fabricated, so I can keep the original brackets for resale. Unless someone wants to sell me a bunch of brackets? They could actually be from any reference card model, as long as it has the 2 screws at the top, since the rest would be getting chopped off.

Would this single wide bracket work?  EDIT: More info here.

Available here for ~$2 each.
hero member
Activity: 518
Merit: 500
Either that, or cut the backplanes and only leave the very top screw mount and the overhang (so it balances on the beam).
This is the part that I want to get fabricated, so I can keep the original brackets for resale. Unless someone wants to sell me a bunch of brackets? They could actually be from any reference card model, as long as it has the 2 screws at the top, since the rest would be getting chopped off.

Damn it !

Now you tell me.

I had like 8 of those things from my 8 reference 5870s and I threw them away Cry
rjk
sr. member
Activity: 448
Merit: 250
1ngldh
If you need any help with setting up KVM on linux, HowToForge has this guide for setup and install on CentOS if you need any help:

http://www.howtoforge.com/virtualization-with-kvm-on-a-centos-6.2-server
Thanks, that looks like a good clear guide to follow.

Anyone want to sell me 18 AWG or better (preferably 16 AWG) 6-pin and 8-pin connectors? Chop them off of dead PSUs, or make them from parts from digi-key -  I don't feel like crimping all those terminals, but if the price is right I'll pay someone else to do it.
rjk
sr. member
Activity: 448
Merit: 250
1ngldh
Either that, or cut the backplanes and only leave the very top screw mount and the overhang (so it balances on the beam).
This is the part that I want to get fabricated, so I can keep the original brackets for resale. Unless someone wants to sell me a bunch of brackets? They could actually be from any reference card model, as long as it has the 2 screws at the top, since the rest would be getting chopped off.
legendary
Activity: 1162
Merit: 1000
DiabloMiner author
You are going to want to remove those back plates on the video cards...you'll impede so much airflow with them still attached...
There's tons of room, and they prevent damage to the back of the board due to clumsy mishandling, which I am prone to. Removing the plastic gave me a huge amount of space, and the only thing I really need to do is mod/remove/replace the front brackets with higher flow pieces.

Sorry, I meant the slot mounting bracket...right now they're like a wall to your airflow...I removed them on all of my cards and my temps dropped ~5C...back plates are fine.

Not entirely they aren't. Hes building a closed air channel that is as large as the cards that go in it. The only way for air to escape, if he properly built it, is through the vents in the card backplates. The worst he'll get here is a pocket of hot air right behind the heatsink, but the heatsink will still perform correctly. The airflow dynamic is no different then how the card would have operated normally.

However, I suggest he removes the backplate and use zip ties on the now empty screw holes to secure the card semi-firmly. Either that, or cut the backplanes and only leave the very top screw mount and the overhang (so it balances on the beam).
newbie
Activity: 20
Merit: 0
If you need any help with setting up KVM on linux, HowToForge has this guide for setup and install on CentOS if you need any help:

http://www.howtoforge.com/virtualization-with-kvm-on-a-centos-6.2-server
hero member
Activity: 812
Merit: 510
You are going to want to remove those back plates on the video cards...you'll impede so much airflow with them still attached...
There's tons of room, and they prevent damage to the back of the board due to clumsy mishandling, which I am prone to. Removing the plastic gave me a huge amount of space, and the only thing I really need to do is mod/remove/replace the front brackets with higher flow pieces.

Sorry, I meant the slot mounting bracket...right now they're like a wall to your airflow...I removed them on all of my cards and my temps dropped ~5C...back plates are fine.
Pages:
Jump to: