Topic: Building Cheap Miners : My "Secret" - page 21. (Read 60237 times)
Looks great Spinx!
Great discussions and info in this thread!
Just wanted to share my DL580 G7 build, wanted to run 11 cards, but settled with 9 after hours and hours of struggle.
Mining etherium at ~ 255MH/s. Ran Cryptonight at 1650H/s with 4x E7-8837, but stopped since i switch to SimpleMiner from hiveOS (had to prioritize gpu stability).
More pics here: https://imgur.com/a/NzYLC
Just wanted to share my DL580 G7 build, wanted to run 11 cards, but settled with 9 after hours and hours of struggle.
Mining etherium at ~ 255MH/s. Ran Cryptonight at 1650H/s with 4x E7-8837, but stopped since i switch to SimpleMiner from hiveOS (had to prioritize gpu stability).
More pics here: https://imgur.com/a/NzYLC
Very weird.
An 850w PSU with 6x 6+2pin connectors, 2 on each cable. 1080Ti has a 250tdp... are you running neoscrypt perchance? That would definitely run well over 250 per card. Must be overloading either the PCI-e power cables or something internal. As it heats up, a conductor won't conduct as well, so it draws more current to compensate, heats up more, etc, and that is when it stops.
I generally try not to put more than 80% load on a PSU... can get away with using Bronze 80+ PSUs that way. (still need quality brands)
I am very impressed with the Rosewill Hive 1000w bronze 80+ PSUs I have. I was running 3x Vega FE (tdp=300w) on one machine, in the winter, before I realized it was running at just over 100% load!! It would run for 2 or 3 days, but no way a PSU at 100% load can be stable for long, it just takes a little rise in ambient temperature and it will flake out. But I have to give Rosewill credit, those $78 PSUs work like champs!
Just my personal preference, I like Antec, EVGA, FSP, and Corsair PSUs. Rosewill is my new favorite Value brand, but they started getting pricey too recently. Thermaltake is rubbish in my experience.
I have them all turned down to draw ~700 watts maximum when using an 850-watt PSU.
That being said... the PHOTON is the cheaper model and runs fine where the QUARK will not. But *only* with 1080Ti cards... moved over to 6x 1060 systems tuned to the exact same wattage draw -- the QUARKS are fine.
I always wait for specials and grab up the Rosewills... I bought 20 each 850-watt QUARK and PHOTON around black Friday for $90-100 per unit.
Very weird.
An 850w PSU with 6x 6+2pin connectors, 2 on each cable. 1080Ti has a 250tdp... are you running neoscrypt perchance? That would definitely run well over 250 per card. Must be overloading either the PCI-e power cables or something internal. As it heats up, a conductor won't conduct as well, so it draws more current to compensate, heats up more, etc, and that is when it stops.
I generally try not to put more than 80% load on a PSU... can get away with using Bronze 80+ PSUs that way. (still need quality brands)
I am very impressed with the Rosewill Hive 1000w bronze 80+ PSUs I have. I was running 3x Vega FE (tdp=300w) on one machine, in the winter, before I realized it was running at just over 100% load!! It would run for 2 or 3 days, but no way a PSU at 100% load can be stable for long, it just takes a little rise in ambient temperature and it will flake out. But I have to give Rosewill credit, those $78 PSUs work like champs!
Just my personal preference, I like Antec, EVGA, FSP, and Corsair PSUs. Rosewill is my new favorite Value brand, but they started getting pricey too recently. Thermaltake is rubbish in my experience.
Super Weird issue I would like to share...
I use Rosewill PSUs in all my stuff... very happy with them, especially QUARK series.
I ran into a strange incompatibility... the QUARK-850 will *NOT* work with more than one Gigabyte Aorus 1080Ti.
THREE separate yet otherwise identical Z400 systems... 1x 1060 / 2x 1080Ti Aorus -- three different Quark-850 PSUs... system will run for like 5 minutes and re-boot. I replaced with Rosewill PHOTON-850 and all three systems are flawless for ~2 weeks so far.
My fourth Z400 with this type setup... just MSI 1080Ti (every other part the same)... totally stable with a QUARK-850 in place.
I figured... maybe a bad run of luck and I had three DOA supplies. Nope. I put those three QUARK-850 PSUs into other systems and they all perform perfectly even using the same or more wattage.
In case anyone else may be trying this & pulling their hair out, haha... figured I would share.
I use Rosewill PSUs in all my stuff... very happy with them, especially QUARK series.
I ran into a strange incompatibility... the QUARK-850 will *NOT* work with more than one Gigabyte Aorus 1080Ti.
THREE separate yet otherwise identical Z400 systems... 1x 1060 / 2x 1080Ti Aorus -- three different Quark-850 PSUs... system will run for like 5 minutes and re-boot. I replaced with Rosewill PHOTON-850 and all three systems are flawless for ~2 weeks so far.
My fourth Z400 with this type setup... just MSI 1080Ti (every other part the same)... totally stable with a QUARK-850 in place.
I figured... maybe a bad run of luck and I had three DOA supplies. Nope. I put those three QUARK-850 PSUs into other systems and they all perform perfectly even using the same or more wattage.
In case anyone else may be trying this & pulling their hair out, haha... figured I would share.
Well... small update.
Changing mining software on the system with the MSI 1080Tis has the same issue. Once again fine with a PHOTON... and once again the QUARK works in another system.
Very weird.
Super Weird issue I would like to share...
I use Rosewill PSUs in all my stuff... very happy with them, especially QUARK series.
I ran into a strange incompatibility... the QUARK-850 will *NOT* work with more than one Gigabyte Aorus 1080Ti.
THREE separate yet otherwise identical Z400 systems... 1x 1060 / 2x 1080Ti Aorus -- three different Quark-850 PSUs... system will run for like 5 minutes and re-boot. I replaced with Rosewill PHOTON-850 and all three systems are flawless for ~2 weeks so far.
My fourth Z400 with this type setup... just MSI 1080Ti (every other part the same)... totally stable with a QUARK-850 in place.
I figured... maybe a bad run of luck and I had three DOA supplies. Nope. I put those three QUARK-850 PSUs into other systems and they all perform perfectly even using the same or more wattage.
In case anyone else may be trying this & pulling their hair out, haha... figured I would share.
I use Rosewill PSUs in all my stuff... very happy with them, especially QUARK series.
I ran into a strange incompatibility... the QUARK-850 will *NOT* work with more than one Gigabyte Aorus 1080Ti.
THREE separate yet otherwise identical Z400 systems... 1x 1060 / 2x 1080Ti Aorus -- three different Quark-850 PSUs... system will run for like 5 minutes and re-boot. I replaced with Rosewill PHOTON-850 and all three systems are flawless for ~2 weeks so far.
My fourth Z400 with this type setup... just MSI 1080Ti (every other part the same)... totally stable with a QUARK-850 in place.
I figured... maybe a bad run of luck and I had three DOA supplies. Nope. I put those three QUARK-850 PSUs into other systems and they all perform perfectly even using the same or more wattage.
In case anyone else may be trying this & pulling their hair out, haha... figured I would share.
You northern DFW or southern DFW?
The biggest difference I saw in their boxes was amount of memory for the price changes.
If you want the R815's, I've secured a very good deal from the same Co that Sundownz got them from who is also local to both of us. DM me for info, I'm not going to put everything out there anymore.
The biggest difference I saw in their boxes was amount of memory for the price changes.
If you want the R815's, I've secured a very good deal from the same Co that Sundownz got them from who is also local to both of us. DM me for info, I'm not going to put everything out there anymore.
Northwest DFW.
Just sent you a DM.
Thanks
You northern DFW or southern DFW?
The biggest difference I saw in their boxes was amount of memory for the price changes.
If you want the R815's, I've secured a very good deal from the same Co that Sundownz got them from who is also local to both of us. DM me for info, I'm not going to put everything out there anymore.
The biggest difference I saw in their boxes was amount of memory for the price changes.
If you want the R815's, I've secured a very good deal from the same Co that Sundownz got them from who is also local to both of us. DM me for info, I'm not going to put everything out there anymore.
I wrote a lengthy article about my journey into the E7 world of xeon's here:
http://www.cointainer.life/2018/03/10/say-l3-cache-king/
thx for the blog, good infohttp://www.cointainer.life/2018/03/10/say-l3-cache-king/
I hit a wall at 1550 H/s with 4x 8870 v1
but i've moved on to yescrypt/koto so i don't care now!
i have 2x 8837 with 2 more on order, i wonder if they can do better than the 8870s on yescrypt (17.3kH with -t 40, 18.5kH with -t 44)
weirdly(?), disabling hyperthreading in the bios (of my R810) didn't help the yescrypt hashrate like it seems to do on i5/i7 in windows
The good thing about the E7-8837 is that it runs at 2.8 GHz on all 8 cores:
http://www.cpu-world.com/CPUs/Xeon/Intel-Xeon%20E7-8837.html
whereas the E7-8870 only runs at 2.53 GHz on 8 or 10 cores:
http://www.cpu-world.com/CPUs/Xeon/Intel-Xeon%20E7-8870.html
So unless you can make productive use of those extra two cores on the E7-8870 the E7-8837 will be faster.
I did a lot of wiring modification for the 580s. First, I've only got 4 GPUs running per box at the moment. I haven't tried more because all my 580s are powering cards from the onboard supplies. I did learn how to rewire things to make use of the 10 pin ATX connectors. At first I was using 8 pin connectors from some modular PSU's but I ended up buying connectors and making them proper.
I never noticed an additional header for an SSD drive but I have modified the SATA connector cable for the optical drive to run either SSD or regular drive. The connector on the board is called a micro SATA connector. The data part is the same but the power portion is smaller and only provides 5V. It's fine for SSD's or optical drives but not sufficient for a regular HDD. If you don't have the blue cable for the optical drive that you can modify, you can pick what you need here: https://www.frys.com/product/6245160?source=google&gclid=CjwKCAjw7tfVBRB0EiwAiSYGM_I81IahE32ryxjsklOTzYfuJuGTa3UX-TpjxvYdzcIjislS1UaiLhoCP3AQAvD_BwE
HOWEVER, I HAVE SINCE MOVED TO JUST USING THE OEM DRIVES. The power savings is not even 10w when you convert to SSD. It's not worth the expense. If the hot swap 10k SAS drives are there, just use them. (This will rob you of an additional power connector you could use for GPUs) I repurporsed the SAS power connector to drive GPUs on the first two boxes, but not on any others.
DL580 prices are starting to rise. I was scoring them for under $300 each. I should shut my mouth. This is probably why Sundownz doesn't wanna talk to me, sees me as competition when I just wanna be fwiends and work together! 
I'll probably add some tech write ups on DL580 conversions and add them to my site. I rather add content there than here.
Almost all PSU's, as long as they aren't junk, can operate between 100v-240v. Yes I'm currently running all those HP supplies at 240v, in fact, anything that CAN run at 240v IS. Read my article about being electrically dense on my site to understand why I am, and why I think Sundownz's electrical guys didn't do him any favors when they but in that big electrical panel with all those 110v circuits for all his R815's.
MinerRus, would that ebay vendor be garlandcomputers? They are local to me I tried to pickup everything they had for $300 a piece but they wouldn't do it. I see they just canceled an auction they had for another that should have ended in a day or two and have put everything on buy it nows for much more money. Greedy bastards... lol
I never noticed an additional header for an SSD drive but I have modified the SATA connector cable for the optical drive to run either SSD or regular drive. The connector on the board is called a micro SATA connector. The data part is the same but the power portion is smaller and only provides 5V. It's fine for SSD's or optical drives but not sufficient for a regular HDD. If you don't have the blue cable for the optical drive that you can modify, you can pick what you need here: https://www.frys.com/product/6245160?source=google&gclid=CjwKCAjw7tfVBRB0EiwAiSYGM_I81IahE32ryxjsklOTzYfuJuGTa3UX-TpjxvYdzcIjislS1UaiLhoCP3AQAvD_BwE
HOWEVER, I HAVE SINCE MOVED TO JUST USING THE OEM DRIVES. The power savings is not even 10w when you convert to SSD. It's not worth the expense. If the hot swap 10k SAS drives are there, just use them. (This will rob you of an additional power connector you could use for GPUs) I repurporsed the SAS power connector to drive GPUs on the first two boxes, but not on any others.
DL580 prices are starting to rise. I was scoring them for under $300 each. I should shut my mouth.
This is probably why Sundownz doesn't wanna talk to me, sees me as competition when I just wanna be fwiends and work together! I'll probably add some tech write ups on DL580 conversions and add them to my site. I rather add content there than here.
Almost all PSU's, as long as they aren't junk, can operate between 100v-240v. Yes I'm currently running all those HP supplies at 240v, in fact, anything that CAN run at 240v IS. Read my article about being electrically dense on my site to understand why I am, and why I think Sundownz's electrical guys didn't do him any favors when they but in that big electrical panel with all those 110v circuits for all his R815's.
MinerRus, would that ebay vendor be garlandcomputers? They are local to me I tried to pickup everything they had for $300 a piece but they wouldn't do it. I see they just canceled an auction they had for another that should have ended in a day or two and have put everything on buy it nows for much more money. Greedy bastards... lol
Yes garlandcomputers is where I purchased my DL580's. I am local also. The last auction that sold for $305 was me I guess your bid was the $300 one just below me.
I guess me asking the same thing to buy five of them at $300 each along with you asking before and only having two auctions sell for higher price than what I paid must have ticked them off which is why they canceled the auction.
This is their exact words:
I'll have to think about that, but probably no.
We are losing money on all of these and we can sell the parts for way more than the units are selling for.
So I have taken these down.
This response was on the $449 BIN auction and I interpreted that to mean that they may be also taking down the $449 BIN auction which is why I bought two of them at that price. I need somewhere to put those E7-8837's I picked up. These ended up costing me $107 more each vs the $305 on the first one since I did snag the $100 in eBay Bucks.
I really seems strange that they have five HP DL580 G7's at BIN prices of $450, $795, $1040, $1050 and $1270 and the only differences is that some have E7-4870 processors, 300GB drives instead of 146GB and more memory. The price increases seem unjustified for what was added or changed.
https://www.ebay.com/sch/garlandcomputer/m.html?item=372242649073&ssPageName=STRK%3AMEBIDX%3AIT&_from=R40&_sacat=0&_sop=15&Product%2520Line=ProLiant%2520DL&_nkw=dl580%20g7&rt=nc&_trksid=p2046732.m1684
Interesting thing about the HP DL580 G7 10 pin connector for powering GPUs.
This link show one person measuring all 10 pins to find 4x 12V, 4x Ground and 2x 3.3V
Pinout for DL580 10pin PCIe Power Cable
https://community.hpe.com/t5/ProLiant-Servers-ML-DL-SL/Pinout-for-DL580-10pin-PCIe-Power-Cable/td-p/6992186
One wonders why the two 3.3V pins. That is until you look at this HP Installation for the Graphics card power cable kit.
Graphics card power cable kit - Installation Instructions
For HP ProLiant DL580 G7, DL585 G7, and DL980 G7 servers
https://support.hpe.com/hpsc/doc/public/display?docId=emr_na-c02514211
Here you see five different HP cables that are rated at 150 Watts, 225 Watts and 300 Watts.
And this critical Note:
IMPORTANT: High power PCIe cables report power allocation information used by the server to calculate power supply redundancy rules. For the server to calculate the accurate number of power supplies needed, use the lowest wattage power cable possible for the high- powered PCIe card.
For example: if a user installs a 150-W PCIe card in the server and connects it to a 300-W power cable, the server calculates the power needed as 300 watts instead of the 150 watts the card uses. This situation results in the server requiring more power supplies than needed for operation or redundancy when, in fact, the server may be sufficient with fewer power supplies. HP recommends fully populating the server with power supplies when using high power PCIe cards.
So it makes sense that those two extra 3.3V pins must tell the server what power wattage cables are installed.
Being an EE it appears that these two pins are just pulled up to the 3.3 volts with a resister and grounding the pins determines the power as follows:
Edit: I just came across this HP 504660-001 150 Watt Cable and it has pin 1 grounded and pin 10 open.
https://www.ebay.com/itm/HP-DL580-DL980G7-Accelerator-24in-Power-Cable-635903-001-504660-001/263096964742
No Power: Both Open - as in no cable installed
150 watts: pin 1 grounded
225 watts: pin 10 grounded
300 watts: pins 1 & 10 grounded
These cables on eBay do not seem to be doing that so even though they do connect to the 10 pin socket and graphics cards they will not tell the server what power is being used.
https://www.ebay.com/itm/10pin-to-6-6pin-Power-Adapter-Cable-for-HP-ProLiant-DL580-G7-and-GPU-50cm-/141964325336
https://www.ebay.com/itm/10pin-to-6-8pin-Power-Cable-for-HP-DL580-G7-and-NVIDIA-GRID-K2-GPU-50cm-/142470960547
https://www.ebay.com/itm/10pin-to-8-8pin-Power-Adapter-Cable-for-HP-ProLiant-DL580-G7-and-GPU-50cm-/141972393916
This link show one person measuring all 10 pins to find 4x 12V, 4x Ground and 2x 3.3V
Pinout for DL580 10pin PCIe Power Cable
https://community.hpe.com/t5/ProLiant-Servers-ML-DL-SL/Pinout-for-DL580-10pin-PCIe-Power-Cable/td-p/6992186
One wonders why the two 3.3V pins. That is until you look at this HP Installation for the Graphics card power cable kit.
Graphics card power cable kit - Installation Instructions
For HP ProLiant DL580 G7, DL585 G7, and DL980 G7 servers
https://support.hpe.com/hpsc/doc/public/display?docId=emr_na-c02514211
Here you see five different HP cables that are rated at 150 Watts, 225 Watts and 300 Watts.
And this critical Note:
IMPORTANT: High power PCIe cables report power allocation information used by the server to calculate power supply redundancy rules. For the server to calculate the accurate number of power supplies needed, use the lowest wattage power cable possible for the high- powered PCIe card.
For example: if a user installs a 150-W PCIe card in the server and connects it to a 300-W power cable, the server calculates the power needed as 300 watts instead of the 150 watts the card uses. This situation results in the server requiring more power supplies than needed for operation or redundancy when, in fact, the server may be sufficient with fewer power supplies. HP recommends fully populating the server with power supplies when using high power PCIe cards.
So it makes sense that those two extra 3.3V pins must tell the server what power wattage cables are installed.
Being an EE it appears that these two pins are just pulled up to the 3.3 volts with a resister and grounding the pins determines the power as follows:
Edit: I just came across this HP 504660-001 150 Watt Cable and it has pin 1 grounded and pin 10 open.
https://www.ebay.com/itm/HP-DL580-DL980G7-Accelerator-24in-Power-Cable-635903-001-504660-001/263096964742
No Power: Both Open - as in no cable installed
150 watts: pin 1 grounded
225 watts: pin 10 grounded
300 watts: pins 1 & 10 grounded
These cables on eBay do not seem to be doing that so even though they do connect to the 10 pin socket and graphics cards they will not tell the server what power is being used.
https://www.ebay.com/itm/10pin-to-6-6pin-Power-Adapter-Cable-for-HP-ProLiant-DL580-G7-and-GPU-50cm-/141964325336
https://www.ebay.com/itm/10pin-to-6-8pin-Power-Cable-for-HP-DL580-G7-and-NVIDIA-GRID-K2-GPU-50cm-/142470960547
https://www.ebay.com/itm/10pin-to-8-8pin-Power-Adapter-Cable-for-HP-ProLiant-DL580-G7-and-GPU-50cm-/141972393916
I did a lot of wiring modification for the 580s. First, I've only got 4 GPUs running per box at the moment. I haven't tried more because all my 580s are powering cards from the onboard supplies. I did learn how to rewire things to make use of the 10 pin ATX connectors. At first I was using 8 pin connectors from some modular PSU's but I ended up buying connectors and making them proper.
I never noticed an additional header for an SSD drive but I have modified the SATA connector cable for the optical drive to run either SSD or regular drive. The connector on the board is called a micro SATA connector. The data part is the same but the power portion is smaller and only provides 5V. It's fine for SSD's or optical drives but not sufficient for a regular HDD. If you don't have the blue cable for the optical drive that you can modify, you can pick what you need here: https://www.frys.com/product/6245160?source=google&gclid=CjwKCAjw7tfVBRB0EiwAiSYGM_I81IahE32ryxjsklOTzYfuJuGTa3UX-TpjxvYdzcIjislS1UaiLhoCP3AQAvD_BwE
HOWEVER, I HAVE SINCE MOVED TO JUST USING THE OEM DRIVES. The power savings is not even 10w when you convert to SSD. It's not worth the expense. If the hot swap 10k SAS drives are there, just use them. (This will rob you of an additional power connector you could use for GPUs) I repurporsed the SAS power connector to drive GPUs on the first two boxes, but not on any others.
DL580 prices are starting to rise. I was scoring them for under $300 each. I should shut my mouth. This is probably why Sundownz doesn't wanna talk to me, sees me as competition when I just wanna be fwiends and work together!
I'll probably add some tech write ups on DL580 conversions and add them to my site. I rather add content there than here.
Almost all PSU's, as long as they aren't junk, can operate between 100v-240v. Yes I'm currently running all those HP supplies at 240v, in fact, anything that CAN run at 240v IS. Read my article about being electrically dense on my site to understand why I am, and why I think Sundownz's electrical guys didn't do him any favors when they but in that big electrical panel with all those 110v circuits for all his R815's.
MinerRus, would that ebay vendor be garlandcomputers? They are local to me I tried to pickup everything they had for $300 a piece but they wouldn't do it. I see they just canceled an auction they had for another that should have ended in a day or two and have put everything on buy it nows for much more money. Greedy bastards... lol
I never noticed an additional header for an SSD drive but I have modified the SATA connector cable for the optical drive to run either SSD or regular drive. The connector on the board is called a micro SATA connector. The data part is the same but the power portion is smaller and only provides 5V. It's fine for SSD's or optical drives but not sufficient for a regular HDD. If you don't have the blue cable for the optical drive that you can modify, you can pick what you need here: https://www.frys.com/product/6245160?source=google&gclid=CjwKCAjw7tfVBRB0EiwAiSYGM_I81IahE32ryxjsklOTzYfuJuGTa3UX-TpjxvYdzcIjislS1UaiLhoCP3AQAvD_BwE
HOWEVER, I HAVE SINCE MOVED TO JUST USING THE OEM DRIVES. The power savings is not even 10w when you convert to SSD. It's not worth the expense. If the hot swap 10k SAS drives are there, just use them. (This will rob you of an additional power connector you could use for GPUs) I repurporsed the SAS power connector to drive GPUs on the first two boxes, but not on any others.
DL580 prices are starting to rise. I was scoring them for under $300 each. I should shut my mouth.
This is probably why Sundownz doesn't wanna talk to me, sees me as competition when I just wanna be fwiends and work together! I'll probably add some tech write ups on DL580 conversions and add them to my site. I rather add content there than here.
Almost all PSU's, as long as they aren't junk, can operate between 100v-240v. Yes I'm currently running all those HP supplies at 240v, in fact, anything that CAN run at 240v IS. Read my article about being electrically dense on my site to understand why I am, and why I think Sundownz's electrical guys didn't do him any favors when they but in that big electrical panel with all those 110v circuits for all his R815's.
MinerRus, would that ebay vendor be garlandcomputers? They are local to me I tried to pickup everything they had for $300 a piece but they wouldn't do it. I see they just canceled an auction they had for another that should have ended in a day or two and have put everything on buy it nows for much more money. Greedy bastards... lol
I wrote a lengthy article about my journey into the E7 world of xeon's here:
http://www.cointainer.life/2018/03/10/say-l3-cache-king/
thx for the blog, good infohttp://www.cointainer.life/2018/03/10/say-l3-cache-king/
I hit a wall at 1550 H/s with 4x 8870 v1
but i've moved on to yescrypt/koto so i don't care now!
i have 2x 8837 with 2 more on order, i wonder if they can do better than the 8870s on yescrypt (17.3kH with -t 40, 18.5kH with -t 44)
weirdly(?), disabling hyperthreading in the bios (of my R810) didn't help the yescrypt hashrate like it seems to do on i5/i7 in windows
PharmEcis I have a few questions on the HP DL580 G7
I see that there is an Internal solid state drive expansion bay option on pages 54 & 55 in the HP ProLiant DL580 G7 Server User Guide. Inside my server I see the place where a 2.5" SSD can be placed and the area on the system board where the SSD Power/Data cable plugs into. I do not have the cable but would like to use a SSD for OS installation and save power by not using any hard drives. Do you have any information on that cable. It appears to be a single connector cable with both power and data. A part number or where I might be able to obtain it is appreciated.
On your Ubuntu install what did you install to: Internal SSD, Internal USB Stick, Internal SD Flash Card or the hard drives on the Embedded HP Smart Array P410i Controller?
Any gotcha's I need to be aware of?
I have a lot of Nvidia GPU's that only take their power from the PCI-E slot. The DL580 G7 with the PCI-E expansion board has lots of PCI-E slots. I have not seen any documentation on what power can be supplied by which slot. I have Quadro 600's that need 40 watts and GTX 750's that need 70 watts. On Dell workstations they clearly state which slots can supply 75 watts and which can only supply 25 watts. Can you point me to any documentation.
--------------------
Edit: I have come across the "Graphics card power cable kit Installation Instructions for For HP ProLiant DL580 G7, DL585 G7, and DL980 G7 servers" and in it it does state IMPORTANT: The PCIe slots provide 75W of power. The remaining wattage is supplied by the power cable to obtain the total wattage required.
Since that statement doesn't have any qualifiers I interpret it to mean ALL of the PCIe slots can supply 75 watts.
Examining my DL580 I see X16 physical slots at slot #2, 3, 5, 6 on the PCIe expansion board and slot 9 and 11 on the main board. Slots 9 and 11 have the card plastic release lever whereas the slots on the PCIe expansion board do not.
Another question is how many GPUs can the DL580 G7 have installed and still boot. I have come across some google links that claim a max of four and if a fifth is installed the system will not boot.
--------------------
Lastly the 1200 watt power supplies are only rated at 900 watts with 110 AC. The 1200 watts is only available if they are powered by 220 VAC. I am also concerned about load balancing in my home if I were to have six of these running. My question is can I put 220 VAC directly to the inputs of these power supplies?
Thanks
I see that there is an Internal solid state drive expansion bay option on pages 54 & 55 in the HP ProLiant DL580 G7 Server User Guide. Inside my server I see the place where a 2.5" SSD can be placed and the area on the system board where the SSD Power/Data cable plugs into. I do not have the cable but would like to use a SSD for OS installation and save power by not using any hard drives. Do you have any information on that cable. It appears to be a single connector cable with both power and data. A part number or where I might be able to obtain it is appreciated.
On your Ubuntu install what did you install to: Internal SSD, Internal USB Stick, Internal SD Flash Card or the hard drives on the Embedded HP Smart Array P410i Controller?
Any gotcha's I need to be aware of?
I have a lot of Nvidia GPU's that only take their power from the PCI-E slot. The DL580 G7 with the PCI-E expansion board has lots of PCI-E slots. I have not seen any documentation on what power can be supplied by which slot. I have Quadro 600's that need 40 watts and GTX 750's that need 70 watts. On Dell workstations they clearly state which slots can supply 75 watts and which can only supply 25 watts. Can you point me to any documentation.
--------------------
Edit: I have come across the "Graphics card power cable kit Installation Instructions for For HP ProLiant DL580 G7, DL585 G7, and DL980 G7 servers" and in it it does state IMPORTANT: The PCIe slots provide 75W of power. The remaining wattage is supplied by the power cable to obtain the total wattage required.
Since that statement doesn't have any qualifiers I interpret it to mean ALL of the PCIe slots can supply 75 watts.
Examining my DL580 I see X16 physical slots at slot #2, 3, 5, 6 on the PCIe expansion board and slot 9 and 11 on the main board. Slots 9 and 11 have the card plastic release lever whereas the slots on the PCIe expansion board do not.
Another question is how many GPUs can the DL580 G7 have installed and still boot. I have come across some google links that claim a max of four and if a fifth is installed the system will not boot.
--------------------
Lastly the 1200 watt power supplies are only rated at 900 watts with 110 AC. The 1200 watts is only available if they are powered by 220 VAC. I am also concerned about load balancing in my home if I were to have six of these running. My question is can I put 220 VAC directly to the inputs of these power supplies?
Thanks
I picked up my HP DL580 G7 late yesterday. It is a beast.
It came with 64GB (16x 4GB) PC3-10600R 1333 MHz memory installed in eight memory cartridges two dimms per cartridge.
HPE ProLiant DL580 G7 Server - Configuring Memory
https://support.hpe.com/hpsc/doc/public/display?docId=c02283239
For mining I don't need all that memory nor that speed as this server the max memory speed is PC3-8500R or 1066 MHz.
I plan to remove four memory cartridges as only four are needed and resell them on eBay.
I am also looking to get 2GB PC3-8500R or PC3-10600R memory to replace the 4GB PC3-10600R installed memory so that I can resell the 64GB PC3-10600R memory.
Selling the above will help in reducing my purchase cost.
The server has the 591205-001 HP PCI-E I/O Expansion Board installed and four 1200 Watt Power Supplies. These power supplies are really 900 watt at 110 VAC. I like that I can set in the Bios how many are active and the number of spares.
I have yet to install Linux as I am still learning how to correctly do memory configuration on the DL580 G7.
In the Bios there are settings for DCU PreFetcher, Hemisphere Mode, System Locality Information Table. It looks like the optimal settings are to Enable DCU PreFetcher, Disable Hemisphere Mode and Enable System Locality Information Table (NUMA).
http://www.linux-mag.com/id/6868
It came with 64GB (16x 4GB) PC3-10600R 1333 MHz memory installed in eight memory cartridges two dimms per cartridge.
HPE ProLiant DL580 G7 Server - Configuring Memory
https://support.hpe.com/hpsc/doc/public/display?docId=c02283239
For mining I don't need all that memory nor that speed as this server the max memory speed is PC3-8500R or 1066 MHz.
I plan to remove four memory cartridges as only four are needed and resell them on eBay.
I am also looking to get 2GB PC3-8500R or PC3-10600R memory to replace the 4GB PC3-10600R installed memory so that I can resell the 64GB PC3-10600R memory.
Selling the above will help in reducing my purchase cost.
The server has the 591205-001 HP PCI-E I/O Expansion Board installed and four 1200 Watt Power Supplies. These power supplies are really 900 watt at 110 VAC. I like that I can set in the Bios how many are active and the number of spares.
I have yet to install Linux as I am still learning how to correctly do memory configuration on the DL580 G7.
In the Bios there are settings for DCU PreFetcher, Hemisphere Mode, System Locality Information Table. It looks like the optimal settings are to Enable DCU PreFetcher, Disable Hemisphere Mode and Enable System Locality Information Table (NUMA).
http://www.linux-mag.com/id/6868
Someone just bought a set of 10 8837 CPUs. I bet they read this thread.
That was me. It also was two sets of 10.
The seller just relisted another set of 10 if anyone else is interested:
https://www.ebay.com/itm/LOT-OF-10-INTEL-E7-8837-2-66GHZ-24MB-LGA1567-SLC3N-8-Core-CPU/332596230484
I currently have an offer for another five HP DL580 G7 from the seller I bought from. Hopefully it will be accepted before 12 pm tonight because eBay has a current 15% in Bonus eBay Bucks on purchases of $150 or more. Than would earn $200+ eBay Bucks that I would be able to spend early April.
Edit: Opps, looks like I killed the golden goose in asking. Even though I purchased other servers from this seller with a Best Offer this seller decided that the auctions they were doing were not getting what they wanted so the killed the current auction and just left the BIN at $450. They stated that the parts inside were more valuable than what these were selling for at auction.
Oh well because of the higher price I only bought two more of these servers for $974 including tax (free local pickup) and they did qualify for $100 in Bonus eBay Bucks. I forgot that eBay capped the 15% promotion at $100 per purchase.
Someone just bought a set of 10 8837 CPUs. I bet they read this thread.
I wrote a lengthy article about my journey into the E7 world of xeon's here:
http://www.cointainer.life/2018/03/10/say-l3-cache-king/
http://www.cointainer.life/2018/03/10/say-l3-cache-king/
Also, MinersRus, you might toss those CPUs in and the box won't boot. If that's the case, you need to go snag a torrent or two. All HP's BIOS stuff is locked behind a paywall but the firmware DVD and SPP DVD's are available via torrent.
I'm not sure if I got lucky or if HP changed their access but I was able to download the latest BIOS (SP99256) for the DL580.
SOFTPAQ NUMBER: SP99256
PART NUMBER: N/A
FILE NAME: SP99256.EXE
TITLE: System Firmware Upgrade for HP ProLiant DL580 G7 Servers (For USB Key-Media).
VERSION: 2018.02.22A
LANGUAGE: English
ROM FAMILY: P65
REVISION: A
The only change for this BIOS update is microcode for the Intel processors. Maybe they made this available to all because of Specter and Meltdown.
Sundownz,
Are you running the R815's with HT Assist turned on or off in the bios? With it on, the cpu's only report 12mb of L3 and with it off they report 16mb. I've seen better speeds with the lower l3. How about you?
Are you running the R815's with HT Assist turned on or off in the bios? With it on, the cpu's only report 12mb of L3 and with it off they report 16mb. I've seen better speeds with the lower l3. How about you?
I have not checked that setting directly but I do believe my CPUs are reporting 12 MB.
Minerus: Protip: Best CPU's you can get for the 580 series is the 8837. I had a set of the E7-4870s and they performed worse than the 8837's and I tried EVERYTHING. You won't be happy w/ the 4830's, I think you'll top out around 1000H/s. I hope you are going to be adding GPUs to the box or it will just barely pay for it's own electricity. The X series of CPUs aren't even worth trying to resell, they have become targets for practice at 100y.
Download Ubuntu 16.04. Install, it's a no brainer. Then just search xmr-stak install ubuntu and you'll find several guides that walk you through it. By now I have it memorized and should have just used a docker...
I see that the DL580 has two internal USB slots were you able to install Ubuntu 16.04 to an internal USB stick?
Linux newbie I am - "should have just used a docker..." - what does this mean?
I looked up the specs for the E7-8837 vs the E7-4830 and the only difference I see is the clock speed. The 8837 runs all cores at 2.8 Ghz and the 4830 runs at 2.27 GHz.
http://www.cpu-world.com/Compare/24/Intel_Xeon_E7-4830_vs_Intel_Xeon_E7-8837.html
Both the 8837 and the 4830 contain: 8 real cores, 24 MB L3 Cache, AES Instruction
Hopefully the DL580 will allow me to disable HT so that only the real cores are exposed.
Could you post the best XMR-Stak CPU Thread config file you used to the 8837 as I will be able to use that for my 4830's.
The Hash rates for the 4830's should be 19% lower than the 8837's because of the clock speed difference.
If it turns out that the DL580 is not worth it for mining I plan to resell it on eBay. I only paid $360 total for it including the E7-4830 processor upgrade.
Jump to: