Pages:
Author

Topic: AMD Opteron 6378 4x, total 64 cores hash? (Read 4439 times)

newbie
Activity: 1
Merit: 0
March 27, 2018, 07:11:09 AM
#32
HI CAN YOU KINDLY CONFIRM IF YOUR OS SHOWS L3 CACHE AS 12 MB INSTEAD OF 16 MB PER PROCESSOR.

I'm seeing 16 MB L2 and 12 MB L3 in the BIOS setup too. `lscpu` shows it as 2MB and 6MB, probably because that is what an individual core will see.

Code:
On-line CPU(s) list: 0-15
Thread(s) per core:  2
Core(s) per socket:  8
Socket(s):           1
NUMA node(s):        2
Vendor ID:           AuthenticAMD
CPU family:          21
Model:               2
Model name:          AMD Opteron(tm) Processor 6378
Stepping:            0
CPU MHz:             2400.070
L1d cache:           16K
L1i cache:           64K
L2 cache:            2048K
L3 cache:            6144K
newbie
Activity: 6
Merit: 0
February 20, 2018, 03:44:04 AM
#31
Hi, what do you think about mixing 2x G34 processor with some GPU's in one server mboard ex. ASUS KGPE-D16?
Regards

900-1000 h/s Monero/Bytecoin on ASUS KGPE-D16 and 6380x2 like there https://translate.google.com/translate?hl=ru&sl=ru&tl=en&u=https%3A%2F%2Fwww.avito.ru%2Fmoskva%2Ftovary_dlya_kompyutera%2F16-yadernyy_protsessor_amd_opteron_6380_1107827504
Windows 10x64.




newbie
Activity: 5
Merit: 0
February 19, 2018, 01:05:41 PM
#30
Hey, 4x Opteron 6378 64cores 2,3GHz. Does anyone have experience how powerful these processors on mining? For example Monero?

Posible hash rate?

 HI CAN YOU KINDLY CONFIRM IF YOUR OS SHOWS L3 CACHE AS 12 MB INSTEAD OF 16 MB PER PROCESSOR.
newbie
Activity: 2
Merit: 0
February 13, 2018, 02:13:42 PM
#29
I know this is a pretty old thread, but it comes up in several related google searches so I figure it needs an answer. My server with 4x6378 running 40 threads for Monero mining does 2199.6 H/s average when idle (running Ubuntu 16.04, only does about 1800 H/s in Windows Server 2016 with same config file)

I didn't bother with any tweaks (other than huge pages and ulimit increase), I just run xmr-stak-cpu with config as full power on every odd core, then a low power thread on the 2nd, 10th, 18th, etc.

Do you think you could share your full config file ?

Sorry, I don't actually use this forum and didn't see this

Literally the only thing I had done was the CPU setup
Code:
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 1 },
{ "low_power_mode" : true, "no_prefetch" : true, "affine_to_cpu" : 2 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 3 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 5 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 7 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 9 },
{ "low_power_mode" : true, "no_prefetch" : true, "affine_to_cpu" : 10 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 11 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 13 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 15 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 17 },
{ "low_power_mode" : true, "no_prefetch" : true, "affine_to_cpu" : 18 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 19 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 21 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 23 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 25 },
{ "low_power_mode" : true, "no_prefetch" : true, "affine_to_cpu" : 26 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 27 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 29 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 31 },

Just continued that pattern through all cores, every other core but added one low power thread at third and eleventh core on each CPU. That assignment was done because of the way the chips themselves are built. I don't remember exactly what the reason was, only that it resulted in lower heat.

I couldn't use XMRig even though it was quite a bit faster in single threads because it refused to assign that way, and did "whatever it felt like" no matter what assignment rules I fed it, resulting in a much slower overall rate (assignment seemed to be broken on more than 16 threads, not sure if they fixed it yet).

Running more than 40 threads was slower or the same speed, due to the shared resources in the CPU design (2 cores share some things, AES seems to be one of those shared functions), so this was the best hashrate I saw while still leaving the server perfectly usable for basically everything else. I can't really offer anything other than that, though, because I only ran it for a couple days as part of testing the server before putting it to work someplace else.

on linux compiling xmr-stak with -march=native added a couple hundred H/s, and -funroll-loops added about 100 H/s if you care enough to figure out where to manually assign that stuff. [insert funroll-all-loops gentoo joke here]. Playing with compile flags I think I capped out about 2650 H/s on the system, which is slower than it should have been so I think the dell board was limiting somehow (geekbench results were slightly lower than expected too). HP systems will probably do better.
newbie
Activity: 1
Merit: 0
February 06, 2018, 09:56:40 PM
#28
Hello friends!

Don't use XMR-stak-cpu use the new combined xmr stak cpu/gpu it gains about 10-20% with light tweaks. First time you run it, it will ask you basic questions like monero or aeon, pool, wallet etc. You can either copy and paste into the command window or just use phrases to change later like "changemetopool" "changemetowallet"

After it runs, close it. You will have a cpu.txt and a config.txt

The CPU file is the recommendations from XMR stak, I did not have to tweak mine for 2x 6274 opteron CPUs. I wsa getting aroun 1100 stable xmr and 2700 aeon with this

I did go into config and force the mode into AES true and did the gpedit for the large memory pool. I was toying with selling the system cuz it's kind of loud but I moved it to a better spot and it's heating a my cats room now so I think I'll keep, here's the old listing a made for it though. I'm actually happy enough with the hash that I'll try and grab another dual or quad cpu system for another 32/64 threads. The 62xx series seem to be sweet spot for value so far and bonus if you can run a GPU with the mobo.

https://www.ebay.com/itm/202213268056?ul_noapp=true

hero member
Activity: 714
Merit: 512
January 31, 2018, 03:16:36 PM
#27
I know this is a pretty old thread, but it comes up in several related google searches so I figure it needs an answer. My server with 4x6378 running 40 threads for Monero mining does 2199.6 H/s average when idle (running Ubuntu 16.04, only does about 1800 H/s in Windows Server 2016 with same config file)

I didn't bother with any tweaks (other than huge pages and ulimit increase), I just run xmr-stak-cpu with config as full power on every odd core, then a low power thread on the 2nd, 10th, 18th, etc.

Do you think you could share your full config file ?
member
Activity: 276
Merit: 13
January 26, 2018, 02:29:16 AM
#26

Opteron 6380 has AES so I guess that is why he recommend CPU upgrade?
I think you are right about the included Opteron 6176.
Opteron 6100 does not have AES but 6200 and 6300 series do.

Actually I think Opteron 6272 is a better upgrade. Much cheaper than Opteron 6380 on ebay and also less power consumption so less cooling problems. Still 16 cores. I bought the Opteron 6276 but I had to limit CPU frequency in bios to about same as Opteron 6272 to avoid overheating. For mining less power consumption might be a better choise anyway.
member
Activity: 276
Merit: 13
January 25, 2018, 04:06:54 PM
#23
Hi, what do you think about mixing 2x G34 processor with some GPU's in one server mboard ex. ASUS KGPE-D16?
Regards

Should work but I have not tried myself.
member
Activity: 276
Merit: 13
January 25, 2018, 09:54:07 AM
#22
I have 4x Opteron 6276. The best hashrate I got was 2030 H/s using xmrig with 56 threads and set affinity to 0xFEFEFEFEFEFEFEFE.
But my server overheats after a while with that setting so I had to change to 32 threads and affinity 0x5555555555555555.
Then I got a stable hashrate of 1700 H/s. That is the best long term stable hashrate I have got.

You can check http://monerobenchmarks.info/
4X AMD OPTERON 6282 SE 1801 H/s -a crytonight -t 64

I actually got higer hashrate running 56 threads than with 64.
But my Power consumption is around 600W so I guess it is better using AMD Vega GPU which can give same hashrate but at much lower power.
Opteron 6300 series should use a Little bit lower Power but the performance should be similar as 6200 series.

I just completed a server rig build with two motherboards. One with 4x 6276 and the other 4x 6376. I was hoping you might be able to answer a few questions.

1) Are you running Linux or Windows Server?

2) I tried the affinity settings you used for xmrig but only manage 140h/s. Do you mind sharing your full config file with me?

Any pointers or thoughts on your own troubleshooting to get the fastest hashrate is greatly appreciated.

Cheers!  Cheesy

Hi!

1) I am using Arch Linux because that is my favourite OS. Have not tried Windows but there might be an issue with maximum number of CPU sockets allowed by license. Linux does not have that kind of limitations.

2) I also have filled 16 memory slots to give each CPU node dual channel memory (each CPU consist of two 8 core CPU nodes with two connected memory channels). Could it be an issue with memory speed? It was a while I mined cryptonight but I can check if I have the config on disk when I am back at home. The affinity setting is to lock the threads to specific CPU cores. I did initial testing on my 8 core AMD FX-8350 in Another computer which is similar to one of the CPU nodes of the server. Just scale up the settings to all CPU nodes on the server. Not sure if I used "low Power mode" when running at 32 threads though. As I said, I'll check my config.

I also have compiled xmrig myself in order to get all CPU optimizations that might be needed on my system. Don't Think it matters much but if for instance AVX is not used it would affect the results.

But I had big issues with server restarting when overheating something. It was not an easy build, lot of tweaking needed both hardware and software to get it run stable. If doing it again I would probably go for a dual socket version and maybe getting two servers instead of one. Also check Intel Xeon servers.

It is a great machine to use when you find some "CPU only" coins. Initially I was going to use it for Verium mining (should be one of the fastest builds for that) but have not yet tried Verium mining. Have been mining Intense Coin and Credits but now difficulty is too high. I am trying Yenten but does not seem very profitable. Not sure what to use it for right now. But it has already paid for itself so I just use it for fun now. Maybe will try Verium. Forgot that it was the intended purpose :-)

Edit:
./xmrig -a cryptonight -t 32 --cpu-affinity 0x5555555555555555 --av=1 -o itns.intensepool.net:5555 -u ADDRESS.30000 -p x

or

./xmrig -a cryptonight -t 56 --cpu-affinity 0xFEFEFEFEFEFEFEFE --av=1 -o itns.intensepool.net:5555 -u ADDRESS.30000 -p x

Note: This was made using an earlier version of xmrig intended for CPU mining only. I beleive later versions integrated GPU mining also. The pool I used does not exist anymore so don't try mining there.
newbie
Activity: 41
Merit: 0
January 25, 2018, 09:12:29 AM
#21
Hi, what do you think about mixing 2x G34 processor with some GPU's in one server mboard ex. ASUS KGPE-D16?
Regards
newbie
Activity: 1
Merit: 0
January 25, 2018, 08:33:24 AM
#20
I have 4x Opteron 6276. The best hashrate I got was 2030 H/s using xmrig with 56 threads and set affinity to 0xFEFEFEFEFEFEFEFE.
But my server overheats after a while with that setting so I had to change to 32 threads and affinity 0x5555555555555555.
Then I got a stable hashrate of 1700 H/s. That is the best long term stable hashrate I have got.

You can check http://monerobenchmarks.info/
4X AMD OPTERON 6282 SE 1801 H/s -a crytonight -t 64

I actually got higer hashrate running 56 threads than with 64.
But my Power consumption is around 600W so I guess it is better using AMD Vega GPU which can give same hashrate but at much lower power.
Opteron 6300 series should use a Little bit lower Power but the performance should be similar as 6200 series.

I just completed a server rig build with two motherboards. One with 4x 6276 and the other 4x 6376. I was hoping you might be able to answer a few questions.

1) Are you running Linux or Windows Server?

2) I tried the affinity settings you used for xmrig but only manage 140h/s. Do you mind sharing your full config file with me?

Any pointers or thoughts on your own troubleshooting to get the fastest hashrate is greatly appreciated.

Cheers!  Cheesy
full member
Activity: 585
Merit: 110
January 23, 2018, 04:45:08 AM
#19
anyone having a list of parts for this build
4x opteron 6378?
sr. member
Activity: 2674
Merit: 328
January 22, 2018, 04:38:28 AM
#18
Hey, 4x Opteron 6378 64cores 2,3GHz. Does anyone have experience how powerful these processors on mining? For example Monero?

Posible hash rate?

Between 2000 and 2500
member
Activity: 276
Merit: 13
January 22, 2018, 03:31:14 AM
#17
Okay yah I'm in... Ordered 9x systems with 4x Opteron 6380s per system.

Suggestions on the best / easiest way to install Linux on these ?


You install Linux just as on any other other computer, no difference.
I have a 4x Opteron 6276 server and had some trouble getting it stable because of heat.
Had to replace heat sinks and underclock a bit to make it run stable.

Keep in mind they are power hungry. 600 W per system is my guess.
Also very high sound level because of the cooling needed.
Still it is a good CPU miner for CPU-friendly algos.

Edit: And as I said above the Opteron 6200 series is almost as good as 6300 series opteron.
The 6300 series was much more expensive when I bought mine.
hero member
Activity: 714
Merit: 512
January 19, 2018, 08:56:56 PM
#16
Okay yah I'm in... Ordered 9x systems with 4x Opteron 6380s per system.

Suggestions on the best / easiest way to install Linux on these ?
hero member
Activity: 714
Merit: 512
January 19, 2018, 08:32:07 PM
#15
I know this is a pretty old thread, but it comes up in several related google searches so I figure it needs an answer. My server with 4x6378 running 40 threads for Monero mining does 2199.6 H/s average when idle (running Ubuntu 16.04, only does about 1800 H/s in Windows Server 2016 with same config file)

That is pretty awesome... I am looking through e-bay to see if I can dig some of these Opteron 6300 computers up =)
full member
Activity: 585
Merit: 110
November 06, 2017, 08:32:10 AM
#14
Hey, 4x Opteron 6378 64cores 2,3GHz. Does anyone have experience how powerful these processors on mining? For example Monero?

Posible hash rate?

here from linus video?
:p
member
Activity: 276
Merit: 13
November 06, 2017, 03:25:38 AM
#13
I have 4x Opteron 6276. The best hashrate I got was 2030 H/s using xmrig with 56 threads and set affinity to 0xFEFEFEFEFEFEFEFE.
But my server overheats after a while with that setting so I had to change to 32 threads and affinity 0x5555555555555555.
Then I got a stable hashrate of 1700 H/s. That is the best long term stable hashrate I have got.

You can check http://monerobenchmarks.info/
4X AMD OPTERON 6282 SE 1801 H/s -a crytonight -t 64

I actually got higer hashrate running 56 threads than with 64.
But my Power consumption is around 600W so I guess it is better using AMD Vega GPU which can give same hashrate but at much lower power.
Opteron 6300 series should use a Little bit lower Power but the performance should be similar as 6200 series.
Pages:
Jump to: