Topic: Data Center Mining Garage and Man Mining Cave - page 19. (Read 49418 times)

I had a bad experience with NVIDIA 1070 due to high expectaction and getting poor results so my opinion is very Biased.  I sold the 1070 before ZEC was out so I don't have much experience with that but with Eth it was horrible and so painful to get even 6 cards working.  When I finally got it working, I tried not to look at the rig because if I do, it may Artifacts and crash.  =) On top of this, every time I see a Nvidia FAN brag about how much faster and efficient it is, I asked them nicely how they get it and never really get a good response so I don't think they even got those results but probably relay what they've heard instead.   I bought those cards based on the rumors but when it comes to the test and Killawatt results = Not so impressive.  It took me a while just to get them stable.  I dont have as much cycles now as I did back then so there's no way I'm going to be chasing the "promised" land anymore.  

To be scale big and be successful, it's best to settle on a solution that works, have great community support when you need it, rather than the "chance" or the hope it works solution.  This is another reason why I didn't jump into Linux before even though it was slightly faster.  The driver update and support was much more limited and slow.  This all changed with Simplemining OS.  He made it super simple, even a Monkey can Mine and the support is FANTASTIC.  The OS developer's nick is Tytanik and using his usual tone of voice "MEABY.........NVIDIA is better with Linux".  That I don't know.  The Meaby part is only funny if you follow his thread and understands how he talks.  He's a funny cat and super awesome guy.    No NVIDIA for me for a long time until someone can SHOW ME THE MONEY...............$$$$$$$

It's hard to recommend a card now due to same hash rate but much higher difficulties.  I still see good values in the RX480 as you can get them cheaper than $180 via Purse.io.  They can be fine tune to handle most coins and depending on the ROM, the wattage can be as low as 98W and as high as 180W.  It's all about good ROMs for the 480 since a ROM designed for ZEC will do horrible on Eth and vice versa.   I had some OK roms but it's been a while I've done ETH so I'm forgetful on how I got the better than normal hash.  On top of that if you have 1 card with less than ideal RAM in the rig, it will crash.  I'm impress with your hash rate for the 1060.  They are relatively cheap so getting 290 Sol / card is impressive.  IS this with claymore or Optiminer?


P.S It's Finsy not Pinksy.  You might get different products if you look for Pinksy.  =)  Tell him Nhan Do sent ya.  He'll hook it up, great guy.  Everyone on the Forum knows Finksy.  If you need risers, including the 6 pin PCI version, hit Hawkfish007 up.  They operate on razor thin profit margins as they're doing it for the LOVE of the GAME and to help our mining community.  Compare their prices to the market and you will see.  You get quality stuff and much better support than Crappy Ebay vendors, etc.  Best to support guys like these.

Where do you generally buy your equipment from?

Similar to that........If it's still working then I'm not sure.  This is the sign of death for the 470s for me and my friends but it appears to be mostly affected in the first batches.  I have over 100 plus RX470s and the rest appears to be in better shape.  I even have Sapphire RX470 where they are stupid enough to put the serial number right on the protection tape where you are supposed to peel off.  So no more SN after that!  They fixed that issue fast.  My RX470 farm have been rock solid since and are on track to be profitable very soon since I start mining them since Sept at $165 each via Jet.com discount back when they first came out.

@yun9999, great thread, been watching it for a couple of days.  I see you use the msi gaming 5 board z97, I use the same one.  I reached out to pinksy for the 4k psu and next week will work on putting in a 220 in my breaker box, im not as big as you yet.  The couple of questions I have is, what gpu do you suggest.  I read your post on the 1070s, I actually have a rig of 6 asus 1060 4gb.  I get about 1750 SOL/s with zec/zcl out of it with 650 power.  If I wanted to go the route of AMD's, what do you suggest that I could find around 200 used.  and did you have to do anything special to get 7 gpus working on the msi z97.  I tried 7 nvidia cards in windows 10 on mine and it was a no go due to resource constraints so I am guessing I will have to go with linux (what flavor) and amd cards to get 7 on this motherboard.

Thanks, and keep up the dedication cause it pushes alot of us to follow

by any chance this explosion sounded like a "loud cracking of the whip" ?

I got something like that awhile back.... but after inspection of all rigs... seems business as usually ... what could it be?

  Wow, what an awesome project!
I have been considering building my first real farm but still don't have the business model worked out quite yet and I am new to farming so please bear with me if some of this sounds like common knowledge.
Just want to be sure of a few things before I throw 30k at a side project.
I am looking at starting with one 48U Rack, 6 rigs, built exactly as yours are, using the same M5 MOBO or the ASRock H81 Pro BTC R2.0. Still contemplating GPU's since prices are dropping and new product lines are about to release. We are going to be install solar panels on the property with Tesla powerwall(s) for backup.
1. What CPU did you use?
2. Heat sink?
3. What RAM and how many GB did you use? Are you able to utilize the RAM in any way?
4. Did you use m.2 SSD's or just standard SSD's?
5. Is there any performance decrease or increase in GPU Hash rate by using PCIex1 or PCI-EGen3?
6. How much power is each rig or the rack of 6 rigs pulling?
7. What is your average hash rate per rig for whatever you are mining? I would assume XMR/ETH?
8. How much data/bandwidth are you going through on average per month?
9. Is there anything you would have done differently in hindsight?

Any advice or tips from anyone would be greatly appreciated!

Your thread has been extremely helpful. Keep up the good work. I'll be sure to throw some BTC your way once we get going.

Oh so sexy and so clean clean!!! Is this server PSU powered?  This is very pleasing to the eyes!  Yes feel free to share here as I support forum member's business and encourage others to do so.   Show more details on the connections please.   

congrats to OP !! awesome build & much work done especially the PASSION.

I do build my own rigs & so called DIY DC as i'm also a DIY man.

Following your thread, much to learn. Sharing a rig that i built "lucky7" (same mobo), rig is sold to the highest bidder in my little telegram group. Will build couple more of them with improvements soon.

MSI RX480 RED.  Yeah I think they are Gaming X. There is only 1 MSI RX480 that are RED.  The Armor are white.


@m1n1ngP4d4w4n  - The Power supply doesn't make any noise.  It's the cooling fans that do.  With the IBM 2880W, those are NASTY LOUD and takes some skillz to replace the fans.  The IBM 2KW doesn't come with any fan.  You buy the custom FAN mount from Finksy which is very good and dirt cheap.  They help combine 2 x 2kw IBM PSU.  The unit is very compact if you can size it up in my picture against a rig.  The breakout board have the built in 2 fan connectors.  If you look at my fan review, all 3 of those fans are plenty sufficient to keep the server PSU cool in normal environments.  Finksy's fan will be the loudest but also the most powerful.  The noise is not Antminer or 2880W or even Dell server annoying loud type, it's a nice Strong white noise LOUD.  I don't recommend running it inside your house but inside garage and hosting site, the box fans or exhaust will wash out the sound.  The other 2 fans are less noisy and a little less power.  Hawkfish and Finksy's fan are ball bearing, Scythe is not.  Scythe is also way more expensive so they're no longer my option as in the past they were the best option as they were way cheaper than Noctua which.  If noise is your biggest concern, get Hawkfish fan.  If max power and noise is less of a concern as you're hosting or running in garage, get Finksy fan.  If you work in the data center, you're probably hearing the annoying high RPM smaller fans. those are annoying sounds.  I have a 850W Dell server PSU and that is ridiculous loud vs the fans I'm using for the IBM 2kw.  Also the pitch of the sound is what makes something untolerable not just the loudness. 

PDU = Power Distribution Unit.  IN Layman's term - a High Powered power strips.

I've bought 14 x 1070 before from 3 different brands.  Great for gaming and efficiency, for mining I think their drivers still sucks for it.  I think that's why Claymore is so slow on the development front for Nvidia.  Crashes all the time and its' very challenging to fine the right settings that would work for all the cards.  All you hear on the forum is people bragging about how awesome they are and you end up buying it just to find out, they don't live up to the hype.  I bought them with the promised of 37MH for Eth.  Never happened.  Some lucky lottery winner guy prob have 1 GPU that have perfect RAM that can clock at that speed.  When you have 7  GPU in 1 rig, if all 7 are not created equal, they will crash.  It's too much work to tweak individually when you're running a large farm hence why I'm a 100% AMD place.  Sold all 1070.  Power saving wasn't all that great either but during that time Simplemining OS wasn't available, it could simply be a lot better in Linux.  For the cost to hash ratio, I still prefer AMD.  It will take a long time to ROI for the 1070 and as the best hashes for ZEC requires Nicehash which pays you much less than normal mining tools so really don't get paid for the full SOL hash rate.  I was so excited seeing a 1070 able to do over 420 SOLs just to find out Nicehash pays based on certain card type so the pay doesn't really match what whattomine.com shows will net you for those hash rates.  It's WAY lower.

Here's a picture of my 1070 rig which is on the black network rack.  




The white ones are the Asus tiny compared to the red MSI 1070 which looks identical to the AMD MSI 480. I dump them after a a few months due to the frustrations of lack of support via Forums.  I only see people bragging but no one was able to prove it or provide the proper guidance.  I was getting 30MH using 150W plus.  I can do that with my Reference 480 using 110W.  For $400 I can get double the hash at 220W.  Unless someone can prove me otherwise, I don't see any big advantage for the 1070 for the popular coins, ETH, ZEC, XMR.  It's hard to recommend any cards right now as new GPUs are about to come out and revenue for existing are dropping fast.  But I would think any 2 AMD cards will be better than 1 Nvidia card especially with the right ROM.  Ref 480 and RX470s are very easy for ROMs as you're just copying Mem strap down and there's hundreds of places and youtube video on that.  Non reference 480 is a bit more challenging when copying straps alone doesn't do the job well.  


On that Note ***********   Don't be shy folks.  Still need help with MSI RX480 ROM that is good for ETH for MSI RED 480 and Armor 480 4G ****************

Yeah i have to agree with that EVGA are good psu's, and i can understand your point of view on keeping some things separated, it's also probably more cost efficient on the long run

What are your take on using server PSU's against normal ones, in my day job i do alot of datacenter stuff, and im kinda afraid of using server PSU's because they're super noisy, how much noise they do the one you use ?


PDU = power distribution units

Basically a power bar with many electrical outlets, usually rackable, and some are monitored/metered or/and remote controlled (like APC rack pdu's)
'
example

So the GPU's u are using are the MSI Gaming X series? Those are RX 480 8GB's?

No as I prefer to test for stability and understand all the caveats first.  Pico solution is better in some area and worst in some area so it's not a 1 solution fits all.  It just opens up many more creative rig options choices with the space saving as the IBM PSU are in 2KW pieces and there is separate 2KW board for a more compact solution to throw into server cases for example.  I could also use a single 2KW to power 1 power hungry  7 GPU Fury rig, not that even a EVGA 1600 can handle that on Eth.  Zec it can but not Eth at over 260W for each GPU.  I'm sure Vegas 10 will be using good amount of juice too.  I already have these Server PSU so I am enjoying the flexibility it's bringing me.  Also the fact that they are 2KW to 4KW and the PSU is difficulty to be pushed to the max load, you're getting much better efficiency then say an EVGA 1300 powering 6 or 7 GPU and is above it's 80% load. 

EVGA = Great resell value, better individual rig power on and off control. Outstanding support and RMA services.
Server PSU - Flexibilities are endless.  Exceptional value for 3 rigs plus or power hungry rigs.  Cheap to start and build up based on needs.  Cheap replacement parts.


I LOVE EFFICIENCY and COST SAVINGs.   That to me is SEXY.

Sorry for noob question, but what is a PDU?

Also, could you explain why you choose to run AMD card rather than GTX 1070s? I will be buying soon and need to make a decision. As I see it, Eth will be switching to POS this year probably, so I think AMD cards will not be that useful then. I also feel that the increased cost of the GTX 1070 will be made up for when they are resold, and they will also have much more hash power when they are being used. However, Monero is becoming a popular coin that also excels on the AMD cards. I am truely torn. I guess I just need to figure out the best cards to buy TODAY.

@klimpa - Thanks for the kind words.  It's hard work and I'm spending ridiculous amount of hours for my rigs but boy when you love what you do.........it's hard to call it work?

@zimmsquad - I am very careless and abusive to my gear and fortunately never really have issues using dual PSU.  I don't bother with P2PSU.  Just make sure both the Server PSU and baby PSU are on the same PDU and you'll be fine as they will power on and off at the same time when you have a power outage.  The rigs won't power up until you hit the power from the ATX which controls the show anyways.  I've had it power up and off with 1 not on, etc.  No issues but also not recommended.  Its best to have the server PSU up first and then power on the rig via ATX.  ATX PSU control the show.

If you can over look the initial cost, I would definitely go with nice quality G2 650W EVGA used with warranty.  EVGA is the best in the biz for RMA and support.  
G2 baby PSU are exceptionally good baby PSU.  It must be G2 not G or HQ versions as those PSU are not compatible with EVGA G2 1200/ 1300 and are lower quality.  I like the G2 baby PSU as it's one cheap way to get cables that are usable for EVGA 1200 and 1300 (Sata / Molex / MB / PCI).  I have many used EVGA 1300 that I bought without MB cables for bitcoin mining so it's a nice bonus.  =)  They're very compact, quiet and have longer warranty then the cheapies.  They should have good resale value.  The higher efficiency will also repay for the premium difference over time.  They are often found used for $60-70 used.   Another good option is EVGA 700W that are often found for $45-50 used on Amazon.  It doesn't give you the cable compatibility, strong resell, etc but it does allow you to power 5 rigs cheaper than spending on 5 x G2 650W.  Either option is fine depending on your budget but also don't over spend else you're not really saving a lot of money going server PSU route.  In any event if you have a large farm you will always need at least 1 x 4kw Bundle just for the flexibility especially when we GPU becomes Power hungry again.

It's simply not worth the hassle, failures, headache with anything cheaper just to save $10 buck per PSU going with a 430-600W PSU.  Trust me, I've tried over a dozen different brands trying to save cost when I was first starting out.  That end up costing me so much money as I had to throw them out or stop using them due to SATA cables failing or limited SATA connections etc.  Also when they die, you don't really feel like spending $15 to ship the PSU for warranty replacement on a $30-40 PSU as you dont want to invest even more into junk.  Even the EVGA 600w is crap.  It will do the job but don't expect it to last long or survive hot temps when powering 7 rig GPU risers.

A good analogy is like buying cheap tires, in normal situations, they work just fine, in rough terrains, snow and other tougher conditions, you need better quality.  We're pushing our rigs super hard, quality is important.  Never a good idea to skimp on PSU. Find other ways to reduce cost such as using Simplemining.net for your OS to save the $40 on SSD and spend it on getting quality PSU.  Don't use 8GB RAM when you really only need 4GB. That's another common mistake I see many people make.  That only is $65 you just saved where you can invest in a quality PSU.

Are you going to switch to 6x pin powered riser and some other adapters to get rid of the baby PSU ? or do you think you will still one for the motherboard/harddrive ?

You connect 1 baby PSU such as a cheap EVGA 650 watt PSU to power the MB and power risers, SSD for each rig.  It's best not to go too cheap on the baby psu as they wont last too long or may not be able to handle the summer heat under max load during the hot summer.  Remember cheap PSU ratings may not be accurate and they tend to post Peak Power vs RMS (continuous use) which is what you want for 24/7 operation.   Finksy is coming up with Pico PSU options as well so it will get more interesting.  I will review it when he send me some.

The GPU gets powered from the 4KW (2KW+2KW) which plug straight into that 4KW breakout board.  The 4KW PSU's breakout board have 30 PCI slots so you can power up to 30 GPU no issues.  I power 5 x 6 GPU rigs 470 and 480 for many months.  Keep it mind that some of the power is being handled by the baby PSU so only about 2/3 is being powered by the server PSU so 30 GPU is no issues for this BEAST of a PSU.  They're server class so they're built like Tanks.  I abuse them non stop for close to 2 years in the Houston heat and humidity for both Bitcoin and GPU mining. I also bought spare 2KW PSU since they are so cheap for backups.   This is why I hardly ever recommend paying $350-450 for a EVGA or Corsair PSU 1500-1600 PSU that at best can handle only power 1 rig but sadly can't even do 7 x R9 390.  I do love my EVGA 1200 Platinum and EVGA 1300 as they are priced reasonably per rig when on sale and they keep their values for many years.  

EVGA is my go to brand as their support is First class, super fast replacement / RMA.  I find their cables more flexible and durable than other brands but that's just my opinion.  I'm not sure if the other EVGAs have the same protection but the EVGA 1300 seem to have a smart trigger where when there's a short somewhere, it will shutdown the GPUs and motherboard.   You can't power it back up unless you reset the MB plug but even then it will turn it off shortly after again.  This gives you the opportunity to fix the issue by disconnecting and reconnecting the GPU 1 by 1 to find which one is causing the issue and replace it.  Once I had this issue and via troubleshooting, swapped to a Corsair PSU  BOOM, one of my RX470 exploded!!!!, The GPU that is causing the short is usually always the one that will end up exploding as I had a few of this incidents.  So when you see this issue, don't blame it on the fact that you're using dual PSU with the IBM server PSU, that's not the reason as you'll also see this in single PSU setup.  All my explosions were from single PSU setup.  The Corsair PSU didn't cause the issue, it just wasn't as smart to know there's a Short.  That was a scary experience.  =)  

I have many MSI RX470 and initally that's a very common issue.  Perhaps that's why they came up with MSI Armor?  To protect you from the explosions?  Haha.  Haven't had 1 explode since so it must have been initial bad batches but my friends have had similar experiences.  It sounds very loud and scary but after you see it once, it's not scary anymore as it's just a small spot that gets burnt, but could also be a capacitor in the inside that we can't see as the sound is like a small bomb exploded.  It won't damage the rest of your rig or cause any fires.  See picture below.



Other than that issue which doesn't seem to happen in later batches, I do like my MSI RED GPUs and hence why I standardized on them.  Not only are the MSI RED the sexiest RX GPUs w the RED LEDs and cool Tiger look, they also have 1 of the best cooling system of all the RX series bar none.   I didn't even have to use box fans for my RX470 rigs even my garage temp was hovering over 100F.  The Twin Frozr system automatic stops the fan when they're below 60C or something like that.  How many GPUs do we see going below those temps?  For the MSI, it is quite often as they run very cool.  So often that I thought my rigs were down.   I'm not as much of a fan with the Armor series.  They took out a lot of stuff to make the price more competitive and it's quite obvious.  No sexy back plate for the RX480, different and cheaper heat sink and fans, etc.  They run much hotter as well.  The Reds are worth the premium.

Awsome farm you have there mate. keep up good work.