Topic: When was your last "Oh, shit!" moment - How did it turn out? (Read 302 times)

Yeah I'll be sure to have a copy of my current Firmware or at least confirm with Yang there is something else available. If the 49TH is quiet enough it goes inside if not then I go back to the original and leave it out in the garage. I should actually check it's power draw out there, as I'm pretty sure I have it running in it's coldest possible environment. Thanks again.

Just remember h6  firmware for nov 11 gave me 49th and 14th

since it worked with the replacement psu I have to use it.

make sure you can go back  to the older firmware.  although  the 49th highspeed may be quiet enoguh.

I did not check efficiency since the power cost is ½ the coins mined.

so 24.5th for free vs 0 th was worth doing and buying the new psu. for 275.

24.5th earns 24.5 x .126 or 3.087 a day  90 days the psu pays off 277.83.

Right I remember reading up on that. Met yourself a good friend when in need out of that situation. Glad that's been the worst of it.

My miner is worm, moves it, shelf mate torches them both. Fuck that is a damn lucky scenario that you had been around. It's bad enough when it's your gear but to have it pull hosted gear and the farm infrastructure into the mini disaster is just getting kicked while down. I'm glad to hear the second story was minimal especially after the first, I guess you might have seen a report or gotten a phone call if it had been the whole farm up in flames. I probably won't ever use those jam in connectors again now lol. Tried them on a few plugs but wasn't a fan anyways.
Nice score finding those guys and the firmware. I should get around to playing with my m20s this week sometime.

Okay my beta m20s died. It is 68th so it is costly.
I could have ordered a psu from pangolinminer but it was 208 inches plus tax and wait for about eight days.  I found HMtech in North Carolina he sold me a whatsminer p21 psu.  It is an upgrade from my p20 psu.

Paid on thursday the 26th arrived on sat the 28th

First test plug it in it works.
Second test attach the fans it worked.
Third test fully swapped it out and it boots to the error controller can not find psu p20.

I knew this would happen as my m10 p10 to m10 p11 psu did the same and would only work with a firmware upgrade.

Went to upgrade the controller to allow the p21 psu.

Firmware failed.  Very pissed off. I keep looking for a good firmware
I had a beta m20s it uses the h6 controller not the h3
Every firmware was
Finally found h6 firmware for nov 2019.  It worked my 68th is back online downtime was
About 12 days.

I stepped out of my workroom about a year and a half ago and smelled smoke. Usually when I smell smoke it's coming in from outside since there's a state lot down the road where they burn brush sometimes. So I was checking out the big door and when I turned around I noticed smoke coming over the wall from the hosting room.

Had a guy complaining that his miner was getting too hot and wanted it moved to a cooler shelf, so I moved it onto a shelf with only one other machine. But that miner's middle board burned up and ended up torching both miners and part of the cold-aisle isolation backing before I got it put out. Fortunately we kept a big extinguisher at the end of the shelf, and it only took a few extra seconds to kill the power just in case.

Had that happened when I was gone overnight instead of during the day, the whole place might have burned down.


More recently I noticed miners and email went down while I was out of town. When I got back in, I went right out to the shop to check on things. Thought maybe power was out, or the shop had burned down for real this time. Well just almost everything was still powered up, but the outlet the battery backup upstream of the modem was plugged into had burned itself out. Whoever wired that part of the building used the "stick the wires in this self-catching hole" option on the outlet, instead of doing it right and using the screw clamps, and the connection went sour, heated up and melted down the socket. Good thing it was in a metal conduit box. So I replaced that and got things back up running pretty quick.


That's about the biggest issues I've run into.

I got tracking and the gear is due tommorrow maybe I get the unit working be sat night.

Company  will get a small write up if they are good. So far they are.

My last and biggest "Oh, shitttt" was just a while ago when my main circuit breaker went on fire , i wrote the whole story right after it happened, it was really scary and tragic, I think I am very lucky that it ended like that, could have been much worse.

Despite how bad it was, I did learn a great lesson, was a little hard way of learning tho.


Agreed ! location is very important, I can never feel good about having my gears any where that I can't reach in just a couple of minutes, I have a few gears that are like 3 hours drive but the host guy takes care of them along with his own gears, and still I hate the fact that I can't reach them daily.

yeah after my 2x cataract surgery close up repair work is a thing of the past.

they are in North Carolina so if they are good I will be closer then I am to pangolin thats for sure..

we have about 85 units of various gear ⚙️ and will be adding more. so a closer location is good for us.

Yikes, good thing you guys got that cooling sorted and decided to drop back down to 13.5. Those S9's are just butter now for you so definitely not worth burning out a couple for the extra 30 TH. Hopefully you get that M20S back up and running soon. Is Pangolin on holiday right now? Makes sense to try and see if they can get you one quick, but building a relationship with a new local repair is definitely worth it... if they're good.
Man I'm so glad I've never had that moment. My wife would have the gear back in the garage immediately... not that I'd blame her. I have always worried about creating a flamethrower in the basement, but that's why I opted for the mineral wool, and cut back anything flammable from the flooring all around the miner setup. I'm glad it didn't turn out worse and you managed to sleep soundly while it hashed away in the future.

One very serious 'oh sshieet' moment for me was when my BW-L21 miner 6-pin power connectors were badly burned because of a crappy power supply.

The burned plastic smell really startled me bad time.

Aftet I had it fixed and bought a HP DPS 1200 FB A psu, I could sleep my nights ok again.

Yesterday  I went to Clifton warehouse and w tore down and reorganized a rack of gear.

Took all day.  we did s9's
131
132
133
134

135  I knew this one had an issue

136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
155
156

190
191
192
193

I had just did new firmware on all s9's  and they were all doing 5000gh a board for the last 10 days as we finally had setup good cooling in the warehouse.  I did a video I need to post later today on youtube.

I looked at miner 135 first I knew some thing was  wrong  turns out the psu burnt and maybe  1 board is now dead.

I looked at every miner and everyone (20+) had browning on the middle boards when set to   15th  vs 13.5 th.

So oh shit.

On the good end  every one is now clean and set to 13.5 th or  9 th or 4.5 th  as we had some miners with 1 and 2 boards.

I feel happy that
1) I never tried running them clock to 15th for an entire year I ran them at 13.5th
2) all work but one once set back to 13.5th
3) I waited to  test when all fans were done correctly and room was cool.
4) worst case is I lose 13.5 th miner out of 1260th

second oh shit Is I have a dead m20s no sign of life
I do have a spare psu
will test it out maybe in the 26th

I will hope it comes back to life  this is the unit I got in may  so it has run from may to december with no issues.

So our large set should be 68 + 13.5 = 81.5 higher and 20 s9's should be 15th not 13.5th that is 30th.

the high speed gain of 30th is a no go   a loss of 30th
the one dead miner may get back to  4.5 ot 9.0th  so a lose of say 5th

so we lost 35th for sure combo  of dead  gear  and loss of over clock

I hope I fix the m20s as it is 68th.

a loss of 35 is better then a loss of 103th.

Up date

I have 2 p11 psu's  and 0 p21 psu's

So I will need to order one.

I found a usa based company.

https://thecoindad.com/   they do repairs  and have parts  may try them.

https://twitter.com/Fix256/status/1208109120072691718

they have one for about $260.

if I order from pangolinminer it is less about 210   but  I may want  to find someone fairly close for repair help.

So first off mine had a happy ending but it came with a massive sweat. I couldn't confirm or check anything for 10 hours.

So running behind the other day I headed off to work without a quick check of the forum or my hashrate with a morning coffee, somewhat a routine as I get ready for work. Sit down in the office and to my dismay I notice that I have no miners hashing. It's at this moment I recall my M20S sounding as if it was ramping up from the garage as I headed to my car. Chalked it up to a colder day and the fans possibly cycling - either way it wasn't enough to cause me to pop in and check.

So I'm left with knowing my miners were at least powered up in the AM, as I heard the house miners as well and no hashrate - Instantly I'm thinking network is down. So when my wife calls saying she can't connect for work, I have a mini eureka. Navigate her past my loud, cable needing miners to the source of all that is connectivity. She does the power cycle for me, while explaining I may need to arrange things better for when others have to do this stuff - I kindly remind her I've probable done this 20 or so times without her knowledge and that she did just fine lol.

Now the panic, my M20S comes online but the house miners are still down. Instantly I'm thinking fuck... they overheated or something F'd up in the controller. Damn ~90TH might have just pooched itself. Turns out, when power cycling the router, she wiggled the power cable loose for the secondary router that was feeding the 3 home miners - still looked plugged in but was doing nothing. I couldn't have been happier at that moment as I had already gone to worst case scenarios. Best break even I've had in a long time