Remotly restart mining whenever GPUs crashing

tg88

legendary

Activity: 2492

Merit: 1429

Payment Gateway Allows Recurring Payments

Quote from: jackjackfly on January 09, 2018, 04:07:15 AM

Try to Google about USB WatchDog for Mining Unattended Operation Crash Auto Recover Reboot, that should help you. I'm not 100% sure, but it should help. Good luck to you

Have you tried these usb watchdogs? really works? I found this interesting video:

https://www.youtube.com/watch?v=tW3QLxakL2U&t=282s

jackjackfly

member

Activity: 322

Merit: 10

To buy or not to buy - that is the question ;)

Try to Google about USB WatchDog for Mining Unattended Operation Crash Auto Recover Reboot, that should help you. I'm not 100% sure, but it should help. Good luck to you

Rasanders22

jr. member

Activity: 67

Merit: 3

Quote from: happywilli on December 30, 2017, 11:44:56 AM

Hello Guys,

Im wondering if it is possible to restart my mining rig remotly when gpus crashes.
I've some issues going on with my mining rig, the GPU's crashes after 1 week.

I'm currently using 4x 580 8gb x gaming GPUS with EVGA GQ 1000Watt 80 PLUS Gold and i'm mining both eth + dcr
using these settings.

tt -30 -cclock 1120 -mclock 2100 -cvddc 920 -mvddc 875 -dcri 30
i've latest updates etc..

whenever my mining crash i get error message Application EthDcrMiner64. has been blocked from accessing Graphics hardware. Display driver amdkmdap stopped responding and has successfully recovered.
and the fans goes very fast/high and i cannot access the computer from teamviewer, so what I need to do is to manually restart it.

Is there a way I can autorestart my mining rig whenever it happens and im not at home?

Thanks!

At my work we use these little boards that can short the psu wire that turns the PSU on/Off. But you could easily work something up with a relay control board. I've thought about using a python program that could control the relay and is controlled by another system, maybe a rasp berry pi. It would ping the miner, say every 5 minutes and if it was hung it would cycle power to the PSU and start the system. But I just havnt gotten around to building it.

ibinsad

sr. member

Activity: 616

Merit: 250

Quote from: martyroz on January 09, 2018, 12:24:49 AM

I use these to reset frozen rigs;

https://www.ebay.com.au/itm/Panasonic-KX-HNA101AZW-Home-Smart-Plug/192380962533?epid=3011381083&hash=item2ccacc86e5:g:yEcAAOSwpkFY5bo8

Do you know if there is a system check wattage if lower than 500W i check the rig and if need restart it?

martyroz

full member

Activity: 325

Merit: 110

I use these to reset frozen rigs;

https://www.ebay.com.au/itm/Panasonic-KX-HNA101AZW-Home-Smart-Plug/192380962533?epid=3011381083&hash=item2ccacc86e5:g:yEcAAOSwpkFY5bo8

BennyT

full member

Activity: 259

Merit: 108

Quote from: puwaha on December 31, 2017, 07:32:51 PM

Quote from: BennyT on December 31, 2017, 10:16:35 AM

I use the plugs as well as a last resort such as the system isn't responding to my remote login via TeamViewer.

It would be nice if I could get a notice when my hash rate drops. 8 cards hash at 180 mh/s.. when one card goes and it drops to under 160 mh/s, then I know I need a restart. Can't figure it out though.

Awesome Miner can be used to monitor and control your rigs. It has rules where it will restart mining software if it crashes, or monitor hashrate, and if it falls below a threshold, the rule will run an action. The action can be anything like restart the mining software, reboot the rig, and a whole lot more.

Looks great! Going to try the free version and see if it’s worth paying for more licenses

puwaha

sr. member

Activity: 700

Merit: 294

Quote from: BennyT on December 31, 2017, 10:16:35 AM

I use the plugs as well as a last resort such as the system isn't responding to my remote login via TeamViewer.

It would be nice if I could get a notice when my hash rate drops. 8 cards hash at 180 mh/s.. when one card goes and it drops to under 160 mh/s, then I know I need a restart. Can't figure it out though.

Awesome Miner can be used to monitor and control your rigs. It has rules where it will restart mining software if it crashes, or monitor hashrate, and if it falls below a threshold, the rule will run an action. The action can be anything like restart the mining software, reboot the rig, and a whole lot more.

BennyT

full member

Activity: 259

Merit: 108

Quote from: dragonmike on December 31, 2017, 10:22:45 AM

Quote from: BennyT on December 31, 2017, 10:16:35 AM

I use the plugs as well as a last resort such as the system isn't responding to my remote login via TeamViewer.

It would be nice if I could get a notice when my hash rate drops. 8 cards hash at 180 mh/s.. when one card goes and it drops to under 160 mh/s, then I know I need a restart. Can't figure it out though.

Look at the vega mining guide online. People have written little scripts that do just that. You might be able to use them / adjust them to your miner and GPUs. Just an idea.

Thanks! I just look a look at it... http://vega.miningguides.com/#Script

Not sure it seems easy enough to implement.

dragonmike

hero member

Activity: 1274

Merit: 556

Quote from: BennyT on December 31, 2017, 10:16:35 AM

I use the plugs as well as a last resort such as the system isn't responding to my remote login via TeamViewer.

It would be nice if I could get a notice when my hash rate drops. 8 cards hash at 180 mh/s.. when one card goes and it drops to under 160 mh/s, then I know I need a restart. Can't figure it out though.

Look at the vega mining guide online. People have written little scripts that do just that. You might be able to use them / adjust them to your miner and GPUs. Just an idea.

BennyT

full member

Activity: 259

Merit: 108

I use the plugs as well as a last resort such as the system isn't responding to my remote login via TeamViewer.

It would be nice if I could get a notice when my hash rate drops. 8 cards hash at 180 mh/s.. when one card goes and it drops to under 160 mh/s, then I know I need a restart. Can't figure it out though.

dragonmike

hero member

Activity: 1274

Merit: 556

Quote from: bucketofsocks on December 30, 2017, 09:10:09 PM

I use wifi smart plugs and just set the bios to power on on power loss. If the pool notifies me the miner is down I try teamviewer, if I can't get it I shut the outlet off for a minute and back on, works pretty good and for less than $20

That's what I use as well. Every rig is plugged to a smart plug (TP-Link HS100 or 110 if you want power monitoring). The app on your phone allows you to cut and restore the power from wherever you are as long as you have internet connection. Invaluable piece of kit imo.

happywilli

newbie

Activity: 29

Merit: 0

Quote from: bucketofsocks on December 30, 2017, 09:10:09 PM

I use wifi smart plugs and just set the bios to power on on power loss. If the pool notifies me the miner is down I try teamviewer, if I can't get it I shut the outlet off for a minute and back on, works pretty good and for less than $20

yes, I just ordered one myself, im going to try it out!
Can i remote control it externally?

zoufou

member

Activity: 114

Merit: 10

I've made scripts to reboot the rig, but most of the times the OS were freezing and does not respond to a reboot order.

So finally fixed my issue here: https://bitcointalksearch.org/topic/m.27162143

ibinsad

sr. member

Activity: 616

Merit: 250

Quote from: bucketofsocks on December 30, 2017, 09:10:09 PM

I use wifi smart plugs and just set the bios to power on on power loss. If the pool notifies me the miner is down I try teamviewer, if I can't get it I shut the outlet off for a minute and back on, works pretty good and for less than $20

I have the same system you told but, what if you are sleeping and rig freeze?

You cannot do anything and lose money, is that why a watchdog will be better, it will restart automatically.

leonix007

sr. member

Activity: 1008

Merit: 297

Grow with community

Take a glance on Simple Rig Resetter, its not free but seems its reliable, this is what I want on the coming year however its out of stock right now, it can manage upto 8rigs with expansion boards optional. its like doing a Hard reset when all Hangs up. Grin

https://shop.simplemining.net/ssrv2.html?___SID=U

https://bitcointalk.org/index.php?topic=1695298.420

bucketofsocks

member

Activity: 83

Merit: 11

I use wifi smart plugs and just set the bios to power on on power loss. If the pool notifies me the miner is down I try teamviewer, if I can't get it I shut the outlet off for a minute and back on, works pretty good and for less than $20

iSkyCastle

member

Activity: 142

Merit: 10

Quote from: IGROK2005 on December 30, 2017, 11:51:00 AM

There are such KVM (keyboard video mouse) devices that can do that. But they are expensive.
Alternatively there are Mobos with BMC (Baseboard Management Controller) from Supermicro for example.

They all communicate via IPMI

Google all of these keywords - and you'll find what's best in your case

Thank you for your advice.
This should work regardless of what I am mining right? Ranging from BTC to XMR.

vacarosie200

newbie

Activity: 45

Merit: 0

Quote from: cryptorious on December 30, 2017, 06:39:24 PM

If it's just the miner thats crashing (and you're running windows) make a mine.bat file like this

:start
ethminer.exe -whatever -parameters
goto start

Run mine.bat from cmd

Or in Linux make mine.sh file

while true; do
whatevercommandtostartminer
done

then from shell, chmod 755 mine.sh
and then from shell execute ./mine.sh

this is not work all the time ... you could get force restart button in win ... so the rig will wait for you to press the button Cheesy

i get this with -f switch

cryptorious

newbie

Activity: 13

Merit: 0

If it's just the miner thats crashing (and you're running windows) make a mine.bat file like this

:start
ethminer.exe -whatever -parameters
goto start

Run mine.bat from cmd

Or in Linux make mine.sh file

while true; do
whatevercommandtostartminer
done

then from shell, chmod 755 mine.sh
and then from shell execute ./mine.sh

vacarosie200

newbie

Activity: 45

Merit: 0

https://www.youtube.com/watch?v=HRF_U9njGs8

symple sms to the unit to be restarted

Topic: Remotly restart mining whenever GPUs crashing (Read 449 times)