cgmon - mining monitor for Linux - auto restart, reboot, sick gpu, ASIC, &more - page 2.

jdape

sr. member

Activity: 269

Merit: 250

Perhaps you can fix your X.org startup problem? Sounds like that would make it work reliably.

Coinstron

newbie

Activity: 6

Merit: 0

Quote from: jdape on March 16, 2014, 12:43:18 PM

Quote from: Coinstron on March 03, 2014, 02:26:43 PM

Hi! tnx for great script!
but it is very sad to see this on my rig at mornings

Quote

Mar 03 20:00:02 bamt-miner - cgmon 1.0.8 - sgminer running and all GPUs healthy.
Mar 03 20:02:01 bamt-miner - cgmon 1.0.8 - sgminer running and all GPUs healthy.
Mar 03 20:04:03 bamt-miner - cgmon 1.0.8 - sgminer running and all GPUs healthy.
Mar 03 20:06:11 bamt-miner - sgminer is not responding. Rebooting.
Mar 03 20:06:21 bamt-miner -
Mar 03 20:08:44 bamt-miner - sgminer not running, starting via this command:
Mar 03 20:08:44 bamt-miner - /opt/miners/sph-sgminer/sgminer --api-listen -c /opt/miners/sph-sgminer/sgminer.conf
Mar 03 20:08:45 bamt-miner - sgminer started successfully. Use 'screen -r' to attach to sgminer and Control-a-d to detach.
Mar 03 20:10:01 bamt-miner - sgminer not running, starting via this command:
Mar 03 20:10:01 bamt-miner - /opt/miners/sph-sgminer/sgminer --api-listen -c /opt/miners/sph-sgminer/sgminer.conf
Mar 03 20:10:02 bamt-miner - sgminer failed to start. Try running the mining command above to find the error. Also, double check your GPU options.
Mar 03 20:12:01 bamt-miner - sgminer not running, starting via this command:
Mar 03 20:12:01 bamt-miner - /opt/miners/sph-sgminer/sgminer --api-listen -c /opt/miners/sph-sgminer/sgminer.conf
Mar 03 20:12:02 bamt-miner - sgminer failed to start. Try running the mining command above to find the error. Also, double check your GPU options.
Mar 03 20:14:01 bamt-miner - sgminer not running, starting via this command:
Mar 03 20:14:01 bamt-miner - /opt/miners/sph-sgminer/sgminer --api-listen -c /opt/miners/sph-sgminer/sgminer.conf
Mar 03 20:14:02 bamt-miner - sgminer failed to start. Try running the mining command above to find the error. Also, double check your GPU options.

sometimes X is not starting after reboot and cgmon restart sgminer in endless cycle. maybe rebooting rig after N failed starts will be good solution?

I bet there's an error in your .conf file. What happens when you run the command manually?

Code:

/opt/miners/sph-sgminer/sgminer --api-listen   -c /opt/miners/sph-sgminer/sgminer.conf

Are you running as root or another user? Could also be a permissions issue. Either way, running it by hand should show the problem.

Hi!
.conf is ok, rig on default BAMT with another mining software (sgminer). Problem occurs when X.org does not start automatically (sometimes it happens) at boot (and AMD driver not working). You can try this sutuation. Sgminer exiting and return nothing. If X.org running, everything works well.

jdape

sr. member

Activity: 269

Merit: 250

Quote from: freskhu on April 13, 2014, 04:56:35 PM

is there any way to add a feature?
If the card's temp goes to specific temperature it stops mine for like 5 minutes than reboot! this can be turn on or off!

That would not be difficult to add. Perhaps a donation would provide some motivation to make it happen

freskhu

newbie

Activity: 62

Merit: 0

is there any way to add a feature?
If the card's temp goes to specific temperature it stops mine for like 5 minutes than reboot! this can be turn on or off!

jdape

sr. member

Activity: 269

Merit: 250

Quote from: bomberb17 on April 10, 2014, 12:46:48 AM

Quote from: jdape on April 09, 2014, 02:23:25 PM

Can you please paste the contents of /tmp/accepted_count

Code:

bomberb17@bomberb17-ltcminer:~$ cat /tmp/accepted_count
1127 1397104922
1151 1397104922
1146 1397104922

I have restarted my rig and now cgmon works ok again.
However I have seen cgminer hanging many times without cgmon catching it, and I suspect that this "bug" (which happens once in a while) is the reason.

Sounds like it. There's only so much we can do in this case. You could try running sgminer instead. It's a fork of later version of cgminer, with scrypt support.

jdape

sr. member

Activity: 269

Merit: 250

Quote from: ivanlabrie on April 10, 2014, 10:09:11 AM

Hi, do I need to add this to say BAMT/SMOS/NotSMOS 1.3 or PiMP to have the rig reboot when sick devices are found?

I haven't used those, but I believe so.

ivanlabrie

hero member

Activity: 812

Merit: 1000

Hi, do I need to add this to say BAMT/SMOS/NotSMOS 1.3 or PiMP to have the rig reboot when sick devices are found?

freskhu

newbie

Activity: 62

Merit: 0

If i run the scrypt manually it works, but it wont do it alone! how to fix? Cheesy

freskhu

newbie

Activity: 62

Merit: 0

when running it manually:

http://prntscr.com/38nlyx

Ninja edit: this error i solved, in the path to log it misses a "/"

freskhu

newbie

Activity: 62

Merit: 0

Hi there,
I have this scrypt running on one rig and i am trying to put on the others.
I run them with bamt 1.3, when i first installed i had this error but i dont remember how i fix it!

i got this information on the log
http://prntscr.com/38nkfi

On the config file i have the right path:
http://prntscr.com/38nkt4

any help? Cheesy

bomberb17

hero member

Activity: 771

Merit: 528

Quote from: jdape on April 09, 2014, 02:23:25 PM

Can you please paste the contents of /tmp/accepted_count

Code:

bomberb17@bomberb17-ltcminer:~$ cat /tmp/accepted_count
1127 1397104922
1151 1397104922
1146 1397104922

I have restarted my rig and now cgmon works ok again.
However I have seen cgminer hanging many times without cgmon catching it, and I suspect that this "bug" (which happens once in a while) is the reason.

jdape

sr. member

Activity: 269

Merit: 250

Can you please paste the contents of /tmp/accepted_count

bomberb17

hero member

Activity: 771

Merit: 528

Quote from: bomberb17 on April 09, 2014, 03:50:40 AM

Quote from: jdape on April 08, 2014, 09:37:27 AM

Quote from: bomberb17 on April 08, 2014, 04:12:36 AM

When I manually run it, I don't receive any mail ( I have gmail).
Waiting to see if I receive when cgminer crashes..

Check your configuration options. This is the default:

Code:

# send email when running script by hand (no or yes)
set mail(notify_on_manual_runs) "no"

Yes I have that option enabled. Mail is coming when cgminer hangs though.
I also have another question: I added the line
*/2 * * * * root /home/user/cgmon.tcl >/dev/null 2>&1
in /etc/crontab as in the instruct.ons. While the script most of the time runs ok, I see that sometimes it does not. For example, this is the output of the log:

Code:

bomberb17@bomberb17-ltcminer:~$ tail -n 20 cgmon.log
Apr 09 02:42:02 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:44:02 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:46:02 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:48:01 bomberb17-ltcminer - GPU 0 Shares accepted since last run: 65 (5.43 shares/min)
Apr 09 02:48:01 bomberb17-ltcminer - GPU 1 Shares accepted since last run: 68 (5.68 shares/min)
Apr 09 02:48:01 bomberb17-ltcminer - GPU 2 Shares accepted since last run: 62 (5.18 shares/min)
Apr 09 02:48:01 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:50:01 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:52:02 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:54:01 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:56:01 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:58:01 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:00:02 bomberb17-ltcminer - GPU 0 no accepted shares in 721 seconds. GPU probably hung.
Apr 09 03:02:02 bomberb17-ltcminer - cgminer API is not enabled/responding. Restart cgminer with '--api-listen' or check the status of mining pools.
Apr 09 03:04:04 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:06:03 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:08:04 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:10:04 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:12:03 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:14:03 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.

And I received the email on 03.00am.
While it restarted my computer and cgminer continued to run fine, the script stopped running every 2 minutes for some reason. I tried adding the line also in crontab -e but nothing changed.
Any ideas?
My os is Xubuntu 12.10

See this also

Code:

bomberb17@bomberb17-ltcminer:~$ ./cgmon.tcl
invalid bareword "exited"
in expression "229 - exited";
should be "$exited" or "{exited}" or "exited(...)" or ...
(parsing expression "229 - exited")
invoked from within
"expr $current_accepted($n) - $previous_accepted($n)"
(procedure "check_status" line 197)
invoked from within
"check_status"
(file "./cgmon.tcl" line 602)

bomberb17

hero member

Activity: 771

Merit: 528

Quote from: jdape on April 08, 2014, 09:37:27 AM

Quote from: bomberb17 on April 08, 2014, 04:12:36 AM

When I manually run it, I don't receive any mail ( I have gmail).
Waiting to see if I receive when cgminer crashes..

Check your configuration options. This is the default:

Code:

# send email when running script by hand (no or yes)
set mail(notify_on_manual_runs) "no"

Yes I have that option enabled. Mail is coming when cgminer hangs though.
I also have another question: I added the line
*/2 * * * * root /home/user/cgmon.tcl >/dev/null 2>&1
in /etc/crontab as in the instruct.ons. While the script most of the time runs ok, I see that sometimes it does not. For example, this is the output of the log:

Code:

bomberb17@bomberb17-ltcminer:~$ tail -n 20 cgmon.log
Apr 09 02:42:02 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:44:02 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:46:02 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:48:01 bomberb17-ltcminer - GPU 0 Shares accepted since last run: 65 (5.43 shares/min)
Apr 09 02:48:01 bomberb17-ltcminer - GPU 1 Shares accepted since last run: 68 (5.68 shares/min)
Apr 09 02:48:01 bomberb17-ltcminer - GPU 2 Shares accepted since last run: 62 (5.18 shares/min)
Apr 09 02:48:01 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:50:01 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:52:02 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:54:01 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:56:01 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 02:58:01 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:00:02 bomberb17-ltcminer - GPU 0 no accepted shares in 721 seconds. GPU probably hung.
Apr 09 03:02:02 bomberb17-ltcminer - cgminer API is not enabled/responding. Restart cgminer with '--api-listen' or check the status of mining pools.
Apr 09 03:04:04 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:06:03 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:08:04 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:10:04 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:12:03 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.
Apr 09 03:14:03 bomberb17-ltcminer - cgmon 1.0.8 - cgminer running and all GPUs healthy.

And I received the email on 03.00am.
While it restarted my computer and cgminer continued to run fine, the script stopped running every 2 minutes for some reason. I tried adding the line also in crontab -e but nothing changed.
Any ideas?
My os is Xubuntu 12.10

jdape

sr. member

Activity: 269

Merit: 250

Quote from: whitetoo on April 08, 2014, 10:15:14 AM

Thanks for the advice jdape. Will look into the SSL option.
Noted on the gpu engine clock, sometimes the gpus can run for 48hours+ and be absolutely fine and other times they will run for an hour. Frustrating as they appear to be stable and then throw a curveball.

Now that spring is here - I notice if certain windows are closed vs opened, that makes the difference between stability and constant hangs. Will have to power down (depending on price) or break out the AC units soon!

whitetoo

sr. member

Activity: 588

Merit: 251

Thanks for the advice jdape. Will look into the SSL option.
Noted on the gpu engine clock, sometimes the gpus can run for 48hours+ and be absolutely fine and other times they will run for an hour. Frustrating as they appear to be stable and then throw a curveball.

jdape

sr. member

Activity: 269

Merit: 250

Quote from: whitetoo on April 08, 2014, 05:30:08 AM

Just been testing this script for the past 24 hours! It's caught 3 SICK GPUs so far and solved with an automatic reboot. Thank you to the developers, no more midnight panics!

I did have one question, when the system is told to reboot, cgmon starts cgminer in the background. I then have to open the terminal and type "screen -r" to see the readout from the miners. Is it possible to have this happen automatically following an auto-reboot? Thank you

So you're saying you want to see your miner in a terminal window after a reboot? Hmm... I'm sure that's possible but it would involve ugly hacks and wouldn't work reliably. I think you'll have to type screen -r as needed for now. That being said - you can use any computer to SSH (remotely login) into your miner computer and then type screen -r. You don't have to physically go to your miner and pull it up on the big screen. For example, I can open five terminal windows on my laptop, each with an SSH session to a miner and see all five at once from anywhere.

When I get sick gpu's over and over, I lower the clock speed (gpu-engine) by 10 and start it again. Repeat until card is stable.

jdape

sr. member

Activity: 269

Merit: 250

Quote from: bomberb17 on April 08, 2014, 04:12:36 AM

When I manually run it, I don't receive any mail ( I have gmail).
Waiting to see if I receive when cgminer crashes..

Check your configuration options. This is the default:

Code:

# send email when running script by hand (no or yes)
set mail(notify_on_manual_runs) "no"

whitetoo

sr. member

Activity: 588

Merit: 251

Just been testing this script for the past 24 hours! It's caught 3 SICK GPUs so far and solved with an automatic reboot. Thank you to the developers, no more midnight panics!

I did have one question, when the system is told to reboot, cgmon starts cgminer in the background. I then have to open the terminal and type "screen -r" to see the readout from the miners. Is it possible to have this happen automatically following an auto-reboot? Thank you

bomberb17

hero member

Activity: 771

Merit: 528

When I manually run it, I don't receive any mail ( I have gmail).
Waiting to see if I receive when cgminer crashes..

Topic: cgmon - mining monitor for Linux - auto restart, reboot, sick gpu, ASIC, &more - page 2. (Read 48219 times)