Topic: [ mining os ] nvoc - page 243. (Read 418546 times)

01:00.0 VGA compatible controller: NVIDIA Corporation Device 1b81 (rev a1)
04:00.0 VGA compatible controller: NVIDIA Corporation Device 1b81 (rev a1)
05:00.0 VGA compatible controller: NVIDIA Corporation Device 1b81 (rev a1)
06:00.0 VGA compatible controller: NVIDIA Corporation Device 1b81 (rev a1)


Mon Sep  4 14:47:36 2017       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 384.59                 Driver Version: 384.59                    |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 1070    Off  | 00000000:01:00.0  On |                  N/A |
| 50%   55C    P0    44W / 135W |    196MiB /  8113MiB |     21%      Default |
+-------------------------------+----------------------+----------------------+
|   1  GeForce GTX 1070    Off  | 00000000:04:00.0 Off |                  N/A |
| 50%   58C    P0    48W / 135W |     19MiB /  8114MiB |      8%      Default |
+-------------------------------+----------------------+----------------------+
|   2  GeForce GTX 1070    Off  | 00000000:05:00.0 Off |                  N/A |
| 50%   52C    P0    44W / 135W |     19MiB /  8114MiB |     17%      Default |
+-------------------------------+----------------------+----------------------+
|   3  GeForce GTX 1070    Off  | 00000000:06:00.0 Off |                  N/A |
| 50%   49C    P0    51W / 135W |     19MiB /  8114MiB |      9%      Default |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID  Type  Process name                               Usage      |
|=============================================================================|
|    0      1067    G   /usr/lib/xorg/Xorg                             149MiB |
|    0      1614    G   compiz                                          43MiB |
|    1      1067    G   /usr/lib/xorg/Xorg                               7MiB |
|    2      1067    G   /usr/lib/xorg/Xorg                               7MiB |
|    3      1067    G   /usr/lib/xorg/Xorg                               7MiB |
+-----------------------------------------------------------------------------+

Power limit for GPU 00000000:01:00.0 was set to 135.00 W from 135.00 W.

Warning: persistence mode is disabled on this device. This settings will go back to default as soon as driver unloads (e.g. last application like nvidia-smi or cuda application terminates). Run with [--help | -h] switch to get more information on how to enable persistence mode.

Power limit for GPU 00000000:04:00.0 was set to 135.00 W from 135.00 W.

Warning: persistence mode is disabled on this device. This settings will go back to default as soon as driver unloads (e.g. last application like nvidia-smi or cuda application terminates). Run with [--help | -h] switch to get more information on how to enable persistence mode.

Power limit for GPU 00000000:05:00.0 was set to 135.00 W from 135.00 W.

Warning: persistence mode is disabled on this device. This settings will go back to default as soon as driver unloads (e.g. last application like nvidia-smi or cuda application terminates). Run with [--help | -h] switch to get more information on how to enable persistence mode.

Power limit for GPU 00000000:06:00.0 was set to 135.00 W from 135.00 W.

Warning: persistence mode is disabled on this device. This settings will go back to default as soon as driver unloads (e.g. last application like nvidia-smi or cuda application terminates). Run with [--help | -h] switch to get more information on how to enable persistence mode.

All done.

LAUNCHING:  IAmNotAJeep_and_Maxximus007_WATCHDOG

LAUNCHING:  Maxximus007_AUTO_TEMPERATURE_CONTROL

process in screen temp; attach with: screen -r temp


  Attribute 'GPUGraphicsClockOffset' (m1-desktop:0[gpu:0]) assigned value 100.


  Attribute 'GPUMemoryTransferRateOffset' (m1-desktop:0[gpu:0]) assigned value 850.


  Attribute 'GPUGraphicsClockOffset' (m1-desktop:0[gpu:1]) assigned value 100.


  Attribute 'GPUMemoryTransferRateOffset' (m1-desktop:0[gpu:1]) assigned value 850.


  Attribute 'GPUGraphicsClockOffset' (m1-desktop:0[gpu:2]) assigned value 100.


  Attribute 'GPUMemoryTransferRateOffset' (m1-desktop:0[gpu:2]) assigned value 850.


  Attribute 'GPUGraphicsClockOffset' (m1-desktop:0[gpu:3]) assigned value 100.


  Attribute 'GPUMemoryTransferRateOffset' (m1-desktop:0[gpu:3]) assigned value 850.


LAUNCHING:  Mining Process

process in screen miner; attach with: screen -r miner

^R

COIN="MPH_EQUIHASH"

MPH_WORKER="$WORKERNAME"
MPH_ADDRESS="papampi"
MPH_EQUIHASH_POOL="us-east.equihash-hub.miningpoolhub.com"
MPH_EQUIHASH_PORT="17023"

if [ $COIN == "MPH_EQUIHASH" ]
then

if [ $EWBF_VERSION == "3_3" ]
then
HCD='/home/m1/zec/v3_3/miner'
fi

if [ $EWBF_VERSION == "3_4" ]
then
HCD='/home/m1/zec/v3_4/miner'
fi

MPHADDR="$MPH_USERNAME.$MPH_WORKER"

screen -dmS miner $HCD --eexit 3 --fee $EWBF_PERCENT --pec --server $MPH_EQUIHASH_POOL --user $MPHADDR --pass z --port $MPH_EQUIHASH_PORT --api 0.0.0.0:42000  --log 2 --logfile ewbf.log;

if [ $LOCALorREMOTE == "LOCAL" ]
then
screen -r miner
fi

BITCOIN="theGROUND"

while [ $BITCOIN == "theGROUND" ]
do
sleep 60
done
fi

COIN="ZPOOL_EQUIHASH"

# ZPOOL uses your BTC_ADDRESS
ZPOOL_EQUIHASH_POOL="equihash.mine.zpool.ca"
ZPOOL_EQUIHASH_PORT="2142"

if [ $COIN == "ZPOOL_EQUIHASH" ]
then

if [ $EWBF_VERSION == "3_3" ]
then
HCD='/home/m1/zec/v3_3/miner'
fi

if [ $EWBF_VERSION == "3_4" ]
then
HCD='/home/m1/zec/v3_4/miner'
fi

ZPOOLADDR="$BTC_ADDRESS.$WORKERNAME"

screen -dmS miner $HCD --eexit 3 --fee $EWBF_PERCENT --pec --server $ZPOOL_EQUIHASH_POOL --user $ZPOOLADDR --pass c=btc --port $ZPOOL_EQUIHASH_PORT --api 0.0.0.0:42000  --log 2 --logfile ewbf.log;

if [ $LOCALorREMOTE == "LOCAL" ]
then
screen -r miner
fi

#!/bin/bash
# Telegram Info Script
# By BaliMiner et al...
# for nvOC by fullzero
# ref: http://bernaerts.dyndns.org/linux/75-debian/351-debian-send-telegram-notification
#

source ~/1bash

CHATID=$TELEGRAM_CHATID
APIKEY=$TELEGRAM_ALERT_APIKEY

SYSTEM_BOOT_TIME=$(uptime -s)
GPU_COUNT=$(nvidia-smi -L | tail -n 1| cut -c 5 |awk '{ SUM += $1+1}  ; { print SUM }')
STARTING_MINER=$(tail -n50 /home/m1/5_restartlog | grep Starting | tail -n 1)
LOST_GPU=$(tail -n50 /home/m1/5_restartlog | grep Lost| tail -n 1)
REBOOT_ALERT=$(tail -n50 /home/m1/5_restartlog | grep 'reboot in' |tail -n 1)
UTILIZATION_LOW_REBOOTING=$(tail -n50 /home/m1/5_restartlog | grep 'low: reviving' |tail -n 1)
UTILIZATION_LOW_RESTART_3MAIN=$(tail -n50 /home/m1/5_restartlog | grep 'low: restart' |tail -n 1)
LOW_UTILIZATION=$(tail -n50 /home/m1/5_restartlog | grep 'Low Utilization' |tail -n 1)
FAILURES_REINIT=$(tail -n50 /home/m1/5_restartlog | grep 'Before reinit')



SYSTEM_UP_TIME=$(uptime -p)
REBOOT_REQUIRED=$(/home/m1/reboot-required)
GPU_UTILIZATIONS=$(tail -n 30 5_restartlog | grep 'GPU UTILIZATION' | awk '{gsub(/GPU UTILIZATION:  /,"")}1' | tail -n 1)


TEMP=$(/usr/bin/nvidia-smi --query-gpu=temperature.gpu --format=csv,noheader)
PD=$(/usr/bin/nvidia-smi --query-gpu=power.draw --format=csv,noheader)
FAN=$(/usr/bin/nvidia-smi --query-gpu=fan.speed --format=csv,noheader)
TEMP_FAN_POWER=$(tail  -n 30 6_autotemplog  | grep GPU | awk '{gsub(/:/,": ")}1' |tail -n $GPU_COUNT)


LF=$'\n'


MSG=" Worker: $WORKERNAME
Boot Time: $SYSTEM_BOOT_TIME
GPU Count: $GPU_COUNT
GPU Utilization:
$GPU_UTILIZATIONS
$STARTING_MINER
$LOW_UTILIZATION
$FAILURES_REINIT
$UTILIZATION_LOW_RESTART_3MAIN
$LOST_GPU
$REBOOT_ALERT
$UTILIZATION_LOW_REBOOTING
"

/usr/bin/curl -m 5 -s -X POST --output /dev/null https://api.telegram.org/bot${APIKEY}/sendMessage -d "text=${MSG}" -d chat_id=${CHATID}

   TELEGRAM_ALERT_APIKEY="aaaaaaaaaaaaaaaaaaa:bbbbbbbbbbbb-cccccccccccccccccccccccc"

#!/bin/bash

# Miner restart script V002
# By Maxximus007 && IAmNotAJeep
# for nvOC by fullzero
# Modified by papampi for telegram-alerts

export DISPLAY=:0

# Creating a log file to record restarts
LOG_FILE="/home/m1/5_restartlog"
if [ -e "$LOG_FILE" ] ; then
  #Limit the logfile, just keep the last 2K
  LASTLOG=$(tail -n 2K $LOG_FILE)
  echo $LASTLOG
  echo ""
fi

echo "$(date) - Starting miner restart script." | tee -a ${LOG_FILE}
echo "" | tee -a ${LOG_FILE}
bash '/home/m1/telegram-alert'
# Give oneBash time to start to prevent reboot
echo "$(date) - waiting 70 seconds before going 'on watch'" | tee -a ${LOG_FILE}
sleep 60

THRESHOLD=90
RESTART=0
GPU_COUNT=$(nvidia-smi --query-gpu=count --format=csv,noheader,nounits | tail -1)
COUNT=$((6 * $GPU_COUNT))

while true
do
sleep 10  # sleep 60
#IAmNotAJeep MOD from V002
  JEEP=0
#IAmNotAJeep MOD from V002
  GPU=0
  REBOOTRESET=$(($REBOOTRESET + 1))

#IAmNotAJeep MOD from V002
  echo ""
  echo "      GPU_COUNT: " $GPU_COUNT | tee -a ${LOG_FILE}

#IAmNotAJeep MOD from V002

  UTILIZATIONS=$(nvidia-smi --query-gpu=utilization.gpu --format=csv,noheader,nounits)
  echo ""
  echo "GPU UTILIZATION: " $UTILIZATIONS | tee -a ${LOG_FILE}
  echo "" | tee -a ${LOG_FILE}




numtest='^[0-9]+$'
  
  for UTIL in $UTILIZATIONS
  do
    if ! [[ $UTIL =~ $numtest ]]
    then
        # Not numeric so: Help we've lost a GPU, so reboot
        echo "$(date) - Lost GPU so restarting system. Found GPU's:" | tee -a ${LOG_FILE}
        echo "" | tee -a ${LOG_FILE}
bash '/home/m1/telegram-alert'
        #Hope PCI BUS info will help find the faulty GPU
        nvidia-smi --query-gpu=gpu_bus_id --format=csv | tee -a ${LOG_FILE}
        echo "reboot in 10 seconds" | tee -a ${LOG_FILE}
        echo ""| tee -a ${LOG_FILE}
bash '/home/m1/telegram-alert'
        sleep 10
        sudo reboot
    fi

    # If utilization is lower than threshold count them:
    if [ $UTIL -lt $THRESHOLD ]
    then
      echo "$(date) - GPU under threshold found" | tee -a ${LOG_FILE}
      echo "" | tee -a ${LOG_FILE}
bash '/home/m1/telegram-alert'
      COUNT=$(($COUNT - 1))
      #IAmNotAJeep MOD from V002
      JEEP=$(($JEEP + 1))
      #IAmNotAJeep MOD from V002
    fi
    GPU=$(($GPU + 1))
  done

#IAmNotAJeep MOD from V002
if [ $JEEP -gt 0 ]
 then

  if [ $COUNT -le 0 ]
  then
    INTERNET_IS_GO=0
    if nc -vzw1 google.com 443;
    #if nc -vzw1 $POOL 80;
    then
    INTERNET_IS_GO=1
    fi
    echo ""
    if [[ $RESTART -gt 4 && $INTERNET_IS_GO == 1 ]]
    then
      echo "$(date) - Utilization is too low: reviving did not work so restarting system in 10 seconds" | tee -a ${LOG_FILE}
      echo "" | tee -a ${LOG_FILE}
 bash '/home/m1/telegram-alert'
      sleep 10
      sudo reboot
    fi
    echo "$(date) - Utilization is too low: restart 3main" | tee -a ${LOG_FILE}
    # If miner runs in screen 'miner' kill the screen to be sure it's gone
    pkill -e miner
bash '/home/m1/telegram-alert'
    # Best to restart oneBash - settings might be adjusted already
    target=$(ps -ef | awk '$NF~"3main" {print $2}')
    kill $target | tee -a ${LOG_FILE}
    echo "" | tee -a ${LOG_FILE}
    RESTART=$(($RESTART + 1))
    REBOOTRESET=0
    COUNT=$GPU_COUNT
    # Give oneBash time to restart to prevent reboot
    sleep 60
  #fi
  else
  echo "$(date) - Low Utilization Detected: 3main will reinit if there are 6 consecutive failures" | tee -a ${LOG_FILE}
  echo ""
  echo "                  "$COUNT "Failures Before reinit"  | tee -a ${LOG_FILE}
bash '/home/m1/telegram-alert'
#IAmNotAJeep MOD from V002
  fi

else
#IAmNotAJeep MOD from V002
  COUNT=$((6 * $GPU_COUNT))
  echo "$(date) - 5 by 5: REMEMBER TO THANK IAmNotAJeep and Maxximus007"
#IAmNotAJeep MOD from V002
fi

  # No need for a reboot after a while
  if [ $REBOOTRESET -gt 5 ]
  then
    RESTART=0
    REBOOTRESET=0
  fi
done

sudo apt install libutempter0