Monitoring Resource Usage

If you have jobs running and want to see how much resources your job is taking, while running, you can add these two statements to your PBS script

top -d 30.00 -b -u -M > top.output.$HOSTNAME.txt &
nvidia-smi --loop=30 -a --display=utilization > nvidia.smi.output.$HOSTNAME.txt &


On top you can specify a loop count with -n listing how many times you want to run the loop, after that it quits nvidia-smi you'd probably have to kill the process at some point because it loops indefinitely until ctrl-c is triggered

Copyright © 2016 MASSIVE. All Rights Reserved.