If you are running a GPU job on Lisa and you want to know how your application is using resources. You can make use of the tool nvtop.
This source of the tool that can be found here: https://github.com/Syllo/nvtop
Step-by-step guide
- submit your GPU job
- login to the node where your job is running by using slurm_joblogin
- start monitoring by enter command: nvtop at the prompt.
Below you see a example output generated by the tool.