gpu

References

• GPU and NVIDIA Glossary, thanks to Modal.

nsys

nsys profile --trace=cuda,nvtx --gpu-metrics-devices=all <application>

--gpu-metrics-devices=all

• SM and warps usage
• NVLink Bandwidth (GPU-to-GPU communication, intra-node)
• PCIe Bandwidth (inter-node communication)