Logging system metrics during training can reveal:
Select an answer to reveal the explanation.
Short Explanation
System metrics show if GPUs are idle or memory-bound during training.
Full Explanation
Perf debugging needs system + model metrics.
Select an answer to reveal the explanation.
System metrics show if GPUs are idle or memory-bound during training.
Perf debugging needs system + model metrics.