From the source
Tencent presents GradLoc, a white-box diagnostic tool for localizing gradient spikes to specific culprit tokens in RLVR training, and proposes LayerClip for layerwise gradient clipping to improve training stability.
Stabilizing RLVR via Token-level Gradient Diagnosis and Layerwise Clipping
Research paper
From the source
We introduce GradLoc, an infrastructure tool
hunyuan.tencent.com
