Clip
Gradient clipping utilities.
| Function | Description |
|---|---|
gradNorm maxNorm vars | Clip gradients by global L2 norm. Return the total norm before clipping. |
gradValue value vars | Clip each gradient element to [-value, +value]. |
gradNorm
gradNorm maxNorm varsClip gradients by global L2 norm. Return the total norm before clipping.
Parameters
maxNorm:floatvars:Tensor list
Returns float
gradValue
gradValue value varsClip each gradient element to [-value, +value].
Parameters
value:floatvars:Tensor list