MUMBAI, India, Nov. 2 -- Intellectual Property India has published a patent application (202617096580 A) filed by Gdm Holding LLC on August 10, 2026, for Training Neural Networks Using Weight Norm Regularizations.
Inventor includes Brock, Andrew.
The application for the patent was published on October 30, 2026, under issue no. 44/2026.
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network. One of the methods includes, for a weight tensor that includes weights of the neural network: performing, using a plurality of training examples, a training step to obtain respective gradients of a loss function with respect to the weights in the weight tensor; applying an optimizer to the respective gradients to generate respective gradient-based updates to the weights in the weight tensor; applying the respective gradient-based updates to the weights in the weight tensor to generate initial updated values of the weights in the weight tensor; scaling the initial updated values of the weights in the weight tensor to generate scaled updated values that have a predetermined target norm; and setting current values of the weights in the weight tensor for a next training step to be equal to the scaled updated values.
Disclaimer: Curated by HT Syndication.
