# weightnorm

**Repository Path**: mirrors_openai/weightnorm

## Basic Information

- **Project Name**: weightnorm
- **Description**: Example code for Weight Normalization, from "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"
- **Primary Language**: Unknown
- **License**: MIT
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2022-01-11
- **Last Updated**: 2026-02-08

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

**Status:** Archive (code is provided as-is, no updates expected)


# Weight Normalization

This repo contains example code for [Weight Normalization](https://arxiv.org/abs/1602.07868), as described in the following 
paper:

**Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks**, by
Tim Salimans, and Diederik P. Kingma.

- The folder 'lasagne' contains code using the Lasagne package for Theano. This code was used to run the CIFAR-10 experiments in the paper.
- The folder 'tensorflow' contains a single nn.py file with a direct implementation copied from our [PixelCNN++](https://github.com/openai/pixel-cnn) repository.
- The folder 'keras' contains example code for use with the Keras package.

## Citation

If you find this code useful please cite us in your work:

```
@inproceedings{Salimans2016WeightNorm,
  title={Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks},
  author={Tim Salimans and Diederik P. Kingma},
  booktitle={Neural Information Processing Systems 2016},
  year={2016}
}
```