Rectified Linear Units Improve Restricted Boltzmann Machines
Why is this work in the frame?
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Abstract
Restricted Boltzmann machines were developed using binary stochastic hidden units. These can be generalized by replacing each binary unit by an infinite number of copies that all have the same weights but have progressively more negative biases. The learning and inference rules for these Stepped Sigmoid Units are unchanged. They can be approximated efficiently by noisy, rectified linear units. Compared with binary units, these units learn features that are better for object recognition on the NORB dataset and face verification on the Labeled Faces in the Wild dataset. Unlike binary units, rectified linear units preserve information about relative intensities as information travels through multiple layers of feature detectors.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
The record
- Venue
- International Conference on Machine Learning
- Topic
- Generative Adversarial Networks and Image Synthesis
- Field
- Computer Science
- Canadian institutions
- University of Toronto
- Funders
- —
- Keywords
- Boltzmann machineBinary numberSigmoid functionComputer scienceObject (grammar)Restricted Boltzmann machineArtificial intelligenceInferencePattern recognition (psychology)Feature (linguistics)Cognitive neuroscience of visual object recognitionAlgorithmMathematicsComputer visionDeep learningArithmeticArtificial neural network
- Has abstract in OpenAlex
- yes