The Neural Autoregressive Distribution Estimator
Why is this work in the frame?
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
No Canadian affiliation. An affiliation-only frame — the usual design — would never have seen this work. It is one of the works that make the case for inverting the frame.
Machine scores (provisional)
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
- Teacher spread
- 0.182 · how far apart the two teachers sit on this one work
- Validation status
score_only:v0-immature-baseline· verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it
Abstract
We describe a new approach for modeling the distribution of high-dimensional vectors of dis-crete variables. This model is inspired by the restricted Boltzmann machine (RBM), which has been shown to be a powerful model of such distributions. However, an RBM typi-cally does not provide a tractable distribution estimator, since evaluating the probability it assigns to some given observation requires the computation of the so-called partition func-tion, which itself is intractable for RBMs of even moderate size. Our model circumvents this difficulty by decomposing the joint dis-tribution of observations into tractable condi-tional distributions and modeling each condi-tional using a non-linear function similar to a conditional of an RBM. Our model can also be interpreted as an autoencoder wired such that its output can be used to assign valid probabilities to observations. We show that this new model outperforms other multivari-ate binary distribution estimators on several datasets and performs similarly to a large (but intractable) RBM. 1
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
The record
- Venue
- Edinburgh Research Explorer (University of Edinburgh)
- Topic
- Generative Adversarial Networks and Image Synthesis
- Field
- Computer Science
- Canadian institutions
- —
- Funders
- Natural Sciences and Engineering Research Council of Canada
- Keywords
- EstimatorAutoregressive modelConditional probability distributionJoint probability distributionAutoencoderRestricted Boltzmann machineComputer scienceBoltzmann machineMarginal distributionProbability distributionMathematicsApplied mathematicsAlgorithmArtificial intelligenceArtificial neural networkStatisticsRandom variable
- Has abstract in OpenAlex
- yes