BART: Bayesian additive regression trees
Why is this work in the frame?
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
No Canadian affiliation. An affiliation-only frame — the usual design — would never have seen this work. It is one of the works that make the case for inverting the frame.
Abstract
We develop a Bayesian “sum-of-trees” model where each tree is constrained by a regularization prior to be a weak learner, and fitting and inference are accomplished via an iterative Bayesian backfitting MCMC algorithm that generates samples from a posterior. Effectively, BART is a nonparametric Bayesian regression approach which uses dimensionally adaptive random basis elements. Motivated by ensemble methods in general, and boosting algorithms in particular, BART is defined by a statistical model: a prior and a likelihood. This approach enables full posterior inference including point and interval estimates of the unknown regression function as well as the marginal effects of potential predictors. By keeping track of predictor inclusion frequencies, BART can also be used for model-free variable selection. BART’s many features are illustrated with a bake-off against competing methods on 42 different data sets, with a simulation experiment and on a drug discovery classification problem.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
The record
- Venue
- The Annals of Applied Statistics
- Topic
- Statistical Methods and Inference
- Field
- Mathematics
- Canadian institutions
- —
- Funders
- Division of Mathematical SciencesNatural Sciences and Engineering Research Council of CanadaIsaac Newton Institute for Mathematical SciencesNational Science Foundation
- Keywords
- Frequentist inferenceBayesian probabilityNonparametric regressionBayesian inferenceBayesian linear regressionMarkov chain Monte CarloBoosting (machine learning)Feature selectionInferenceBayesian average
- Has abstract in OpenAlex
- yes