Multi-sample $$\zeta $$-mixup: richer, more realistic synthetic samples from a p-series interpolant

Abstract Modern deep learning training procedures rely on model regularization techniques such as data augmentation methods, which generate training samples that increase the diversity of data and richness of label information. A popular recent method,mixup, uses convex combinations of pairs of original samples to generate new samples. However, as we show in our experiments,mixup can produce undesirable synthetic samples, where the data is sampled off the manifold and can contain incorrect labels. We propose $$\zeta $$ ζ -mixup, a generalization ofmixup with provably and demonstrably desirable properties that allows convex combinations of $${T} \ge 2$$ T≥2 samples, leading to more realistic and diverse outputs that incorporate information from $${T}$$ T original samples by using ap-series interpolant. We show that, compared tomixup, $$\zeta $$ ζ -mixup better preserves the intrinsic dimensionality of the original datasets, which is a desirable property for training generalizable models. Furthermore, we show that our implementation of $$\zeta $$ ζ -mixup is faster thanmixup, and extensive evaluation on controlled synthetic and 26 diverse real-world natural and medical image classification datasets shows that $$\zeta $$ ζ -mixup outperformsmixup, CutMix, and traditional data augmentation techniques. The code will be released at https://github.com/kakumarabhishek/zeta-mixup .

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.