Generalization Gap in Data Augmentation: Insights from Illumination
Jianqiang Xiao Weiwen Guo Junfeng Liu Mengze Li
In the field of computer vision, data augmentation is widely used to enrich
the feature complexity of training datasets with deep learning techniques.
However, regarding the generalization capabilities of models, the difference in
artificial features generated by data augmentation and natural visual features
has not been fully revealed. This study focuses on the visual representation
variable 'illumination', by simulating its distribution degradation and
examining how data augmentation techniques enhance model performance on a
classification task. Our goal is to investigate the differences in
generalization between models trained with augmented data and those trained
under real-world illumination conditions. Results indicate that after
undergoing various data augmentation methods, model performance has been
significantly improved. Yet, a noticeable generalization gap still exists after
utilizing various data augmentation methods, emphasizing the critical role of
feature diversity in the training set for enhancing model generalization.