Generative Expansion of Small Datasets: An Expansive Graph Approach
cs.LG, cs.CV, eess.IV
Submitted: 2024-06-25
Updated: 2024-10-01
Comments: 5 pages, 3 figures and 2 tables. Under review in ICASSP 2025
Journal ref: 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1-5
DOI: 10.1109/ICASSP49660.2025.10887596
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Limited data availability in machine learning significantly impacts performance and generalization.
Terminology
Abstract
Limited data availability in machine learning significantly impacts performance and generalization. Traditional augmentation methods enhance moderately sufficient datasets. GANs struggle with convergence when generating diverse samples. Diffusion models, while effective, have high computational costs. We introduce an Expansive Synthesis model generating large-scale, information-rich datasets from minimal samples. It uses expander graph mappings and feature interpolation to preserve data distribution and feature relationships. The model leverages neural networks' non-linear latent space, captured by a Koopman operator, to create a linear feature space for dataset expansion. An autoencoder with self-attention layers and optimal transport refines distributional consistency. We validate by comparing classifiers trained on generated data to those trained on original datasets. Results show comparable performance, demonstrating the model's potential to augment training data effectively. This work advances data generation, addressing scarcity in machine learning applications.
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks