English
Related papers

Related papers: Self-Evolution Learning for Mixup: Enhance Data Au…

200 papers

We propose a meta-learning method for semi-supervised learning that learns from multiple tasks with heterogeneous attribute spaces. The existing semi-supervised meta-learning methods assume that all tasks share the same attribute space,…

Machine Learning · Computer Science 2023-11-10 Tomoharu Iwata , Atsutoshi Kumagai

We introduce Learning to Self-Evolve (LSE), a reinforcement learning framework that trains large language models (LLMs) to improve their own contexts at test time. We situate LSE in the setting of test-time self-evolution, where a model…

Computation and Language · Computer Science 2026-03-20 Xiaoyin Chen , Canwen Xu , Yite Wang , Boyi Liu , Zhewei Yao , Yuxiong He

In this paper, we propose a novel framework that combines ensemble learning with augmented graph structures to improve the performance and robustness of semi-supervised node classification in graphs. By creating multiple augmented views of…

Machine Learning · Computer Science 2025-03-25 Maryam Abdolali , Romina Zakerian , Behnam Roshanfekr , Fardin Ayar , Mohammad Rahmati

In this paper, we present a simple and efficient method for training deep neural networks in a semi-supervised setting where only a small portion of training data is labeled. We introduce self-ensembling, where we form a consensus…

Neural and Evolutionary Computing · Computer Science 2017-03-16 Samuli Laine , Timo Aila

In recent years, various deep learning techniques have been exploited in side channel attacks, with the anticipation of obtaining more appreciable attack results. Most of them concentrate on improving network architectures or putting…

Cryptography and Security · Computer Science 2024-01-18 Zhimin Luo , Mengce Zheng , Ping Wang , Minhui Jin , Jiajia Zhang , Honggang Hu

Data augmentation is one of the most prevalent tools in deep learning, underpinning many recent advances, including those from classification, generative models, and representation learning. The standard approach to data augmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Brandon Trabucco , Kyle Doherty , Max Gurinas , Ruslan Salakhutdinov

Self-training is a simple yet effective method within semi-supervised learning. The idea is to iteratively enhance training data by adding pseudo-labeled data. Its generalization performance heavily depends on the selection of these…

Machine Learning · Statistics 2023-03-03 Julian Rodemann , Christoph Jansen , Georg Schollmeyer , Thomas Augustin

A common practice in unsupervised representation learning is to use labeled data to evaluate the quality of the learned representations. This supervised evaluation is then used to guide critical aspects of the training process such as…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Colorado J Reed , Sean Metzger , Aravind Srinivas , Trevor Darrell , Kurt Keutzer

Conventional semi-supervised contrastive learning methods assign pseudo-labels only to samples whose highest predicted class probability exceeds a predefined threshold, and then perform supervised contrastive learning using those selected…

Machine Learning · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

Dialogue generation models face the challenge of producing generic and repetitive responses. Unlike previous augmentation methods that mostly focus on token manipulation and ignore the essential variety within a single sample using hard…

Computation and Language · Computer Science 2021-03-03 Yu Cao , Liang Ding , Zhiliang Tian , Meng Fang

Manipulating data, such as weighting data examples or augmenting with new instances, has been increasingly used to improve model training. Previous work has studied various rule- or learning-based approaches designed for specific types of…

Machine Learning · Computer Science 2019-10-29 Zhiting Hu , Bowen Tan , Ruslan Salakhutdinov , Tom Mitchell , Eric P. Xing

Mixup, a simple data augmentation method that randomly mixes two data points via linear interpolation, has been extensively applied in various deep learning applications to gain better generalization. However, the theoretical underpinnings…

Machine Learning · Computer Science 2023-03-16 Difan Zou , Yuan Cao , Yuanzhi Li , Quanquan Gu

Labeling time series data is an expensive task because of domain expertise and dynamic nature of the data. Hence, we often have to deal with limited labeled data settings. Data augmentation techniques have been successfully deployed in…

Machine Learning · Computer Science 2023-04-11 Karan Aggarwal , Jaideep Srivastava

This paper proposes AEDA (An Easier Data Augmentation) technique to help improve the performance on text classification tasks. AEDA includes only random insertion of punctuation marks into the original text. This is an easier technique to…

Computation and Language · Computer Science 2021-08-31 Akbar Karimi , Leonardo Rossi , Andrea Prati

Semi-supervised text classification (SSTC) has gained increasing attention due to its ability to leverage unlabeled data. However, existing approaches based on pseudo-labeling suffer from the issues of pseudo-label bias and error…

Computation and Language · Computer Science 2023-10-24 Henry Peng Zou , Cornelia Caragea

Introducing training-time augmentations is a key technique to enhance generalization and prepare deep neural networks against test-time corruptions. Inspired by the success of generative diffusion models, we propose a novel approach of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Markus Heinonen , Ba-Hien Tran , Michael Kampffmeyer , Maurizio Filippone

Text embeddings, i.e. vector representations of entire texts, play an important role in many NLP applications, such as retrieval-augmented generation, clustering, or visualizing collections of texts for data exploration. Currently,…

Computation and Language · Computer Science 2026-03-17 Rita González-Márquez , Philipp Berens , Dmitry Kobak

In the context of continual learning, acquiring new knowledge while maintaining previous knowledge presents a significant challenge. Existing methods often use experience replay techniques that store a small portion of previous task data…

Machine Learning · Computer Science 2025-12-24 Minsu Kim , Seong-Hyeon Hwang , Steven Euijong Whang

Data analysis and machine learning are of preeminent importance in the legal domain, especially in tasks like clustering and text classification. In this study, we harnessed the power of natural language processing tools to enhance datasets…

Computation and Language · Computer Science 2024-04-16 Lucas José Gonçalves Freitas , Thaís Rodrigues , Guilherme Rodrigues , Pamella Edokawa , Ariane Farias

The major challenge of learning from multi-label data has arisen from the overwhelming size of label space which makes this problem NP-hard. This problem can be alleviated by gradually involving easy to hard tags into the learning process.…

Machine Learning · Computer Science 2019-10-09 Seyed Amjad Seyedi , S. Siamak Ghodsi , Fardin Akhlaghian , Mahdi Jalili , Parham Moradi