English
Related papers

Related papers: Human-in-the-Loop Mixup

200 papers

Machine learning techniques are used in a wide range of domains. However, machine learning models often suffer from the problem of over-fitting. Many data augmentation methods have been proposed to tackle such a problem, and one of them is…

Machine Learning · Statistics 2021-06-21 Masanari Kimura

Deep generative models have shown impressive results in text-to-image synthesis. However, current text-to-image models often generate images that are inadequately aligned with text prompts. We propose a fine-tuning method for aligning such…

This research explores a hybrid approach to fine-tuning large language models (LLMs) by integrating real-world and synthetic data to boost model performance, particularly in generating accurate and contextually relevant responses. By…

Computation and Language · Computer Science 2024-10-15 Alexey Zhezherau , Alexei Yanockin

The LLM-as-a-judge paradigm enables flexible, user-defined evaluation, but its effectiveness is often limited by the scarcity of diverse, representative data for refining criteria. We present a tool that integrates synthetic data generation…

Human-Computer Interaction · Computer Science 2025-11-07 Hyo Jin Do , Zahra Ashktorab , Jasmina Gajcin , Erik Miehling , Martín Santillán Cooper , Qian Pan , Elizabeth M. Daly , Werner Geyer

Mixup is a popular data augmentation technique for training deep neural networks where additional samples are generated by linearly interpolating pairs of inputs and their labels. This technique is known to improve the generalization…

Machine Learning · Computer Science 2023-10-17 Yingtian Zou , Vikas Verma , Sarthak Mittal , Wai Hoh Tang , Hieu Pham , Juho Kannala , Yoshua Bengio , Arno Solin , Kenji Kawaguchi

Data augmentation techniques apply transformations to existing texts to generate additional data. The transformations may produce low-quality texts, where the meaning of the text is changed and the text may even be mangled beyond human…

Human-Computer Interaction · Computer Science 2024-04-30 Hong Jin Kang , Fabrice Harel-Canada , Muhammad Ali Gulzar , Violet Peng , Miryung Kim

This paper introduces HuLP, a Human-in-the-Loop for Prognosis model designed to enhance the reliability and interpretability of prognostic models in clinical contexts, especially when faced with the complexities of missing covariates and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Muhammad Ridzuan , Mai Kassem , Numan Saeed , Ikboljon Sobirov , Mohammad Yaqub

Large deep neural networks are powerful, but exhibit undesirable behaviors such as memorization and sensitivity to adversarial examples. In this work, we propose mixup, a simple learning principle to alleviate these issues. In essence,…

Machine Learning · Computer Science 2018-05-01 Hongyi Zhang , Moustapha Cisse , Yann N. Dauphin , David Lopez-Paz

Learning from human feedback has enabled the alignment of language models (LMs) with human preferences. However, collecting human preferences is expensive and time-consuming, with highly variable annotation quality. An appealing alternative…

In recent years, mixup regularization has gained popularity as an effective way to improve the generalization performance of deep learning models by training on convex combinations of training data. While many mixup variants have been…

Machine Learning · Computer Science 2025-06-16 Yousef El-Laham , Niccolò Dalmasso , Svitlana Vyetrenko , Vamsi K. Potluru , Manuela Veloso

We often desire our models to be interpretable as well as accurate. Prior work on optimizing models for interpretability has relied on easy-to-quantify proxies for interpretability, such as sparsity or the number of operations required. In…

Machine Learning · Statistics 2018-11-01 Isaac Lage , Andrew Slavin Ross , Been Kim , Samuel J. Gershman , Finale Doshi-Velez

Mixup data augmentation approaches have been applied for various tasks of deep learning to improve the generalization ability of deep neural networks. Some existing approaches CutMix, SaliencyMix, etc. randomly replace a patch in one image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Huafeng Qin , Xin Jin , Hongyu Zhu , Hongchao Liao , Mounîm A. El-Yacoubi , Xinbo Gao

Mixup, which creates synthetic training instances by linearly interpolating random sample pairs, is a simple and yet effective regularization technique to boost the performance of deep models trained with SGD. In this work, we report a…

Machine Learning · Computer Science 2023-03-03 Zixuan Liu , Ziqiao Wang , Hongyu Guo , Yongyi Mao

Mixup is a powerful data augmentation method that interpolates between two or more examples in the input or feature space and between the corresponding target labels. Many recent mixup methods focus on cutting and pasting two or more…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Data mixing augmentation have proved to be effective in improving the generalization ability of deep neural networks. While early methods mix samples by hand-crafted policies (e.g., linear interpolation), recent methods utilize saliency…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Zicheng Liu , Siyuan Li , Di Wu , Zihan Liu , Zhiyuan Chen , Lirong Wu , Stan Z. Li

In e-commerce, behavioral data is collected for decision making which can be costly and slow. Simulation with LLM powered agents is emerging as a promising alternative for representing human population behavior. However, LLMs are known to…

Artificial Intelligence · Computer Science 2025-04-01 Saab Mansour , Leonardo Perelli , Lorenzo Mainetti , George Davidson , Stefano D'Amato

High-stakes applications require AI-generated models to be interpretable. Current algorithms for the synthesis of potentially interpretable models rely on objectives or regularization terms that represent interpretability only coarsely…

Machine Learning · Computer Science 2021-04-28 Marco Virgolin , Andrea De Lorenzo , Francesca Randone , Eric Medvet , Mattias Wahde

Matching is a task at the heart of any data integration process, aimed at identifying correspondences among data elements. Matching problems were traditionally solved in a semi-automatic manner, with correspondences being generated by…

Databases · Computer Science 2020-12-03 Roee Shraga , Ofra Amir , Avigdor Gal

An increasingly common use case for machine learning models is augmenting the abilities of human decision makers. For classification tasks where neither the human or model are perfectly accurate, a key step in obtaining high performance is…

Machine Learning · Computer Science 2021-10-04 Gavin Kerrigan , Padhraic Smyth , Mark Steyvers

Mixup is a well-established data augmentation technique, which can extend the training distribution and regularize the neural networks by creating ''mixed'' samples based on the label-equivariance assumption, i.e., a proportional mixup of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zongbo Han , Tianchi Xie , Bingzhe Wu , Qinghua Hu , Changqing Zhang