中文
相关论文

相关论文: Co-Mixup: Saliency Guided Joint Mixup with Supermo…

200 篇论文

Recent work has shown potential in using Mixed Integer Programming (MIP) solvers to optimize certain aspects of neural networks (NNs). However the intriguing approach of training NNs with MIP solvers is under-explored.…

机器学习 · 计算机科学 2023-04-03 Tómas Thorbjarnarson , Neil Yorke-Smith

Mixup, a simple data augmentation method that randomly mixes two data points via linear interpolation, has been extensively applied in various deep learning applications to gain better generalization. However, the theoretical underpinnings…

机器学习 · 计算机科学 2023-03-16 Difan Zou , Yuan Cao , Yuanzhi Li , Quanquan Gu

Data mixing augmentation has been widely applied to improve the generalization ability of deep neural networks. Recently, offline data mixing augmentation, e.g. handcrafted and saliency information-based mixup, has been gradually replaced…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Huafeng Qin , Xin Jin , Yun Jiang , Mounim A. El-Yacoubi , Xinbo Gao

Given imbalanced data, it is hard to train a good classifier using deep learning because of the poor generalization of minority classes. Traditionally, the well-known synthetic minority oversampling technique (SMOTE) for data augmentation,…

机器学习 · 计算机科学 2023-11-06 Wei-Chao Cheng , Tan-Ha Mai , Hsuan-Tien Lin

Mixed-integer optimisation problems can be computationally challenging. Here, we introduce and analyse two efficient algorithms with a specific sequential design that are aimed at dealing with sampled problems within this class. At each…

最优化与控制 · 数学 2023-03-07 Mohammadreza Chamanbaz , Roland Bouffanais

We propose \emph{MaxUp}, an embarrassingly simple, highly effective technique for improving the generalization performance of machine learning models, especially deep neural networks. The idea is to generate a set of augmented data with…

机器学习 · 计算机科学 2020-02-24 Chengyue Gong , Tongzheng Ren , Mao Ye , Qiang Liu

Unsupervised clustering is one of the most fundamental challenges in machine learning. A popular hypothesis is that data are generated from a union of low-dimensional nonlinear manifolds; thus an approach to clustering is identifying and…

机器学习 · 计算机科学 2017-12-27 Dejiao Zhang , Yifan Sun , Brian Eriksson , Laura Balzano

Steering the behavior of a strong model pre-trained on internet-scale data can be difficult due to the scarcity of competent supervisors. Recent studies reveal that, despite supervisory noises, a strong student model may surpass its weak…

机器学习 · 计算机科学 2024-02-26 Yuejiang Liu , Alexandre Alahi

Data augmentation by mixing samples, such as Mixup, has widely been used typically for classification tasks. However, this strategy is not always effective due to the gap between augmented samples for training and original samples for…

机器学习 · 计算机科学 2019-06-21 Takuya Shimada , Shoichiro Yamaguchi , Kohei Hayashi , Sosuke Kobayashi

In this work, we propose data augmentation via pairwise mixup across subgroups to improve group fairness. Many real-world applications of machine learning systems exhibit biases across certain groups due to under-representation or training…

机器学习 · 统计学 2023-09-14 Madeline Navarro , Camille Little , Genevera I. Allen , Santiago Segarra

In deep learning, mini-batch training is commonly used to optimize network parameters. However, the traditional mini-batch method may not learn the under-represented samples and complex patterns in the data, leading to a longer time for…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Subin Sahayam , John Zakkam , Umarani Jayaraman

Data augmentation techniques play an important role in enhancing the performance of deep learning models. Despite their proven benefits in computer vision tasks, their application in the other domains remains limited. This paper proposes a…

机器学习 · 计算机科学 2024-01-23 Yousef El-Laham , Elizabeth Fons , Dillon Daudert , Svitlana Vyetrenko

In the rapidly evolving research on artificial intelligence (AI) the demand for fast, computationally efficient, and scalable solutions has increased in recent years. The problem of optimizing the computing resources for distributed machine…

机器学习 · 计算机科学 2025-10-30 Mohammadreza Doostmohammadian , Zulfiya R. Gabidullina , Hamid R. Rabiee

A wireless network operator typically divides the radio spectrum it possesses into a number of subbands. In a cellular network those subbands are then reused in many cells. To mitigate co-channel interference, a joint spectrum and power…

信号处理 · 电气工程与系统科学 2020-12-22 Yasar Sinan Nasir , Dongning Guo

Codistillation has been proposed as a mechanism to share knowledge among concurrently trained models by encouraging them to represent the same function through an auxiliary loss. This contrasts with the more commonly used fully-synchronous…

机器学习 · 计算机科学 2021-07-27 Shagun Sodhani , Olivier Delalleau , Mahmoud Assran , Koustuv Sinha , Nicolas Ballas , Michael Rabbat

The rise in internet usage has led to the generation of massive amounts of data, resulting in the adoption of various supervised and semi-supervised machine learning algorithms, which can effectively utilize the colossal amount of data to…

Modern deep networks can be better generalized when trained with noisy samples and regularization techniques. Mixup and CutMix have been proven to be effective for data augmentation to help avoid overfitting. Previous Mixup-based methods…

计算机视觉与模式识别 · 计算机科学 2022-11-30 Shuyang Sun , Jie-Neng Chen , Ruifei He , Alan Yuille , Philip Torr , Song Bai

Mixup is a data augmentation technique that enhances model generalization by interpolating between data points using a mixing ratio $\lambda$ in the image domain. Recently, the concept of mixup has been adapted to the graph domain through…

机器学习 · 计算机科学 2024-12-12 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yibing Zhan , Yiheng Lu , Dapeng Tao

The development of mobile and on the edge applications that embed deep convolutional neural models has the potential to revolutionise biomedicine. However, most deep learning models require computational resources that are not available in…

计算机视觉与模式识别 · 计算机科学 2022-05-20 Adrián Inés , Andrés Díaz-Pinto , César Domínguez , Jónathan Heras , Eloy Mata , Vico Pascual

Domain shifts are ubiquitous in machine learning, and can substantially degrade a model's performance when deployed to real-world data. To address this, distribution alignment methods aim to learn feature representations which are invariant…

机器学习 · 计算机科学 2024-10-08 Andrea Napoli , Paul White