English
Related papers

Related papers: Co-Mixup: Saliency Guided Joint Mixup with Supermo…

200 papers

Mixed Integer Linear Programming (MILP) is a fundamental tool for modeling combinatorial optimization problems. Recently, a growing body of research has used machine learning to accelerate MILP solving. Despite the increasing popularity of…

Machine Learning · Computer Science 2024-10-29 Weimin Huang , Taoan Huang , Aaron M Ferber , Bistra Dilkina

The limited availability of annotated data in medical imaging makes semi-supervised learning increasingly appealing for its ability to learn from imperfect supervision. Recently, teacher-student frameworks have gained popularity for their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Thanh-Huy Nguyen , Hoang-Thien Nguyen , Vi Vu , Ba-Thinh Lam , Phat Huynh , Tianyang Wang , Xingjian Li , Ulas Bagci , Min Xu

Deep neural networks have proven to be highly effective when large amounts of data with clean labels are available. However, their performance degrades when training data contains noisy labels, leading to poor generalization on the test…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Fahimeh Fooladgar , Minh Nguyen Nhat To , Parvin Mousavi , Purang Abolmaesumi

Although deep neural networks have provided impressive gains in performance, these improvements often come at the cost of increased computational complexity and expense. In many cases, such as 3D volume or video classification tasks, not…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Sharath M Shankaranarayana , Soumava Kumar Roy , Prasad Sudhakar , Chandan Aladahalli

Deep-learning based speech separation models confront poor generalization problem that even the state-of-the-art models could abruptly fail when evaluating them in mismatch conditions. To address this problem, we propose an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-04 Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu

Modern deep neural network training is typically based on mini-batch stochastic gradient optimization. While the use of large mini-batches increases the available computational parallelism, small batch training has been shown to provide…

Machine Learning · Computer Science 2018-04-23 Dominic Masters , Carlo Luschi

To solve the problem of poor performance of deep neural network models due to insufficient data, a simple yet effective interpolation-based data augmentation method is proposed: MSMix (Manifold Swap Mixup). This method feeds two different…

Machine Learning · Computer Science 2023-06-01 Mao Ye , Haitao Wang , Zheqian Chen

Large-batch SGD is important for scaling training of deep neural networks. However, without fine-tuning hyperparameter schedules, the generalization of the model may be hampered. We propose to use batch augmentation: replicating instances…

Machine Learning · Computer Science 2019-01-29 Elad Hoffer , Tal Ben-Nun , Itay Hubara , Niv Giladi , Torsten Hoefler , Daniel Soudry

Mixup is a widely adopted strategy for training deep networks, where additional samples are augmented by interpolating inputs and labels of training pairs. Mixup has shown to improve classification performance, network calibration, and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Thomas Mensink , Pascal Mettes

In conventional multi-user multiple-input multiple-output (MU-MIMO) systems with frequency division duplexing (FDD), channel acquisition and precoder optimization processes have been designed separately although they are highly coupled.…

Information Theory · Computer Science 2022-09-22 Jeonghyeon Jang , Hoon Lee , Il-Min Kim , Inkyu Lee

Robust optimization is becoming increasingly important in machine learning applications. In this paper, we study a unified framework of robust submodular optimization. We study this problem both from a minimization and maximization…

Machine Learning · Computer Science 2021-03-22 Rishabh Iyer

Deep neural networks are powerful, massively parameterized machine learning models that have been shown to perform well in supervised learning tasks. However, very large amounts of labeled data are usually needed to train deep neural…

Machine Learning · Computer Science 2020-12-02 Hanchen Xie , Mohamed E. Hussein , Aram Galstyan , Wael Abd-Almageed

This paper introduces the notion of co-modularity, to co-cluster observations of bipartite networks into co-communities. The task of co-clustering is to group together nodes of one type with nodes of another type, according to the…

Methodology · Statistics 2021-11-09 Thomas E. Bartlett

Mixup is a regularization technique that artificially produces new samples using convex combinations of original training points. This simple technique has shown strong empirical performance, and has been heavily used as part of…

Machine Learning · Computer Science 2022-11-01 Arslan Chaudhry , Aditya Krishna Menon , Andreas Veit , Sadeep Jayasumana , Srikumar Ramalingam , Sanjiv Kumar

Compared to classical deep neural networks its binarized versions can be useful for applications on resource-limited devices due to their reduction in memory consumption and computational demands. In this work we study deep neural networks…

Optimization and Control · Mathematics 2021-10-26 Jannis Kurtz , Bubacarr Bah

Choosing a suitable deep learning architecture for multimodal data fusion is a challenging task, as it requires the effective integration and processing of diverse data types, each with distinct structures and characteristics. In this…

Machine Learning · Computer Science 2025-01-22 Abdelmadjid Chergui , Grigor Bezirganyan , Sana Sellami , Laure Berti-Équille , Sébastien Fournier

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

Deep networks have gained immense popularity in Computer Vision and other fields in the past few years due to their remarkable performance on recognition/classification tasks surpassing the state-of-the art. One of the keys to their success…

Machine Learning · Computer Science 2018-06-04 Rudrasis Chakraborty , Chun-Hao Yang , Baba C. Vemuri

Mini-batch training is a cornerstone of modern deep learning, offering computational efficiency and scalability for training complex architectures. However, existing deep subspace clustering (DSC) methods, which typically combine an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yuxuan Jiang , Chenwei Yu , Zhi Lin , Xiaolan Liu

We study the problem of robust data augmentation for regression tasks in the presence of noisy data. Data augmentation is essential for generalizing deep learning models, but most of the techniques like the popular Mixup are primarily…

Machine Learning · Computer Science 2024-08-19 Seong-Hyeon Hwang , Minsu Kim , Steven Euijong Whang