中文
相关论文

相关论文: Harnessing Hard Mixed Samples with Decoupled Regul…

200 篇论文

We introduce a new approach for decoupling trends (drift) and changepoints (shifts) in time series. Our locally adaptive model-based approach for robustly decoupling combines Bayesian trend filtering and machine learning based…

统计方法学 · 统计学 2024-01-09 Haoxuan Wu , Toryn L. J. Schafer , Sean Ryan , David S. Matteson

Mixup refers to interpolation-based data augmentation, originally motivated as a way to go beyond empirical risk minimization (ERM). Its extensions mostly focus on the definition of interpolation and the space (input or feature) where it…

机器学习 · 计算机科学 2023-11-10 Shashanka Venkataramanan , Ewa Kijak , Laurent Amsaleg , Yannis Avrithis

Federated Learning (FL) has been successfully adopted for distributed training and inference of large-scale Deep Neural Networks (DNNs). However, DNNs are characterized by an extremely large number of parameters, thus, yielding significant…

机器学习 · 计算机科学 2023-12-25 Qianyu Long , Christos Anagnostopoulos , Shameem Puthiya Parambath , Daning Bi

Software-intensive systems, such as software product lines and robotics, utilise Markov decision processes (MDPs) to capture uncertainty and analyse sequential decision-making problems. Despite the usefulness of conventional policy…

人工智能 · 计算机科学 2026-05-01 Alexandros Evangelidis , Gricel Vázquez , Simos Gerasimou

Mixed Sample Data Augmentation (MSDA) has received increasing attention in recent years, with many successful variants such as MixUp and CutMix. By studying the mutual information between the function learned by a VAE on the original data…

机器学习 · 计算机科学 2021-03-02 Ethan Harris , Antonia Marcu , Matthew Painter , Mahesan Niranjan , Adam Prügel-Bennett , Jonathon Hare

Data augmentation is a dominant method for reducing model overfitting and improving generalization. Most existing data augmentation methods tend to find a compromise in augmenting the data, \textit{i.e.}, increasing the amplitude of…

计算机视觉与模式识别 · 计算机科学 2023-10-17 Zehao Wang , Yiwen Guo , Qizhang Li , Guanglei Yang , Wangmeng Zuo

Mixed-Modal Image Retrieval (MMIR) as a flexible search paradigm has attracted wide attention. However, previous approaches always achieve limited performance, due to two critical factors are seriously overlooked. 1) The contribution of…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Fuxiang Huang , Lei Zhang , Xiaowei Fu , Suqi Song

Deep learning models for vision tasks are trained on large datasets under the assumption that there exists a universal representation that can be used to make predictions for all samples. Whereas high complexity models are proven to be…

计算机视觉与模式识别 · 计算机科学 2022-09-28 Botos Csaba , Adel Bibi , Yanwei Li , Philip Torr , Ser-Nam Lim

Deep networks have achieved impressive results on a range of well-curated benchmark datasets. Surprisingly, their performance remains sensitive to perturbations that have little effect on human performance. In this work, we propose a novel…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Jonas Ngnawe , Marianne Abemgnigni Njifon , Jonathan Heek , Yann Dauphin

Distribution Matching Distillation (DMD) facilitates efficient inference by distilling multi-step diffusion models into few-step variants. Concurrently, Reinforcement Learning (RL) has emerged as a vital tool for aligning generative models…

The Mixture of Experts architecture allows for outrageously large neural networks by scaling model parameter size independently from computational demand (FLOPs). However, current DNN frameworks cannot effectively support the dynamic data…

机器学习 · 计算机科学 2022-08-03 Ferdinand Kossmann , Zhihao Jia , Alex Aiken

Recovering a signal from its Fourier intensity underlies many important applications, including lensless imaging and imaging through scattering media. Conventional algorithms for retrieving the phase suffer when noise is present but display…

图像与视频处理 · 电气工程与系统科学 2020-03-05 Yaotian Wang , Xiaohang Sun , Jason W. Fleischer

Deep Neural Networks (DNNs) have been shown to be susceptible to memorization or overfitting in the presence of noisily-labelled data. For the problem of robust learning under such noisy data, several algorithms have been proposed. A…

机器学习 · 计算机科学 2022-12-06 Deep Patel , P. S. Sastry

We introduce Noisy Feature Mixup (NFM), an inexpensive yet effective method for data augmentation that combines the best of interpolation based training and noise injection schemes. Rather than training with convex combinations of pairs of…

机器学习 · 计算机科学 2023-05-23 Soon Hoe Lim , N. Benjamin Erichson , Francisco Utrera , Winnie Xu , Michael W. Mahoney

It has previously been hypothesized, and supported with some experimental evidence, that deeper representations, when well trained, tend to do a better job at disentangling the underlying factors of variation. We study the following related…

机器学习 · 计算机科学 2012-07-19 Yoshua Bengio , Grégoire Mesnil , Yann Dauphin , Salah Rifai

Nonlinear hyperspectral unmixing has recently received considerable attention, as linear mixture models do not lead to an acceptable resolution in some problems. In fact, most nonlinear unmixing methods are designed by assuming specific…

图像与视频处理 · 电气工程与系统科学 2024-02-07 Saeid Mehrdad , Seyed AmirHossein Janani

With the rising number of machine learning competitions, the world has witnessed an exciting race for the best algorithms. However, the involved data selection process may fundamentally suffer from evidence ambiguity and concept drift…

机器学习 · 计算机科学 2020-06-15 Hoang D. Nguyen , Xuan-Son Vu , Quoc-Tuan Truong , Duc-Trong Le

Multi-label image classification datasets are often partially labeled where many labels are missing, posing a significant challenge to training accurate deep classifiers. However, the powerful Mixup sample-mixing data augmentation cannot be…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Chak Fong Chong , Jielong Guo , Xu Yang , Wei Ke , Yapeng Wang

This work introduces a framework to address the computational complexity inherent in Mixed-Integer Programming (MIP) models by harnessing the potential of deep learning. By employing deep learning, we construct problem-specific heuristics…

最优化与控制 · 数学 2024-05-13 Niki Triantafyllou , Maria M. Papathanasiou

Deep neural networks often consist of a great number of trainable parameters for extracting powerful features from given datasets. On one hand, massive trainable parameters significantly enhance the performance of these deep networks. On…

机器学习 · 计算机科学 2020-02-26 Yehui Tang , Yunhe Wang , Yixing Xu , Boxin Shi , Chao Xu , Chunjing Xu , Chang Xu