English
Related papers

Related papers: RegBN: Batch Normalization of Multimodal Data with…

200 papers

The minimization of a data-fidelity term and an additive regularization functional gives rise to a powerful framework for supervised learning. In this paper, we present a unifying regularization functional that depends on an operator and on…

Machine Learning · Computer Science 2022-06-30 Michael Unser

Multi-behavior recommendation faces a critical challenge in practice: auxiliary behaviors (e.g., clicks, carts) are often noisy, weakly correlated, or semantically misaligned with the target behavior (e.g., purchase), which leads to biased…

Information Retrieval · Computer Science 2026-01-22 Miaomiao Cai , Zhijie Zhang , Junfeng Fang , Zhiyong Cheng , Xiang Wang , Meng Wang

Person re-identification (Re-ID) has achieved great success in the supervised scenario. However, it is difficult to directly transfer the supervised model to arbitrary unseen domains due to the model overfitting to the seen source domains.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Lei Qi , Lei Wang , Yinghuan Shi , Xin Geng

Deep neural networks are learning models with a very high capacity and therefore prone to over-fitting. Many regularization techniques such as Dropout, DropConnect, and weight decay all attempt to solve the problem of over-fitting by…

Machine Learning · Computer Science 2016-12-06 Armen Aghajanyan

This work investigates the use of mixed-norm regularization for sensor selection in Event-Related Potential (ERP) based Brain-Computer Interfaces (BCI). The classification problem is cast as a discriminative optimization framework where…

Machine Learning · Computer Science 2014-03-17 Rémi Flamary , Nisrine Jrad , Ronald Phlypo , Marco Congedo , Alain Rakotomamonjy

Multimodal remote sensing semantic segmentation enhances scene interpretation by exploiting complementary physical cues from heterogeneous data. Although pretrained Vision Foundation Models (VFMs) provide strong general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Haocheng Li , Juepeng Zheng , Shuangxi Miao , Ruibo Lu , Guosheng Cai , Haohuan Fu , Jianxi Huang

In this paper, we analyze batch normalization from the perspective of discriminability and find the disadvantages ignored by previous studies: the difference in $l_2$ norms of sample features can hinder batch normalization from obtaining…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Zhennan Wang , Kehan Li , Runyi Yu , Yian Zhao , Pengchong Qiao , Chang Liu , Fan Xu , Xiangyang Ji , Guoli Song , Jie Chen

In many applications where collecting data is expensive, for example neuroscience or medical imaging, the sample size is typically small compared to the feature dimension. It is challenging in this setting to train expressive, non-linear…

Machine Learning · Computer Science 2019-04-23 Sergul Aydore , Bertrand Thirion , Gael Varoquaux

Deep Neural Networks (DNNs) thrive in recent years in which Batch Normalization (BN) plays an indispensable role. However, it has been observed that BN is costly due to the reduction operations. In this paper, we propose alleviating this…

Machine Learning · Computer Science 2018-11-05 Zhaodong Chen , Lei Deng , Guoqi Li , Jiawei Sun , Xing Hu , Xin Ma , Yuan Xie

Variational methods for revealing visual concepts learned by convolutional neural networks have gained significant attention during the last years. Being based on noisy gradients obtained via back-propagation such methods require the…

Machine Learning · Computer Science 2018-05-02 Maximilian Baust , Florian Ludwig , Christian Rupprecht , Matthias Kohl , Stefan Braunewell

Few-shot image classification requires the classifier to robustly cope with unseen classes even if there are only a few samples for each class. Recent advances benefit from the meta-learning process where episodic tasks are formed to train…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Da Chen , Yongliang Yang , Zunlei Feng , Xiang Wu , Mingli Song , Wenbin Li , Yuan He , Hui Xue , Feng Mao

Unsupervised representation learning methods are widely used for gaining insight into high-dimensional, unstructured, or structured data. In some cases, users may have prior topological knowledge about the data, such as a known cluster…

Machine Learning · Computer Science 2023-11-08 Edith Heiter , Robin Vandaele , Tijl De Bie , Yvan Saeys , Jefrey Lijffijt

Medical multimodal representation learning aims to integrate heterogeneous data into unified patient representations to support clinical outcome prediction. However, real-world medical datasets commonly contain systematic biases from…

Machine Learning · Computer Science 2026-05-19 Xiaoguang Zhu , Linxiao Gong , Lianlong Sun , Yang Liu , Haoyu Wang , Jing Liu

Regularization is commonly used for alleviating overfitting in machine learning. For convolutional neural networks (CNNs), regularization methods, such as DropBlock and Shake-Shake, have illustrated the improvement in the generalization…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yi Wang , Zhen-Peng Bian , Junhui Hou , Lap-Pui Chau

The ResNet and its variants have achieved remarkable successes in various computer vision tasks. Despite its success in making gradient flow through building blocks, the simple shortcut connection mechanism limits the ability of…

Image and Video Processing · Electrical Eng. & Systems 2021-01-05 Jing Xu , Yu Pan , Xinglin Pan , Steven Hoi , Zhang Yi , Zenglin Xu

Multi-modal learning has achieved remarkable success by integrating information from various modalities, achieving superior performance in tasks like recognition and retrieval compared to uni-modal approaches. However, real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xiaohao Liu , Xiaobo Xia , Zhuo Huang , See-Kiong Ng , Tat-Seng Chua

Deep Neural Networks have achieved remarkable success relying on the developing high computation capability of GPUs and large-scale datasets with increasing network depth and width in image recognition, object detection and many other…

Machine Learning · Computer Science 2020-01-08 E Zhenqian , Gao Weiguo

Lack of standardization and various intrinsic parameters for magnetic resonance (MR) image acquisition results in heterogeneous images across different sites and devices, which adversely affects the generalization of deep neural networks.…

Image classification models often demonstrate unstable performance in real-world applications due to variations in image information, driven by differing visual perspectives of subject objects and lighting discrepancies. To mitigate these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuze Zheng , Zixuan Li , Xiangxian Li , Jinxing Liu , Yuqing Wang , Xiangxu Meng , Lei Meng

Effective properties of materials with random heterogeneous structures are typically determined by homogenising the mechanical quantity of interest in a window of observation. The entire problem setting encompasses the solution of a local…

Numerical Analysis · Mathematics 2021-10-22 Felipe Rocha , Simone Deparis , Pablo Antolin , Annalisa Buffa