English
Related papers

Related papers: Understanding Unimodal Bias in Multimodal Deep Lin…

200 papers

Multimodal representations and continual learning are two areas closely related to human intelligence. The former considers the learning of shared representation spaces where information from different modalities can be compared and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Kai Wang , Luis Herranz , Joost van de Weijer

Learning effective joint embedding for cross-modal data has always been a focus in the field of multimodal machine learning. We argue that during multimodal fusion, the generated multimodal embedding may be redundant, and the discriminative…

Machine Learning · Computer Science 2022-12-06 Sijie Mai , Ying Zeng , Haifeng Hu

Existing work in intelligent communications has recently made preliminary attempts to utilize multi-source sensing information (MSI) to improve the system performance. However, the research on MSI aided intelligent communications has not…

Signal Processing · Electrical Eng. & Systems 2020-12-01 Yuwen Yang , Feifei Gao , Chengwen Xing , Jianping An , Ahmed Alkhateeb

In this paper, we propose a model-driven deep learning network for multiple-input multiple-output (MIMO) detection. The structure of the network is specially designed by unfolding the iterative algorithm. Some trainable parameters are…

Information Theory · Computer Science 2018-09-26 Hengtao He , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

Multimodal learning enhances the perceptual capabilities of cognitive systems by integrating information from different sensory modalities. However, existing multimodal fusion research typically assumes static integration, not fully…

Neural and Evolutionary Computing · Computer Science 2025-05-16 Xiang He , Dongcheng Zhao , Yang Li , Qingqun Kong , Xin Yang , Yi Zeng

Multimodal meta-learning is a recent problem that extends conventional few-shot meta-learning by generalizing its setup to diverse multimodal task distributions. This setup makes a step towards mimicking how humans make use of a diverse set…

Machine Learning · Computer Science 2021-10-28 Milad Abdollahzadeh , Touba Malekzadeh , Ngai-Man Cheung

Conventional deep learning prioritizes unconstrained optimization, yet biological systems operate under strict metabolic constraints. We propose that these physical constraints shape dynamics to function not as limitations, but as a…

Machine Learning · Computer Science 2026-01-23 Xia Chen

Reliability is of paramount importance for the physical layer of wireless systems due to its decisive impact on end-to-end performance. However, the uncertainty of prevailing deep learning (DL)-based physical layer algorithms is hard to…

Signal Processing · Electrical Eng. & Systems 2023-02-07 Wentao Yu , Hengtao He , Xianghao Yu , Shenghui Song , Jun Zhang , Khaled B. Letaief

Deep learning, in general, focuses on training a neural network from large labeled datasets. Yet, in many cases there is value in training a network just from the input at hand. This is particularly relevant in many signal and image…

Machine Learning · Computer Science 2024-04-09 Tom Tirer , Raja Giryes , Se Young Chun , Yonina C. Eldar

Farquhar et al. [2021] show that correcting for active learning bias with underparameterised models leads to improved downstream performance. For overparameterised models such as NNs, however, correction leads either to decreased or…

Machine Learning · Computer Science 2021-12-15 Chelsea Murray , James U. Allingham , Javier Antorán , José Miguel Hernández-Lobato

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

We discuss methods for visualizing neural network decision boundaries and decision regions. We use these visualizations to investigate issues related to reproducibility and generalization in neural network training. We observe that changes…

During the last decades, many studies have been dedicated to improving the performance of neural networks, for example, the network architectures, initialization, and activation. However, investigating the importance and effects of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Fahad Alrasheedi , Xin Zhong , Pei-Chi Huang

In recent years, machine learning has been adopted to complex networks, but most existing works concern about the structural properties. To use machine learning to detect phase transitions and accurately identify the critical transition…

Physics and Society · Physics 2020-01-08 Qi Ni , Ming Tang , Ying Liu , Ying-Cheng Lai

This work proposes deep network models and learning algorithms for unsupervised and supervised binary hashing. Our novel network design constrains one hidden layer to directly output the binary codes. This addresses a challenging issue in…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Thanh-Toan Do , Anh-Dzung Doan , Ngai-Man Cheung

Deep Learning has revolutionized machine learning and artificial intelligence, achieving superhuman performance in several standard benchmarks. It is well-known that deep learning models are inefficient to train; they learn by processing…

Machine Learning · Computer Science 2021-12-03 Fartash Faghri

Transfer learning has recently become the dominant paradigm of machine learning. Pre-trained models fine-tuned for downstream tasks achieve better performance with fewer labelled examples. Nonetheless, it remains unclear how to develop…

Machine Learning · Computer Science 2024-01-30 Jonas Pfeiffer , Sebastian Ruder , Ivan Vulić , Edoardo Maria Ponti

Very deep convolutional networks with hundreds of layers have led to significant reductions in error on competitive benchmarks. Although the unmatched expressiveness of the many layers can be highly desirable at test time, training very…

Machine Learning · Computer Science 2016-08-01 Gao Huang , Yu Sun , Zhuang Liu , Daniel Sedra , Kilian Weinberger

Model-based methods and deep neural networks have both been tremendously successful paradigms in machine learning. In model-based methods, problem domain knowledge can be built into the constraints of the model, typically at the expense of…

Machine Learning · Computer Science 2014-11-21 John R. Hershey , Jonathan Le Roux , Felix Weninger

Multimodal learning typically utilizes multimodal joint loss to integrate different modalities and enhance model performance. However, this joint learning strategy can induce modality imbalance, where strong modalities overwhelm weaker ones…

Machine Learning · Computer Science 2025-09-08 Shijie Wang , Li Zhang , Xinyan Liang , Yuhua Qian , Shen Hu