English
Related papers

Related papers: Multimodal Data Fusion based on the Global Workspa…

200 papers

Generative adversarial networks (GANs) are highly effective unsupervised learning frameworks that can generate very sharp data, even for data such as images with complex, highly multimodal distributions. However GANs are known to be very…

Machine Learning · Statistics 2017-12-05 Sitao Xiang , Hao Li

Attention Graph Neural Networks (AT-GNNs), such as GAT and Graph Transformer, have demonstrated superior performance compared to other GNNs. However, existing GNN systems struggle to efficiently train AT-GNNs on GPUs due to their intricate…

Machine Learning · Computer Science 2024-11-26 Jiahui Liu , Zhenkun Cai , Zhiyong Chen , Minjie Wang

Wireless physical layer assessment, such as measuring antenna radiation patterns, is complex and cost-intensive. Researchers often require a stationary setup with antennas surrounding the device under test. There remains a need for more…

Networking and Internet Architecture · Computer Science 2025-01-24 Alexander Heinrich , Florentin Putz , Sören Krollmann , Bastian Loss , Waqar Ahmed , Matthias Hollick

Fault detection and diagnosis are critical for the optimal and safe operation of industrial processes. The correlations among sensors often display non-Euclidean structures where graph neural networks (GNNs) are widely used therein.…

Machine Learning · Computer Science 2026-04-22 Bibek Aryal , Gift Modekwe , Qiugang Lu

Federated learning (FL) facilitates the secure utilization of decentralized images, advancing applications in medical image recognition and autonomous driving. However, conventional FL faces two critical challenges in real-world deployment:…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Shiwei Lu , Yuhang He , Jiashuo Li , Qiang Wang , Yihong Gong

We introduce a new method to tag Multiword Expressions (MWEs) using a linguistically interpretable language-independent deep learning architecture. We specifically target discontinuity, an under-explored aspect that poses a significant…

Computation and Language · Computer Science 2019-04-26 Omid Rohanian , Shiva Taslimipoor , Samaneh Kouchaki , Le An Ha , Ruslan Mitkov

We present a series of modifications which improve upon Graph WaveNet's previously state-of-the-art performance on the METR-LA traffic prediction task. The goal of this task is to predict the future speed of traffic at each sensor in a…

Signal Processing · Electrical Eng. & Systems 2019-12-17 Sam Shleifer , Clara McCreery , Vamsi Chitters

Multimodal medical image segmentation faces significant challenges in the context of gastric cancer lesion analysis. This clinical context is defined by the scarcity of independent multimodal datasets and the imperative to amalgamate…

Image and Video Processing · Electrical Eng. & Systems 2025-05-28 Jiaming Liang , Lihuan Dai , Xiaoqi Sheng , Xiangguang Chen , Chun Yao , Guihua Tao , Qibin Leng , Hongmin Cai , Xi Zhong

Graph Neural Networks (GNNs) have improved unsupervised community detection of clustered nodes due to their ability to encode the dual dimensionality of the connectivity and feature information spaces of graphs. Identifying the latent…

Machine Learning · Computer Science 2023-11-28 William Leeney , Ryan McConville

Estimating causal effects from observational data is a central problem in many domains. A general approach is to balance covariates with weights such that the distribution of the data mimics randomization. We present generalized balancing…

Machine Learning · Statistics 2023-10-02 Yoshiaki Kitazawa

The current practice for assessing neonatal postoperative pain relies on bedside caregivers. This practice is subjective, inconsistent, slow, and discontinuous. To develop a reliable medical interpretation, several automated approaches have…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Md Sirajus Salekin , Ghada Zamzmi , Dmitry Goldgof , Rangachar Kasturi , Thao Ho , Yu Sun

This paper presents a novel multimodal framework to distinguish between different symptom classes of subjects in the schizophrenia spectrum and healthy controls using audio, video, and text modalities. We implemented Convolution Neural…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Gowtham Premananth , Yashish M. Siriwardena , Philip Resnik , Sonia Bansal , Deanna L. Kelly , Carol Espy-Wilson

Traditional machine learning methods for movement recognition often struggle with limited model interpretability and a lack of insight into human movement dynamics. This study introduces a novel representation learning framework based on…

Machine Learning · Computer Science 2025-07-01 Xingrui Gu , Chuyi Jiang , Erte Wang , Qiang Cui , Leimin Tian , Lianlong Wu , Siyang Song , Chuang Yu

Modeling complex phenomena typically involves the use of both discrete and continuous variables. Such a setting applies across a wide range of problems, from identifying trends in time-series data to performing effective compositional scene…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Tuan Anh Le , Katherine M. Collins , Luke Hewitt , Kevin Ellis , N. Siddharth , Samuel J. Gershman , Joshua B. Tenenbaum

Image fusion aims to generate a high-quality image from multiple images captured under varying conditions. The key problem of this task is to preserve complementary information while filtering out irrelevant information for the fused…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Yuanshen Guan , Ruikang Xu , Mingde Yao , Lizhi Wang , Zhiwei Xiong

Visual question answering (VQA) requires systems to perform concept-level reasoning by unifying unstructured (e.g., the context in question and answer; "QA context") and structured (e.g., knowledge graph for the QA context and scene;…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Yanan Wang , Michihiro Yasunaga , Hongyu Ren , Shinya Wada , Jure Leskovec

People perceive the world with different senses, such as sight, hearing, smell, and touch. Processing and fusing information from multiple modalities enables Artificial Intelligence to understand the world around us more easily. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Zecheng Liu , Jia Wei , Rui Li , Jianlong Zhou

Emotion regulation plays a crucial role in mental health, and difficulties in regulating emotions can contribute to psychological disorders. While reappraisal and suppression are well-studied strategies, the combined contributions of gray…

Neurons and Cognition · Quantitative Biology 2025-03-14 Alessandro Grecucci , Parisa Ahmadi Ghomroudi , Carmen Morawetz , Valerie Lesk , Irene Messina

It is necessary for clinicians to comprehensively analyze patient information from different sources. Medical image fusion is a promising approach to providing overall information from medical images of different modalities. However,…

Image and Video Processing · Electrical Eng. & Systems 2019-12-12 Fanda Fan , Yunyou Huang , Lei Wang , Xingwang Xiong , Zihan Jiang , Zhifei Zhang , Jianfeng Zhan

Recent research on graph neural networks (GNNs) has explored mechanisms for capturing local uncertainty and exploiting graph hierarchies to mitigate data sparsity and leverage structural properties. However, the synergistic integration of…

Machine Learning · Computer Science 2025-05-06 Yoonhyuk Choi , Jiho Choi , Taewook Ko , Chong-Kwon Kim