English
Related papers

Related papers: Self-Attention Equipped Graph Convolutions for Dis…

200 papers

Deep learning-based medical image segmentation technology aims at automatic recognizing and annotating objects on the medical image. Non-local attention and feature learning by multi-scale methods are widely used to model network, which…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Bo Wang , Lei Wang , Junyang Chen , Zhenghua Xu , Thomas Lukasiewicz , Zhigang Fu

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Zhiyuan Li , Hailong Li , Anca L. Ralescu , Jonathan R. Dillman , Mekibib Altaye , Kim M. Cecil , Nehal A. Parikh , Lili He

Decoding human activity accurately from wearable sensors can aid in applications related to healthcare and context awareness. The present approaches in this domain use recurrent and/or convolutional models to capture the spatio-temporal…

Human-Computer Interaction · Computer Science 2020-12-21 Satya P. Singh , Aimé Lay-Ekuakille , Deepak Gangwar , Madan Kumar Sharma , Sukrit Gupta

We propose a novel technique to incorporate attention within convolutional neural networks using feature maps generated by a separate convolutional autoencoder. Our attention architecture is well suited for incorporation with deep…

Computer Vision and Pattern Recognition · Computer Science 2019-02-11 Chaitanya Kaul , Suresh Manandhar , Nick Pears

Face-based age estimation has attracted enormous attention due to wide applications to public security surveillance, human-computer interaction, etc. With vigorous development of deep learning, age estimation based on deep neural network…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Zhicheng Cao , Kaituo Zhang , Liaojun Pang , Heng Zhao

Understanding the dynamic reorganization of brain networks is critical for predicting cognitive decline, neurological progression, and individual variability in clinical outcomes. This work proposes a multimodal graph neural network…

Machine Learning · Computer Science 2026-02-11 Preksha Girish , Rachana Mysore , Kiran K. N. , Hiranmayee R. , Shipra Prashanth , Shrey Kumar

This paper focuses on the detection of potentially dangerous tendencies of social media users in an innovative multimodal way. We integrate Natural Language Processing (NLP) and Graph Neural Networks (GNNs) together. Firstly, we apply NLP…

Machine Learning · Computer Science 2025-09-23 Cuiqianhe Du , Chia-En Chiang , Tianyi Huang , Zikun Cui

The healthcare industry has been revolutionized significantly by novel imaging technologies, not just in the diagnosis of cardiovascular diseases but also by the visualization of structural abnormalities like cardiomegaly. This article…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Abishek Karthik , Pandiyaraju V

Existing deep learning models for chest radiology often neglect patient metadata, limiting diagnostic accuracy and fairness. To bridge this gap, we introduce MetaCheX, a novel multimodal framework that integrates chest X-ray images with…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Nathan He , Cody Chen

When the trained physician interprets medical images, they understand the clinical importance of visual features. By applying cognitive attention, they apply greater focus onto clinically relevant regions while disregarding unnecessary…

Image and Video Processing · Electrical Eng. & Systems 2021-09-06 Adrit Rao , Jongchan Park , Sanghyun Woo , Joon-Young Lee , Oliver Aalami

Modelling long-range dependencies is critical for scene understanding tasks in computer vision. Although convolution neural networks (CNNs) have excelled in many vision tasks, they are still limited in capturing long-range structured…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Li Zhang , Mohan Chen , Anurag Arnab , Xiangyang Xue , Philip H. S. Torr

High annotation costs are a substantial bottleneck in applying modern deep learning architectures to clinically relevant medical use cases, substantiating the need for novel algorithms to learn from unlabeled data. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Aiham Taleb , Matthias Kirchler , Remo Monti , Christoph Lippert

Research studies have shown no qualms about using data driven deep learning models for downstream tasks in medical image analysis, e.g., anatomy segmentation and lesion detection, disease diagnosis and prognosis, and treatment planning.…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Jiahao Huang , Yingying Fang , Yang Nan , Huanjun Wu , Yinzhe Wu , Zhifan Gao , Yang Li , Zidong Wang , Pietro Lio , Daniel Rueckert , Yonina C. Eldar , Guang Yang

Alongside neuroimaging such as MRI scans and PET, Alzheimer's disease (AD) datasets contain valuable tabular data including AD biomarkers and clinical assessments. Existing computer vision approaches struggle to utilize this additional…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Weichen Huang

This paper proposes a learning model, based on rank-fusion graphs, for general applicability in multimodal prediction tasks, such as multimodal regression and image classification. Rank-fusion graphs encode information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Icaro Cavalcante Dourado , Salvatore Tabbone , Ricardo da Silva Torres

Predicting the quality of multimedia content is often needed in different fields. In some applications, quality metrics are crucial with a high impact, and can affect decision making such as diagnosis from medical multimedia. In this paper,…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Marouane Tliba , Aymen Sekhri , Mohamed Amine Kerkouri , Aladine Chetouani

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Self-attention is a useful mechanism to build generative models for language and images. It determines the importance of context elements by comparing each element to the current time step. In this paper, we show that a very lightweight…

Computation and Language · Computer Science 2019-02-26 Felix Wu , Angela Fan , Alexei Baevski , Yann N. Dauphin , Michael Auli

Integrating heterogeneous biomedical data including imaging, omics, and clinical records supports accurate diagnosis and personalised care. Graph-based models fuse such non-Euclidean data by capturing spatial and relational structure, yet…

Genomics · Quantitative Biology 2025-05-06 Alireza Sadeghi , Farshid Hajati , Ahmadreza Argha , Nigel H Lovell , Min Yang , Hamid Alinejad-Rokny

Deep learning models have great potential in medical imaging, including orthodontics and skeletal maturity assessment. However, applying a model to data different from its training set can lead to unreliable predictions that may impact…

Image and Video Processing · Electrical Eng. & Systems 2025-05-15 Omid Halimi Milani , Amanda Nikho , Lauren Mills , Marouane Tliba , Ahmet Enis Cetin , Mohammed H. Elnagar