English
Related papers

Related papers: A multimodal method based on cross-attention and c…

200 papers

In this paper, we propose a novel cross-attention-based generative adversarial network (GAN) for the challenging person image generation task. Cross-attention is a novel and intuitive multi-modal fusion method in which an…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Hao Tang , Ling Shao , Nicu Sebe , Luc Van Gool

Positron Emission Tomography and Magnetic Resonance Imaging (PET-MRI) systems can obtain functional and anatomical scans. PET suffers from a low signal-to-noise ratio. Meanwhile, the k-space data acquisition process in MRI is…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Taofeng Xie , Zhuo-Xu Cui , Chen Luo , Huayu Wang , Congcong Liu , Yuanzhi Zhang , Xuemei Wang , Yanjie Zhu , Guoqing Chen , Dong Liang , Qiyu Jin , Yihang Zhou , Haifeng Wang

Conventional multimodal data integration methods provide a comprehensive assessment of the shared or unique structure within each individual data type but suffer from several limitations such as the inability to handle high-dimensional data…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Matthew Drexler , Benjamin Risk , James J Lah , Suprateek Kundu , Deqiang Qiu

Automatic breast lesion detection and classification is an important task in computer-aided diagnosis, in which breast ultrasound (BUS) imaging is a common and frequently used screening tool. Recently, a number of deep learning-based…

Image and Video Processing · Electrical Eng. & Systems 2022-10-13 Zong Fan , Ping Gong , Shanshan Tang , Christine U. Lee , Xiaohui Zhang , Pengfei Song , Shigao Chen , Hua Li

Limited accessibility to neurological care leads to underdiagnosed Parkinson's Disease (PD), preventing early intervention. Existing AI-based PD detection methods primarily focus on unimodal analysis of motor or speech tasks, overlooking…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Md Saiful Islam , Tariq Adnan , Jan Freyberg , Sangwu Lee , Abdelrahman Abdelkader , Meghan Pawlik , Cathe Schwartz , Karen Jaffe , Ruth B. Schneider , E Ray Dorsey , Ehsan Hoque

Missing data are often dealt with multiple imputation. A crucial part of the multiple imputation process is selecting sensible models to generate plausible values for incomplete data. A method based on posterior predictive checking is…

Computation · Statistics 2026-05-14 Mingyang Cai , Stef van Buuren , Gerko Vink

Deep learning integration into medical imaging systems has transformed disease detection and diagnosis processes with a focus on pneumonia identification. The study introduces an intricate deep learning system using Convolutional Neural…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 P K Dutta , Anushri Chowdhury , Anouska Bhattacharyya , Shakya Chakraborty , Sujatra Dey

Parkinson's disease (PD), characterized by its incurable nature, rapid progression, and severe disability, poses significant challenges to the lives of patients and their families. Given the aging population, the need for early detection of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Wei Huang , Yinxuan Xu , Yintao Zhou , Zhengyu Li , Jing Huang , Meng Pang

The recent monkeypox outbreak has raised significant public health concerns due to its rapid spread across multiple countries. Monkeypox can be difficult to distinguish from chickenpox and measles in the early stages because the symptoms of…

Image and Video Processing · Electrical Eng. & Systems 2024-08-14 Niloy Kumar Kundu , Mainul Karim , Sarah Kobir , Dewan Md. Farid

Multi-modal medical image fusion is essential for the precise clinical diagnosis and surgical navigation since it can merge the complementary information in multi-modalities into a single image. The quality of the fused image depends on the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Xianming Gu , Lihui Wang , Zeyu Deng , Ying Cao , Xingyu Huang , Yue-min Zhu

Alzheimer's disease (AD) is the most prevalent form of dementia, and its early diagnosis is essential for slowing disease progression. Recent studies on multimodal neuroimaging fusion using MRI and PET have achieved promising results by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Delin Ma , Menghui Zhou , Jun Qi , Yun Yang , Po Yang

Controlling recurrent infectious diseases is a vital yet complicated problem. In this paper, we propose a novel active screening model (ACTS) and algorithms to facilitate active screening for recurrent diseases (no permanent immunity) under…

Quantitative Methods · Quantitative Biology 2019-03-15 Han-Ching Ou , Arunesh Sinha , Sze-Chuan Suen , Andrew Perrault , Milind Tambe

Recent studies have focused on utilizing multi-modal data to develop robust models for facial Action Unit (AU) detection. However, the heterogeneity of multi-modal data poses challenges in learning effective representations. One such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Xiang Zhang , Huiyuan Yang , Taoyue Wang , Xiaotian Li , Lijun Yin

The COVID-19 pandemic continues to spread and impact the well-being of the global population. The front-line modalities including computed tomography (CT) and X-ray play an important role for triaging COVID patients. Considering the limited…

It is imperative that breast cancer is detected precisely and timely to improve patient outcomes. Diagnostic methodologies have traditionally relied on unimodal approaches; however, medical data analytics is integrating diverse data sources…

Machine Learning · Computer Science 2024-06-21 Faseela Abdullakutty , Younes Akbari , Somaya Al-Maadeed , Ahmed Bouridane , Rifat Hamoudi

Multimodal fusion learning has shown significant promise in classifying various diseases such as skin cancer and brain tumors. However, existing methods face three key limitations. First, they often lack generalizability to other diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Joy Dhar , Nayyar Zaidi , Maryam Haghighat , Puneet Goyal , Sudipta Roy , Azadeh Alavi , Vikas Kumar

Osteoporosis is a common condition that increases fracture risk, especially in older adults. Early diagnosis is vital for preventing fractures, reducing treatment costs, and preserving mobility. However, healthcare providers face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Mehdi Hosseini Chagahi , Saeed Mohammadi Dashtaki , Niloufar Delfan , Nadia Mohammadi , Farshid Rostami Pouria , Behzad Moshiri , Md. Jalil Piran , Oliver Faust

Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the…

Machine Learning · Computer Science 2018-02-21 Zhanli Chen , Rashid Ansari , Diana J. Wilkie

Recent works on Multimodal 3D Computer-aided diagnosis have demonstrated that obtaining a competitive automatic diagnosis model when a 3D convolution neural network (CNN) brings more parameters and medical images are scarce remains…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Yin Dai , Yifan Gao , Fayu Liu , Jun Fu

Traditional biometric systems have encountered significant setbacks due to various unavoidable factors, for example, wearing of face masks in face recognition-based biometrics and hygiene concerns in fingerprint-based biometrics. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Arun K. Sharma , Shubhobrata Bhattacharya , Motahar Reza , Bishakh Bhattacharya