English
Related papers

Related papers: Multi-view biomedical foundation models for molecu…

200 papers

Large language models applied to vast biological datasets have the potential to transform biology by uncovering disease mechanisms and accelerating drug development. However, current models are often siloed, trained separately on…

Geometric deep learning can find representations that are optimal for a given task and therefore improve the performance over pre-defined representations. While current work has mainly focused on point representations, meshes also contain…

Machine Learning · Computer Science 2021-04-21 Ignacio Sarasua , Jonwong Lee , Christian Wachinger

The early detection of a pulmonary embolism (PE) is critical for enhancing patient survival rates. Both image-based and non-image-based features are of utmost importance in medical classification tasks. In a clinical setting, physicians…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Zhaoxin Guo , Zhipeng Wang , Ruiquan Ge , Jianxun Yu , Feiwei Qin , Yuan Tian , Yuqing Peng , Yonghong Li , Changmiao Wang

Alzheimer's disease (AD) diagnosis requires integrating neuroimaging with heterogeneous clinical evidence and reasoning under established criteria, yet most multimodal models remain opaque and weakly guideline-aligned. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Qiuhui Chen , Yushan Deng , Xuancheng Yao , Yi Hong

Every molecule ever synthesised can be drawn as a 2D skeletal diagram, yet in modern property prediction this universally available representation has received less focus in favour of molecular graphs, 3D conformers, or billion-parameter…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Aaditya Baranwal , Akshaj Gupta , Shruti Vyas , Yogesh S Rawat

Multimodal Fusion Learning (MFL), leveraging disparate data from various imaging modalities (e.g., MRI, CT, SPECT), has shown great potential for addressing medical problems such as skin cancer and brain tumor prediction. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Joy Dhar , Nayyar Zaidi , Maryam Haghighat

Functional connectivity (FC) derived from resting-state fMRI plays a critical role in personalized predictions such as age and cognitive performance. However, applying foundation models(FM) to fMRI data remains challenging due to its high…

Neurons and Cognition · Quantitative Biology 2025-08-26 Yanwen Wang , Xinglin Zhao , Yijin Song , Xiaobo Liu , Yanrong Hao , Rui Cao , Xin Wen

Discovering materials with desirable properties in an efficient way remains a significant problem in materials science. Many studies have tackled this problem by using different sets of information available about the materials. Among them,…

Materials Science · Physics 2025-03-04 Onur Boyar , Indra Priyadarsini , Seiji Takeda , Lisa Hamada

The automatic diagnosis of Parkinson's disease is in high clinical demand due to its prevalence and the importance of targeted treatment. Current clinical practice often relies on diagnostic biomarkers in QSM and NM-MRI images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Ding Shaodong , Liu Ziyang , Zhou Yijun , Liu Tao

Early and accessible detection of Alzheimer's disease (AD) remains a critical clinical challenge, and cube-copying tasks offer a simple yet informative assessment of visuospatial function. This work proposes a multimodal framework that…

Machine Learning · Computer Science 2025-12-19 Jaeho Yang , Kijung Yoon

Introspection of deep supervised predictive models trained on functional and structural brain imaging may uncover novel markers of Alzheimer's disease (AD). However, supervised training is prone to learning from spurious features (shortcut…

Machine Learning · Computer Science 2022-05-24 Alex Fedorov , Lei Wu , Tristan Sylvain , Margaux Luck , Thomas P. DeRamus , Dmitry Bleklov , Sergey M. Plis , Vince D. Calhoun

The advent of foundation models, particularly Vision-Language Models (VLMs) and Multi-modal Large Language Models (MLLMs), has redefined the frontiers of artificial intelligence, enabling remarkable generalization across diverse tasks with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Redwan Sony , Parisa Farmanifard , Hamzeh Alzwairy , Nitish Shukla , Arun Ross

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Foundation models are vital tools in various Computer Vision applications. They take as input a single RGB image and output a deep feature representation that is useful for various applications. However, in case we have multiple views of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Leo Segre , Or Hirschorn , Shai Avidan

Being the most commonly known neurodegeneration, Alzheimer's Disease (AD) is annually diagnosed in millions of patients. The present medical scenario still finds the exact diagnosis and classification of AD through neuroimaging data as a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Shravan Venkatraman , Pandiyaraju V , Abeshek A , Pavan Kumar S , Aravintakshan S A

Magnetic Resonance Imaging is a critical imaging modality in clinical diagnosis and research, yet its complexity and heterogeneity hinder scalable, generalizable machine learning. Although foundation models have revolutionized language and…

Existing machine learning methods for molecular (e.g., gene) embeddings are restricted to specific tasks or data modalities, limiting their effectiveness within narrow domains. As a result, they fail to capture the full breadth of gene…

Medical data collected for diagnostic decisions are typically multimodal, providing comprehensive information on a subject. While computer-aided diagnosis systems can benefit from multimodal inputs, effectively fusing such data remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Qiuhui Chen , Yi Hong

Accurate and early diagnosis of Alzheimer's disease (AD) is critical for effective intervention and requires integrating complementary information from multimodal neuroimaging data. However, conventional fusion approaches often rely on…

Machine Learning · Computer Science 2026-04-14 Farica Zhuang , Shu Yang , Dinara Aliyeva , Zixuan Wen , Duy Duong-Tran , Christos Davatzikos , Tianlong Chen , Song Wang , Li Shen

Although Alzheimer's disease detection via MRIs has advanced significantly thanks to contemporary deep learning models, challenges such as class imbalance, protocol variations, and limited dataset diversity often hinder their generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Zobia Batool , Huseyin Ozkan , Erchan Aptoula