English
Related papers

Related papers: Transformer representation learning is necessary f…

200 papers

The ability to predict the future trajectory of a patient is a key step toward the development of therapeutics for complex diseases such as Alzheimer's disease (AD). However, most machine learning approaches developed for prediction of…

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

We introduce a multimodal deep learning framework, Prescriptive Neural Networks (PNNs), that combines ideas from optimization and machine learning, and is, to the best of our knowledge, the first prescriptive method to handle multimodal…

Machine Learning · Computer Science 2025-01-27 Dimitris Bertsimas , Lisa Everest , Vasiliki Stoumpou

Background: Depression is a major public health concern, affecting an estimated five percent of the global population. Early and accurate diagnosis is essential to initiate effective treatment, yet recognition remains challenging in many…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Jana Weber , Marcel Weber , Juan Miguel Lopez Alcaraz

Accurate and robust drug response prediction is of utmost importance in precision medicine. Although many models have been developed to utilize the representations of drugs and cancer cell lines for predicting cancer drug responses (CDR),…

Quantitative Methods · Quantitative Biology 2023-11-22 Xiaoqiong Xia , Chaoyu Zhu , Yuqi Shan , Fan Zhong , Lei Liu

Diagnosing rare diseases presents a common challenge in clinical practice, necessitating the expertise of specialists for accurate identification. The advent of machine learning offers a promising solution, while the development of such…

Machine Learning · Computer Science 2024-03-12 Yifan Wu , Yang Liu , Yue Yang , Michael S. Yao , Wenli Yang , Xuehui Shi , Lihong Yang , Dongjun Li , Yueming Liu , James C. Gee , Xuan Yang , Wenbin Wei , Shi Gu

Machine learning offers great potential for automated prediction of post-stroke symptoms and their response to rehabilitation. Major challenges for this endeavour include the very high dimensionality of neuroimaging data, the relatively…

Artificial Intelligence · Computer Science 2023-10-31 Adam White , Margarita Saranti , Artur d'Avila Garcez , Thomas M. H. Hope , Cathy J. Price , Howard Bowman

The accurate diagnosis of Alzheimer's disease (AD) and prognosis of mild cognitive impairment (MCI) conversion are crucial for early intervention. However, existing multimodal methods face several challenges, from the heterogeneity of input…

Machine Learning · Computer Science 2025-03-20 Chenyu Liu , Luca Rossi

In this study, we propose HOPER (HOlistic ProtEin Representation), a novel multimodal learning framework designed to enhance protein function prediction (PFP) in low-data settings. The challenge of predicting protein functions is compounded…

Biomolecules · Quantitative Biology 2024-12-18 Serbülent Ünsal , Sinem Özdemir , Bünyamin Kasap , M. Erşan Kalaycı , Kemal Turhan , Tunca Doğan , Aybar C. Acar

Major depressive disorder (MDD) is a prevalent mental disorder associated with complex neurobiological changes that cannot be fully captured using a single imaging modality. The use of multimodal magnetic resonance imaging (MRI) provides a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nojod M. Alotaibi , Areej M. Alhothali

This thesis focuses on representation learning for sequence data over time or space, aiming to improve downstream sequence prediction tasks by using the learned representations. Supervised learning has been the most dominant approach for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-02 Qingming Tang

Body Dysmorphic Disorder (BDD) is a highly prevalent and frequently underdiagnosed condition characterized by persistent, intrusive preoccupations with perceived defects in physical appearance. In this extended analysis, we employ multiple…

Machine Learning · Computer Science 2025-03-17 Omar Costilla-Reyes , Morgan Talbot

Alzheimer's Disease (AD) is a progressive neurodegenerative disease. Amnestic mild cognitive impairment (MCI) is a common first symptom before the conversion to clinical impairment where the individual becomes unable to perform activities…

Computer Vision and Pattern Recognition · Computer Science 2017-10-16 Donghuan Lu , Karteek Popuri , Weiguang Ding , Rakesh Balachandar , Mirza Faisal Beg

POD-DL-ROMs have been recently proposed as an extremely versatile strategy to build accurate and reliable reduced order models (ROMs) for nonlinear parametrized partial differential equations, combining (i) a preliminary dimensionality…

Numerical Analysis · Mathematics 2023-05-09 Simone Brivio , Stefania Fresca , Nicola Rares Franco , Andrea Manzoni

It is expensive to compute residual diffusivity in chaotic in-compressible flows by solving advection-diffusion equation due to the formation of sharp internal layers in the advection dominated regime. Proper orthogonal decomposition (POD)…

Computational Physics · Physics 2019-10-02 Jiancheng Lyu , Jack Xin , Yifeng Yu

Transformer-based deep learning models have shown promise for disease risk prediction using electronic health records(EHRs), but modeling temporal dependencies remains a key challenge due to irregular visit intervals and lack of uniform…

Machine Learning · Computer Science 2025-11-10 Daniel S. Lee , Mayra S. Haedo-Cruz , Chen Jiang , Oshin Miranda , LiRong Wang

Simulating fluid flows in different virtual scenarios is of key importance in engineering applications. However, high-fidelity, full-order models relying, e.g., on the finite element method, are unaffordable whenever fluid flows must be…

Fluid Dynamics · Physics 2021-11-24 Stefania Fresca , Andrea Manzoni

Many learning tasks involve multi-modal data streams, where continuous data from different modes convey a comprehensive description about objects. A major challenge in this context is how to efficiently interpret multi-modal information in…

Machine Learning · Computer Science 2020-07-24 Amila Silva , Shanika Karunasekera , Christopher Leckie , Ling Luo

We present InfoVAE-Med3D, a latent-representation learning approach for 3D brain MRI that targets interpretable biomarkers of cognitive decline. Standard statistical models and shallow machine learning often lack power, while most deep…

Managing fluid balance in dialysis patients is crucial, as improper management can lead to severe complications. In this paper, we propose a multimodal approach that integrates visual features from lung ultrasound images with clinical data…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Tianqi Yang , Nantheera Anantrasirichai , Oktay Karakuş , Marco Allinovi , Alin Achim