English
Related papers

Related papers: Multi-modal Representation Learning Enables Accura…

200 papers

Recent advancements in multimodal pre-training models have significantly advanced computational pathology. However, current approaches predominantly rely on visual-language models, which may impose limitations from a molecular perspective…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Minghao Han , Dingkang Yang , Jiabei Cheng , Xukun Zhang , Linhao Qu , Zizhi Chen , Lihua Zhang

Copolymers are highly versatile materials with a vast range of possible chemical compositions. By using computational methods for property prediction, the design of copolymers can be accelerated, allowing for the prioritization of…

Materials Science · Physics 2025-09-16 Elaheh Kazemi-Khasragh , Rocío Mercado , Carlos Gonzalez , Maciej Haranczyk

Protein language models (pLMs) have recently gained significant attention for their ability to uncover relationships between sequence, structure, and function from evolutionary statistics, thereby accelerating therapeutic drug discovery.…

Machine Learning · Computer Science 2026-03-04 Darshan Patil , Pranshu Malviya , Mathieu Reymond , Quentin Fournier , Sarath Chandar

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

In this paper, we propose a novel model for high-dimensional data, called the Hybrid Orthogonal Projection and Estimation (HOPE) model, which combines a linear orthogonal projection and a finite mixture model under a unified generative…

Machine Learning · Computer Science 2016-04-26 Shiliang Zhang , Hui Jiang

Virtual screening can accelerate drug discovery by identifying promising candidates for experimental evaluation. Machine learning is a powerful method for screening, as it can learn complex structure-property relationships from experimental…

Machine Learning · Computer Science 2021-02-22 Simon Axelrod , Rafael Gomez-Bombarelli

Many healthcare applications are inherently multimodal, involving several physiological signals. As sensors for these signals become more common, improving machine learning methods for multimodal healthcare data is crucial. Pretraining…

Machine Learning · Computer Science 2024-10-23 Ching Fang , Christopher Sandino , Behrooz Mahasseni , Juri Minxha , Hadi Pouransari , Erdrin Azemi , Ali Moin , Ellen Zippi

Survival analysis plays a vital role in making clinical decisions. However, the models currently in use are often difficult to interpret, which reduces their usefulness in clinical settings. Prototype learning presents a potential solution,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Shuo Jiang , Zhuwen Chen , Liaoman Xu , Yanming Zhu , Changmiao Wang , Jiong Zhang , Feiwei Qin , Yifei Chen , Zhu Zhu

Proteins are inherently multiscale physical systems whose functional properties emerge from coordinated structural organization across multiple spatial resolutions, ranging from atomic interactions to global fold topology. However, existing…

Machine Learning · Computer Science 2026-05-13 Viet Thanh Duy Nguyen , John K. Johnstone , Truong-Son Hy

Predicting the physico-chemical properties of pure substances and mixtures is a central task in thermodynamics. Established prediction methods range from fully physics-based ab-initio calculations, which are only feasible for very simple…

Machine Learning · Computer Science 2024-12-02 Johannes Zenn , Dominik Gond , Fabian Jirasek , Robert Bamler

Molecular representation is a critical element in our understanding of the physical world and the foundation for modern molecular machine learning. Previous molecular machine learning models have employed strings, fingerprints, global…

Machine Learning · Computer Science 2025-05-28 Daniil A. Boiko , Thiago Reschützegger , Benjamin Sanchez-Lengeling , Samuel M. Blau , Gabe Gomes

Learning multimodal representations is a fundamentally complex research problem due to the presence of multiple heterogeneous sources of information. Although the presence of multiple modalities provides additional valuable information,…

Machine Learning · Computer Science 2019-05-15 Yao-Hung Hubert Tsai , Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency , Ruslan Salakhutdinov

Tabular data contains rich structural semantics and plays a crucial role in organizing and manipulating information. Recent methods employ Multi-modal Large Language Models (MLLMs) to address table-related tasks across various modalities of…

Computation and Language · Computer Science 2026-02-17 Haolan Wang , Zhenghao Liu , Xinze Li , Xiaocui Yang , Yu Gu , Yukun Yan , Qi Shi , Fangfang Li , Chong Chen , Ge Yu

Multimodal federated learning holds immense potential for collaboratively training models from multiple sources without sharing raw data, addressing both data scarcity and privacy concerns, two key challenges in healthcare. A major…

Machine Learning · Computer Science 2025-05-27 Pranav Poudel , Aavash Chhetri , Prashnna Gyawali , Georgios Leontidis , Binod Bhattarai

Reinforcement learning has achieved promising results on robotic control tasks but struggles to leverage information effectively from multiple sensory modalities that differ in many characteristics. Recent works construct auxiliary losses…

Machine Learning · Computer Science 2024-10-24 Bang You , Huaping Liu

Transformer-based architectures have recently propelled advances in sequence modeling across domains, but their application to the hydrophobic-hydrophilic (H-P) model for protein folding remains relatively unexplored. In this work, we adapt…

Machine Learning · Computer Science 2025-04-23 Peizheng Liu , Hitoshi Iba

The advent of highly accurate protein structure prediction methods has fueled an exponential expansion of the protein structure database. Consequently, there is a rising demand for rapid and precise structural homolog search. Traditional…

Biomolecules · Quantitative Biology 2023-12-01 Yuan Liu , Hong-Bin Shen

Transformer models have achieved state-of-the-art results across a diverse range of domains. However, concern over the cost of training the attention mechanism to learn complex dependencies between distant inputs continues to grow. In…

In recent years, deep learning techniques have made significant strides in molecular generation for specific targets, driving advancements in drug discovery. However, existing molecular generation methods present significant limitations:…

Machine Learning · Computer Science 2025-03-12 Taojie Kuang , Qianli Ma , Athanasios V. Vasilakos , Yu Wang , Qiang , Cheng , Zhixiang Ren

Proteins govern most biological functions essential for life, but achieving controllable protein discovery and optimization remains challenging. Recently, machine learning-assisted protein editing (MLPE) has shown promise in accelerating…

Artificial Intelligence · Computer Science 2024-11-19 Mingze Yin , Hanjing Zhou , Yiheng Zhu , Miao Lin , Yixuan Wu , Jialu Wu , Hongxia Xu , Chang-Yu Hsieh , Tingjun Hou , Jintai Chen , Jian Wu