English
Related papers

Related papers: Multi-modal Transfer Learning between Biological F…

200 papers

RNA inverse sequence design has broad biological and engineering applications, but computational methods for practical design queries remain limited. Such queries may impose several constraints at once, including target folds or motifs,…

Quantitative Methods · Quantitative Biology 2026-05-11 Michael Lindsey

Biological function emerges from coupled constraints across sequence, structure, regulation, evolution, and cellular context, yet most foundation models in biology are trained within one modality or for a fixed forward task. We present…

Predicting the secondary structure of RNA is a core challenge in computational biology, essential for understanding molecular function and designing novel therapeutics. The field has evolved from foundational but accuracy-limited…

Biomolecules · Quantitative Biology 2026-05-20 Giuseppe Sacco , Giovanni Bussi , Guido Sanguinetti

In this work, we propose a simple transformer-based baseline for multimodal molecular representation learning, integrating three distinct modalities: SMILES strings, 2D graph representations, and 3D conformers of molecules. A key aspect of…

Machine Learning · Computer Science 2024-10-25 Andrei Manolache , Dragos Tantaru , Mathias Niepert

Multimodal foundation models aim to create a unified representation space that abstracts away from surface features like language syntax or modality differences. To investigate this, we study the internal representations of three recent…

Computation and Language · Computer Science 2025-02-21 Hyunji Lee , Danni Liu , Supriti Sinhamahapatra , Jan Niehues

The effective application of foundation models to translational research in immune-mediated diseases requires multimodal patient-level representations that can capture complex phenotypes emerging from multicellular interactions. Yet most…

Recent advances in general-purpose foundation models have stimulated the development of large biological sequence models. While natural language shows symbolic granularity (characters, words, sentences), biological sequences exhibit…

Machine Learning · Computer Science 2026-03-24 Hanlin Xiao , Rainer Breitling , Eriko Takano , Mauricio A. Álvarez

Proteins are macromolecules that mediate a significant fraction of the cellular processes that underlie life. An important task in bioengineering is designing proteins with specific 3D structures and chemical properties which enable…

Quantitative Methods · Quantitative Biology 2022-05-31 Namrata Anand , Tudor Achim

Recent advances in applying deep learning in genomics include DNA-language and single-cell foundation models. However, these models take only one data type as input. We introduce dynamic token adaptation and demonstrate how it combines…

Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design computer agents with intelligent capabilities such as understanding, reasoning, and learning through integrating multiple communicative…

Machine Learning · Computer Science 2023-02-21 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Developing models with high interpretability and even deriving formulas to quantify relationships between biological data is an emerging need. We propose here a framework for ab initio derivation of sequence motifs and linear formula using…

Quantitative Methods · Quantitative Biology 2022-08-23 Chengyu Liu , Wei Wang

Multimodal learning is a framework for building models that make predictions based on different types of modalities. Important challenges in multimodal learning are the inference of shared representations from arbitrary modalities and…

Machine Learning · Computer Science 2022-07-06 Masahiro Suzuki , Yutaka Matsuo

The modeling of genomic sequences presents unique challenges due to their length and structural complexity. Traditional sequence models struggle to capture long-range dependencies and biological features inherent in DNA. In this work, we…

Computational Engineering, Finance, and Science · Computer Science 2026-03-09 Qirong Yang , Yucheng Guo , Zicheng Liu , Yujie Yang , Qijin Yin , Siyuan Li , Shaomin Ji , Linlin Chao , Xiaoming Zhang , Stan Z. Li

Accurately diagnosing and predicting vehicle malfunctions is crucial for maintenance and safety in the automotive industry. While modern diagnostic systems primarily rely on sequences of vehicular Diagnostic Trouble Codes (DTCs) registered…

Artificial Intelligence · Computer Science 2026-02-03 Hugo Math , Rainer Lienhart

Single-cell RNA sequencing has transformed biology by enabling the measurement of gene expression at cellular resolution, providing information for cell types, states, and disease contexts. Recently, single-cell foundation models have…

Machine Learning · Computer Science 2025-10-13 Oussama Kharouiche , Aris Markogiannakis , Xiao Fei , Michail Chatzianastasis , Michalis Vazirgiannis

The task of understanding and interpreting the complex information encoded within genomic sequences remains a grand challenge in biological research and clinical applications. In this context, recent advancements in large language model…

Genomics · Quantitative Biology 2024-09-25 Qihang Zhao , Chi Zhang , Weixiong Zhang

Protein representation learning is critical for numerous biological tasks. Recently, large transformer-based protein language models (pLMs) pretrained on large scale protein sequences have demonstrated significant success in sequence-based…

Machine Learning · Computer Science 2025-08-12 Xuefeng Liu , Songhao Jiang , Chih-chan Tien , Jinbo Xu , Rick Stevens

Recent advances in large language models (LLMs) and biomedical foundation models (BioFMs) have achieved strong results in biological text reasoning, molecular modeling, and single-cell analysis, yet they remain siloed in disjoint embedding…

Quantitative Methods · Quantitative Biology 2025-10-03 Ching-Huei Tsou , Michal Ozery-Flato , Ella Barkan , Diwakar Mahajan , Ben Shapira

Foundation models learn highly transferable representations through large-scale pretraining on diverse data. An increasing body of research indicates that these representations exhibit a remarkable degree of similarity across architectures…

Artificial Intelligence · Computer Science 2025-10-08 Jianglin Lu , Hailing Wang , Yi Xu , Yizhou Wang , Kuo Yang , Yun Fu