English
Related papers

Related papers: BSM: Small but Powerful Biological Sequence Model …

200 papers

Predicting gene function from its DNA sequence is a fundamental challenge in biology. Many deep learning models have been proposed to embed DNA sequences and predict their enzymatic function, leveraging information in public databases…

Foundation models are transforming neuroscience but are often prohibitively large, data-hungry, and difficult to deploy. Here, we introduce BrainSymphony, a lightweight and parameter-efficient foundation model with plug-and-play integration…

Quantitative Methods · Quantitative Biology 2026-02-13 Moein Khajehnejad , Forough Habibollahi , Devon Stoliker , Adeel Razi

Existing machine learning methods for molecular (e.g., gene) embeddings are restricted to specific tasks or data modalities, limiting their effectiveness within narrow domains. As a result, they fail to capture the full breadth of gene…

With the rapid development of deep learning, training Big Models (BMs) for multiple downstream tasks becomes a popular paradigm. Researchers have achieved various outcomes in the construction of BMs and the BM application in many fields. At…

Fueled by breakthrough technology developments, the biological, biomedical, and behavioral sciences are now collecting more data than ever before. There is a critical need for time- and cost-efficient strategies to analyze and interpret…

Biological foundation models (BioFMs), pretrained on large-scale biological sequences, have recently shown strong potential in providing meaningful representations for diverse downstream bioinformatics tasks. However, such models often rely…

Machine Learning · Computer Science 2026-02-10 Yifan Wu , Jiyue Jiang , Xichen Ye , Yiqi Wang , Chang Zhou , Yitao Xu , Jiayang Chen , He Hu , Weizhong Zhang , Cheng Jin , Jiao Yuan , Yu Li

Machine learning is widely used to analyze biological sequence data. Non-sequential models such as SVMs or feed-forward neural networks are often used although they have no natural way of handling sequences of varying length. Recurrent…

Quantitative Methods · Quantitative Biology 2016-03-14 Søren Kaae Sønderby , Casper Kaae Sønderby , Henrik Nielsen , Ole Winther

Large Language Models (LLMs), with their remarkable task-handling capabilities and innovative outputs, have catalyzed significant advancements across a spectrum of fields. However, their proficiency within specialized domains such as…

Quantitative Methods · Quantitative Biology 2024-03-05 Yin Fang , Xiaozhuan Liang , Ningyu Zhang , Kangwei Liu , Rui Huang , Zhuo Chen , Xiaohui Fan , Huajun Chen

Cellular differentiation is governed by gene regulatory networks, the high-dimensional stochastic biochemical systems that determine the transcriptional landscape and mediate cellular responses to signals and perturbations. Although…

Molecular Networks · Quantitative Biology 2026-04-29 Suryanarayana Maddu , Victor Chardès , Michael J. Shelley

We present BioLangFusion, a simple approach for integrating pre-trained DNA, mRNA, and protein language models into unified molecular representations. Motivated by the central dogma of molecular biology (information flow from gene to…

Machine Learning · Computer Science 2025-06-11 Amina Mollaysa , Artem Moskale , Pushpak Pati , Tommaso Mansi , Mangal Prakash , Rui Liao

Current protein language models (PLMs) learn protein representations mainly based on their sequences, thereby well capturing co-evolutionary information, but they are unable to explicitly acquire protein functions, which is the end goal of…

Biomolecules · Quantitative Biology 2023-07-06 Minghao Xu , Xinyu Yuan , Santiago Miret , Jian Tang

Biological functions stem from coordinated interactions among proteins, nucleic acids and small molecules. Mass spectrometry technologies for reliable, high throughput single-cell proteomics will add a new modality to genomics and enable…

Genomics · Quantitative Biology 2023-11-07 Andrew Leduc , Hannah Harens , Nikolai Slavov

In cell culture bioprocessing, real-time batch process monitoring (BPM) refers to the continuous tracking and analysis of key process variables such as viable cell density, nutrient levels, metabolite concentrations, and product titer…

Quantitative Methods · Quantitative Biology 2025-12-04 Johnny Peng , Thanh Tung Khuat , Ellen Otte , Katarzyna Musial , Bogdan Gabrys

Clustering mixed-type data remains a major challenge in biomedical research to uncover clinically meaningful subgroups within heterogeneous patient populations. Most existing clustering methods impose restrictive assumptions like local…

Applications · Statistics 2026-04-23 Yueting Wang , Shu Wang , Jonathan G. Yabes , Chung-Chou H. Chang

Proteins adopt multiple structural conformations to perform their diverse biological functions, and understanding these conformations is crucial for advancing drug discovery. Traditional physics-based simulation methods often struggle with…

Biomolecules · Quantitative Biology 2025-03-14 Jiarui Lu , Xiaoyin Chen , Stephen Zhewen Lu , Chence Shi , Hongyu Guo , Yoshua Bengio , Jian Tang

Protein language models have shown remarkable success in learning biological information from protein sequences. However, most existing models are limited by either autoencoding or autoregressive pre-training objectives, which makes them…

Quantitative Methods · Quantitative Biology 2024-12-10 Bo Chen , Xingyi Cheng , Pan Li , Yangli-ao Geng , Jing Gong , Shen Li , Zhilei Bei , Xu Tan , Boyan Wang , Xin Zeng , Chiming Liu , Aohan Zeng , Yuxiao Dong , Jie Tang , Le Song

Large Language models (LLMs) have emerged as powerful tools for addressing challenges across diverse domains. Notably, recent studies have demonstrated that large language models significantly enhance the efficiency of biomolecular analysis…

Computation and Language · Computer Science 2025-03-07 Jiyue Jiang , Zikang Wang , Yuheng Shan , Heyan Chai , Jiayi Li , Zixian Ma , Xinrui Zhang , Yu Li

Unlocking deep and interpretable biological reasoning from complex genomic data remains a major AI challenge limiting scientific progress. While current DNA foundation models excel at representing sequences, they struggle with multi-step…

Biological function emerges from coupled constraints across sequence, structure, regulation, evolution, and cellular context, yet most foundation models in biology are trained within one modality or for a fixed forward task. We present…

Discovering genes with similar functions across diverse biomedical contexts poses a significant challenge in gene representation learning due to data heterogeneity. In this study, we resolve this problem by introducing a novel model called…

Machine Learning · Computer Science 2023-10-05 Tianyu Liu , Yuge Wang , Rex Ying , Hongyu Zhao