English
Related papers

Related papers: Cell-ontology guided transcriptome foundation mode…

200 papers

Foundation models for single-cell RNA sequencing (scRNA-seq) have shown promising capabilities in capturing gene expression patterns. However, current approaches face critical limitations: they ignore biological prior knowledge encoded in…

Machine Learning · Computer Science 2025-03-04 Mufan Qiu , Xinyu Hu , Fengwei Zhan , Sukwon Yun , Jie Peng , Ruichen Zhang , Bhavya Kailkhura , Jiekun Yang , Tianlong Chen

Multi-omics research has enhanced our understanding of cancer heterogeneity and progression. Investigating molecular data through multi-omics approaches is crucial for unraveling the complex biological mechanisms underlying cancer, thereby…

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

The transformers have achieved significant accomplishments in the natural language processing as its outstanding parallel processing capabilities and highly flexible attention mechanism. In addition, increasing studies based on transformers…

Computation and Language · Computer Science 2024-07-19 Wei Lan , Guohang He , Mingyang Liu , Qingfeng Chen , Junyue Cao , Wei Peng

Non-coding RNA structure and function are essential to understanding various biological processes, such as cell signaling, gene expression, and post-transcriptional regulations. These are all among the core problems in the RNA field. With…

Quantitative Methods · Quantitative Biology 2022-08-09 Jiayang Chen , Zhihang Hu , Siqi Sun , Qingxiong Tan , Yixuan Wang , Qinze Yu , Licheng Zong , Liang Hong , Jin Xiao , Tao Shen , Irwin King , Yu Li

Accurate molecular property prediction is central to drug discovery, catalysis, and process design, yet real-world applications are often limited by small datasets. Molecular foundation models provide a promising direction by learning…

Machine Learning · Computer Science 2026-04-21 Karim K. Ben Hicham , Jan G. Rittig , Martin Grohe , Alexander Mitsos

Large pre-trained models with their numerous model parameters and extensive training datasets have shown excellent performance in various tasks. Many publicly available medical image datasets do not have a sufficient amount of data so there…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Jianhao Xie , Ziang Zhang , Guibo Luo , Yuesheng Zhu

Modeling cellular states and predicting their responses to perturbations are central challenges in computational biology and the development of virtual cells. Existing foundation models for single-cell transcriptomics provide powerful…

Quantitative Methods · Quantitative Biology 2026-03-31 Han Zhang , Guo-Hua Yuan , Chaohao Yuan , Tingyang Xu , Tian Bian , Hong Cheng , Wenbing Huang , Deli Zhao , Yu Rong

The development of single-cell and spatial transcriptomics has revolutionized our capacity to investigate cellular properties, functions, and interactions in both cellular and spatial contexts. However, the analysis of single-cell and…

Genomics · Quantitative Biology 2024-12-09 Shuang Ge , Shuqing Sun , Huan Xu , Qiang Cheng , Zhixiang Ren

Existing domain-specific Large Language Models (LLMs) are typically developed by fine-tuning general-purposed LLMs with large-scale domain-specific corpora. However, training on large-scale corpora often fails to effectively organize domain…

Computation and Language · Computer Science 2025-02-11 Zhiqiang Liu , Chengtao Gan , Junjie Wang , Yichi Zhang , Zhongpu Bo , Mengshu Sun , Huajun Chen , Wen Zhang

Foundation models have revolutionized natural language processing and artificial intelligence, significantly enhancing how machines comprehend and generate human languages. Inspired by the success of these foundation models, researchers…

Recently, data-centric AI methodology has been a dominant paradigm in single-cell transcriptomics analysis, which treats data representation rather than model complexity as the fundamental bottleneck. In the review of current studies,…

Machine Learning · Computer Science 2026-05-08 Ru Zhang , Xunkai Li , Yaxin Deng , Sicheng Liu , Daohan Su , Qiangqiang Dai , Hongchao Qin , Rong-Hua Li , Guoren Wang , Jia Li

Single-cell trajectory analysis aims to reconstruct the biological developmental processes of cells as they evolve over time, leveraging temporal correlations in gene expression. During cellular development, gene expression patterns…

Applications · Statistics 2026-03-30 Junhao Zhu , Kevin Zhang , Zhaolei Zhang , Dehan Kong

Proteins, essential to biological systems, perform functions intricately linked to their three-dimensional structures. Understanding the relationship between protein structures and their amino acid sequences remains a core challenge in…

Quantitative Methods · Quantitative Biology 2024-11-04 Liang He , Peiran Jin , Yaosen Min , Shufang Xie , Lijun Wu , Tao Qin , Xiaozhuan Liang , Kaiyuan Gao , Yuliang Jiang , Tie-Yan Liu

Biological neural networks are shaped both by evolution across generations and by individual learning within an organism's lifetime, whereas standard artificial neural networks undergo a single, large training procedure without inherited…

Machine Learning · Computer Science 2025-05-01 Klemen Kotar , Greta Tuckute

Unsupervised cell type identification is crucial for uncovering and characterizing heterogeneous populations in single cell omics studies. Although a range of clustering methods have been developed, most focus exclusively on intrinsic…

Artificial Intelligence · Computer Science 2025-12-12 Liang Peng , Haopeng Liu , Yixuan Ye , Cheng Liu , Wenjun Shen , Si Wu , Hau-San Wong

When reliable target structures are unavailable at scale or phenotypes arise from dysregulated pathways, transcriptomic perturbations provide a system-level functional readout for drug action. In this work, we formalize…

Machine Learning · Computer Science 2026-05-18 Ziyu Xu , Zijian Zhang , Liang Wang , Zhiyuan Liu , Qiang Liu , Shu Wu , Liang Wang

We present a systematic evaluation framework - thirty-seven analyses, 153 statistical tests, four cell types, two perturbation modalities - for assessing mechanistic interpretability in single-cell foundation models. Applying this framework…

Genomics · Quantitative Biology 2026-02-20 Ihor Kendiukhov

Fine-grained entity typing (FET), which assigns entities in text with context-sensitive, fine-grained semantic types, is a basic but important task for knowledge extraction from unstructured text. FET has been studied extensively in natural…

Computation and Language · Computer Science 2024-06-12 Tanay Komarlu , Minhao Jiang , Xuan Wang , Jiawei Han

Single-cell RNA sequencing (scRNA-seq) enables dissecting cellular heterogeneity in tissues, resulting in numerous biological discoveries. Various computational methods have been devised to delineate cell types by clustering scRNA-seq data…

Quantitative Methods · Quantitative Biology 2023-09-18 Tram Huynh , Zixuan Cang