English
Related papers

Related papers: Cell2Text: Multimodal LLM for Generating Single-Ce…

200 papers

Spatial transcriptomics has the potential to transform our understanding of RNA expression in tissues. Classical array-based technologies produce multiple-cell-scale measurements requiring deconvolution to recover single cell information.…

Large language models (LLMs) have shown growing promise in biomedical research, particularly for knowledge-driven interpretation tasks. However, their ability to reliably reason from gene-level knowledge to functional understanding, a core…

Genomics · Quantitative Biology 2026-05-25 Xiaohan Huang , Meng Xiao , Chuan Qin , Qingqing Long , Jinmiao Chen , Yuanchun Zhou , Hengshu Zhu

Feature modeling of different modalities is a basic problem in current research of cross-modal information retrieval. Existing models typically project texts and images into one embedding space, in which semantically similar information…

Multimedia · Computer Science 2019-06-13 Jing Yu , Chenghao Yang , Zengchang Qin , Zhuoqian Yang , Yue Hu , Weifeng Zhang

Recent advances in cellular research demonstrate that scRNA-seq characterizes cellular heterogeneity, while spatial transcriptomics reveals the spatial distribution of gene expression. Cell representation is the fundamental issue in the two…

Genomics · Quantitative Biology 2025-01-16 Kai Zheng , Shaokai Wang , Yunpei Xu , Qiming Lei , Qichang Zhao , Xiao Liang , Qilong Feng , Yaohang Li , Min Li , Jinhui Xu , Jianxin Wang

Large language models (LLMs) are transforming cellular biology by enabling the development of "virtual cells"--computational systems that represent, predict, and reason about cellular states and behaviors. This work provides a comprehensive…

Computation and Language · Computer Science 2025-10-10 Krinos Li , Xianglu Xiao , Shenglong Deng , Lucas He , Zijun Zhong , Yuanjie Zou , Zhonghao Zhan , Zheng Hui , Weiye Bao , Guang Yang

Recent developments in high throughput profiling of individual neurons have spurred data driven exploration of the idea that there exist natural groupings of neurons referred to as cell types. The promise of this idea is that the immense…

Neurons and Cognition · Quantitative Biology 2019-11-14 Rohan Gala , Nathan Gouwens , Zizhen Yao , Agata Budzillo , Osnat Penn , Bosiljka Tasic , Gabe Murphy , Hongkui Zeng , Uygar Sümbül

Single-cell gene expression measurements encode variability spanning molecular noise, cell-to-cell heterogeneity, and technical artifacts. Mechanistic stochastic models provide powerful approaches to disentangle these sources, yet inferring…

Quantitative Methods · Quantitative Biology 2025-09-19 Christopher E. Miles

The explosive growth of large language models (LLMs) has created a vast but opaque landscape: millions of models exist, yet their evolutionary relationships through fine-tuning, distillation, or adaptation are often undocumented or unclear,…

Machine Learning · Computer Science 2026-05-04 Zhaomin Wu , Haodong Zhao , Ziyang Wang , Jizhou Guo , Qian Wang , Bingsheng He

Multimodal large language models (MLLMs), building upon the foundation of powerful large language models (LLMs), have recently demonstrated exceptional capabilities in generating not only texts but also images given interleaved multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Bohao Li , Yuying Ge , Yixiao Ge , Guangzhi Wang , Rui Wang , Ruimao Zhang , Ying Shan

Automated data visualization plays a crucial role in simplifying data interpretation, enhancing decision-making, and improving efficiency. While large language models (LLMs) have shown promise in generating visualizations from natural…

Computation and Language · Computer Science 2025-07-29 Mizanur Rahman , Md Tahmid Rahman Laskar , Shafiq Joty , Enamul Hoque

Computational modeling of single-cell gene expression is crucial for understanding cellular processes, but generating realistic expression profiles remains a major challenge. This difficulty arises from the count nature of gene expression…

The rapid evolution of multimodal foundation model has demonstrated significant progresses in vision-language understanding and generation, e.g., our previous work SEED-LLaMA. However, there remains a gap between its capability and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yuying Ge , Sijie Zhao , Jinguo Zhu , Yixiao Ge , Kun Yi , Lin Song , Chen Li , Xiaohan Ding , Ying Shan

Text generation from semantic graphs is traditionally performed with deterministic methods, which generate a unique description given an input graph. However, the generation problem admits a range of acceptable textual outputs, exhibiting…

Computation and Language · Computer Science 2021-08-16 Jiuzhou Han , Daniel Beck , Trevor Cohn

Single-cell perturbation studies face dual heterogeneity bottlenecks: (i) semantic heterogeneity--identical biological concepts encoded under incompatible metadata schemas across datasets; and (ii) statistical heterogeneity--distribution…

Artificial Intelligence · Computer Science 2026-03-10 Wenxuan Huang , Mingyu Tsoi , Yanhao Huang , Xinjie Mao , Xue Xia , Hao Wu , Jiaqi Wei , Yuejin Yang , Lang Yu , Cheng Tan , Xiang Zhang , Zhangyang Gao , Siqi Sun

Predicting drug-induced cellular state changes at single-cell resolution remains a central challenge in virtual cell modeling, particularly under out-of-distribution (OOD) conditions. Current approaches predominantly rely on RNA-based…

Genomics · Quantitative Biology 2026-05-18 Peiting Shi , Ningfeng Que , Xianzhe Huang , Xiaofei Wang , Jianzhong Jeff Xi

Sequential sentence classification (SSC) in scientific publications is crucial for supporting downstream tasks such as fine-grained information retrieval and extractive summarization. However, current SSC methods are constrained by model…

Computation and Language · Computer Science 2024-12-02 Mengfei Lan , Lecheng Zheng , Shufan Ming , Halil Kilicoglu

We propose a method to fuse frozen text-only large language models (LLMs) with pre-trained image encoder and decoder models, by mapping between their embedding spaces. Our model demonstrates a wide suite of multimodal capabilities: image…

Computation and Language · Computer Science 2023-10-16 Jing Yu Koh , Daniel Fried , Ruslan Salakhutdinov

Automated single-cell annotation is difficult when the most abundant genes are not the most discriminative ones, or when a target state is poorly covered by a fixed reference atlas. GPTCelltype-style one-shot prompting allows large language…

Quantitative Methods · Quantitative Biology 2026-05-08 Yehui Yang , Zelin Zang , Xienan Zheng , Yuzhe Jia , Changxi Chi , Jingbo Zhou , Chang Yu , Jinlin Wu , Fuji Yang , Jiebo Luo , Zhen Lei , Stan Z. Li

Predicting cellular responses to genetic perturbations represents a fundamental challenge in systems biology, critical for advancing therapeutic discovery and virtual cell modeling. While large language models (LLMs) show promise for…

Single-cell RNA sequencing (scRNA-seq) has made significant strides in unraveling the intricate cellular diversity within complex tissues. This is particularly critical in the brain, presenting a greater diversity of cell types than other…

Machine Learning · Computer Science 2023-10-05 Gyutaek Oh , Baekgyu Choi , Inkyung Jung , Jong Chul Ye