English
Related papers

Related papers: Single Cells Are Spatial Tokens: Transformers for …

200 papers

Single-cell RNA sequencing (scRNA-seq) enables high-resolution analysis of cellular heterogeneity, but its complexity, which is marked by high dimensionality, sparsity, and batch effects, which poses major computational challenges.…

Computation and Language · Computer Science 2026-03-25 Cong Qi , Hanzhang Fang , Siqi Jiang , Xun Song , Tianxing Hu , Wei Zhi

Many real-world problems can be naturally described by mathematical formulas. The task of finding formulas from a set of observed inputs and outputs is called symbolic regression. Recently, neural networks have been applied to symbolic…

Machine Learning · Computer Science 2022-10-24 Martin Vastl , Jonáš Kulhánek , Jiří Kubalík , Erik Derner , Robert Babuška

Learning from limited data is challenging because data scarcity leads to a poor generalization of the trained model. A classical global pooled representation will probably lose useful local information. Many few-shot learning methods have…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Haoxing Chen , Huaxiong Li , Yaohui Li , Chunlin Chen

Mapping spatial distributions of transcriptomic cell types is essential to understanding the brain, with its exceptional cellular heterogeneity and the functional significance of its spatial organization. Spatial transcriptomics techniques…

Neurons and Cognition · Quantitative Biology 2023-01-23 Brian Long , Jeremy Miller , The SpaceTx Consortium

Most approaches for semantic segmentation use only information from color cameras to parse the scenes, yet recent advancements show that using depth data allows to further improve performances. In this work, we focus on transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Francesco Barbato , Giulia Rizzoli , Pietro Zanuttigh

Enabling image generation models to be spatially controlled is an important area of research, empowering users to better generate images according to their own fine-grained specifications via e.g. edge maps, poses. Although this task has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Guoxuan Xia , Harleen Hanspal , Petru-Daniel Tudosiu , Shifeng Zhang , Sarah Parisot

Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell…

Quantitative Methods · Quantitative Biology 2026-02-17 Zhenglun Kong , Mufan Qiu , John Boesen , Xiang Lin , Sukwon Yun , Tianlong Chen , Manolis Kellis , Marinka Zitnik

Multivariate long-term time series forecasting is of great application across many domains, such as energy consumption and weather forecasting. With the development of transformer-based methods, the performance of multivariate long-term…

Machine Learning · Computer Science 2023-05-29 Zheng Sun , Yi Wei , Wenxiao Jia , Long Yu

The spatial positioning of chromosomes relative to functional nuclear bodies is intertwined with genome functions such as transcription. However, the sequence patterns and epigenomic features that collectively influence chromatin spatial…

Genomics · Quantitative Biology 2023-07-04 Muyu Yang , Jian Ma

Deep learning has proven to successfully learn variations in tissue and cell morphology. Training of such models typically relies on expensive manual annotations. Here we conjecture that spatially resolved gene expression, e.i., the…

Quantitative Methods · Quantitative Biology 2023-12-11 Axel Andersson , Gabriele Partel , Leslie Solorzano , Carolina Wählby

Single-cell technologies have revolutionized biomedical research by enabling scalable measurement of the genome, transcriptome, and proteome of multiple systems at single-cell resolution. Now widely applied to cancer models, these assays…

Genomics · Quantitative Biology 2020-05-05 Allen W Zhang , Kieran R Campbell

Utilizing transformer architectures for semantic segmentation of high-resolution images is hindered by the attention's quadratic computational complexity in the number of tokens. A solution to this challenge involves decreasing the number…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Daniel Kienzle , Marco Kantonis , Robin Schön , Rainer Lienhart

Datasets from single-molecule experiments often reflect a large variety of molecular behaviour. The exploration of such datasets can be challenging, especially if knowledge about the data is limited and a priori assumptions about expected…

Data Analysis, Statistics and Probability · Physics 2020-04-06 Anton Vladyka , Tim Albrecht

We investigate image segmentation of cells under the lens of scalar fields. Our goal is to learn a continuous scalar field on image domains such that its segmentation produces robust instances for cells present in images. This field is a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Kevin I. Ruiz Vargas , Gabriel G. Galdino , Tsang Ing Ren , Alexandre L. Cunha

Spatial Transcriptomics is a groundbreaking technology that integrates histology images with spatially resolved gene expression profiles. Among the various Spatial Transcriptomics techniques available, Visium has emerged as the most widely…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Daniela Ruiz , Paula Cárdenas , Leonardo Manrique , Daniela Vega , Gabriel M. Mejia , Pablo Arbeláez

Labeled sequence transduction is a task of transforming one sequence into another sequence that satisfies desiderata specified by a set of labels. In this paper we propose multi-space variational encoder-decoders, a new model for labeled…

Computation and Language · Computer Science 2019-10-08 Chunting Zhou , Graham Neubig

scRNA-seq clustering is a critical task for analyzing single-cell RNA sequencing (scRNA-seq) data, as it groups cells with similar gene expression profiles. Transformers, as powerful foundational models, have been applied to scRNA-seq…

Machine Learning · Computer Science 2026-02-10 Zhuomin Liang , Liang Bai , Xian Yang

Spatial transcriptomics is an emerging field that enables the identification of functional regions based on the spatial distribution of gene expression. Integrating this functional information present in transcriptomic data with structural…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Shanaka Liyanaarachchi , Chathurya Wijethunga , Shihab Aaqil Ahamed , Akthas Absar , Ranga Rodrigo

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often struggle with rigid…

Artificial Intelligence · Computer Science 2025-08-20 Jiayu Fang , Zhiqi Shao , S T Boris Choy , Junbin Gao

Recent advancements in transformer-based models have greatly improved time series analysis, providing robust solutions for tasks such as forecasting, anomaly detection, and classification. A crucial element of these models is positional…

Machine Learning · Computer Science 2026-05-07 Habib Irani , Vangelis Metsis