English
Related papers

Related papers: stEnTrans: Transformer-based deep learning for spa…

200 papers

While deep learning has revolutionized research and applications in NLP and computer vision, this has not yet been the case for behavioral modeling and behavioral health applications. This is because the domain's datasets are smaller, have…

Machine Learning · Computer Science 2021-07-14 Mike A. Merrill , Tim Althoff

We propose a new positional encoding method for a neural network architecture called the Transformer. Unlike the standard sinusoidal positional encoding, our approach is based on solid mathematical grounds and has a guarantee of not losing…

Machine Learning · Computer Science 2024-05-17 Tsuyoshi Idé , Jokin Labaien , Pin-Yu Chen

Plant phenotyping focuses on the measurement of plant characteristics throughout the growing season, typically with the goal of evaluating genotypes for plant breeding. Estimating plant location is important for identifying genotypes which…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Enyu Cai , Sriram Baireddy , Changye Yang , Melba Crawford , Edward J. Delp

Spatial studies of transcriptome provide biologists with gene expression maps of heterogeneous and complex tissues. However, most experimental protocols for spatial transcriptomics suffer from the need to select beforehand a small fraction…

Machine Learning · Computer Science 2019-05-08 Romain Lopez , Achille Nazaret , Maxime Langevin , Jules Samaran , Jeffrey Regier , Michael I. Jordan , Nir Yosef

Understanding the dynamic nature of protein structures is essential for comprehending their biological functions. While significant progress has been made in predicting static folded structures, modeling protein motions on microsecond to…

The location, timing, and abundance of gene expression (both mRNA and proteins) within a tissue define the molecular mechanisms of cell functions. Recent technology breakthroughs in spatial molecular profiling, including imaging-based…

Applications · Statistics 2020-12-10 Qiwei Li , Minzhe Zhang , Yang Xie , Guanghua Xiao

Transformer-based models have achieved remarkable success in natural language and vision tasks, but their application to gene expression analysis remains limited due to data sparsity, high dimensionality, and missing values. We present…

Machine Learning · Computer Science 2025-04-15 Shuai Jiang , Saeed Hassanpour

Steady-state visual evoked potential (SSVEP) is one of the most commonly used control signal in the brain-computer interface (BCI) systems. However, the conventional spatial filtering methods for SSVEP classification highly depend on the…

Neurons and Cognition · Quantitative Biology 2022-10-11 Jianbo Chen , Yangsong Zhang , Yudong Pan , Peng Xu , Cuntai Guan

Spatial transcriptomics (ST) has revolutionized biomedical research by enabling high resolution gene expression profiling within tissues. However, the high cost and scarcity of high resolution ST data remain significant challenges. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yaoyu Fang , Jiahe Qian , Xinkun Wang , Lee A. Cooper , Bo Zhou

Adapting Deep Learning (DL) techniques to automate non-trivial coding activities, such as code documentation and defect detection, has been intensively studied recently. Learning to predict code changes is one of the popular and essential…

Software Engineering · Computer Science 2022-08-02 Shiyi Qi , Yaoxian Li , Cuiyun Gao , Xiaohong Su , Shuzheng Gao , Zibin Zheng , Chuanyi Liu

Position emission tomography (PET) is widely used in clinics and research due to its quantitative merits and high sensitivity, but suffers from low signal-to-noise ratio (SNR). Recently convolutional neural networks (CNNs) have been widely…

Image and Video Processing · Electrical Eng. & Systems 2023-12-12 Se-In Jang , Tinsu Pan , Ye Li , Pedram Heidari , Junyu Chen , Quanzheng Li , Kuang Gong

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

Accurate segmentation of organs or lesions from medical images is crucial for reliable diagnosis of diseases and organ morphometry. In recent years, convolutional encoder-decoder solutions have achieved substantial progress in the field of…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Bingzhi Chen , Yishu Liu , Zheng Zhang , Guangming Lu , Adams Wai Kin Kong

Flow-guided Localization (FGL) enables the identification of spatial regions within the human body that contain an event of diagnostic interest. FGL does that by leveraging the passive movement of energy-constrained nanodevices circulating…

Emerging Technologies · Computer Science 2025-08-25 Mika Leo Hube , Filip Lemic , Ethungshan Shitiri , Gerard Calvo Bartra , Sergi Abadal , Xavier Costa Pérez

The field of steganography has experienced a surge of interest due to the recent advancements in AI-powered techniques, particularly in the context of multimodal setups that enable the concealment of signals within signals of a different…

Cryptography and Security · Computer Science 2023-03-16 Jaume Ros , Margarita Geleta , Jordi Pons , Xavier Giro-i-Nieto

Spatial grounding, the process of associating natural language expressions with corresponding image regions, has rapidly advanced due to the introduction of transformer-based models, significantly enhancing multimodal representation and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Ijazul Haq , Muhammad Saqib , Yingjie Zhang

Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks. However, most systems do not fully utilize spatial information. In this paper, we propose a target speech extraction…

Sound · Computer Science 2023-06-29 Aoqi Guo , Junnan Wu , Peng Gao , Wenbo Zhu , Qinwen Guo , Dazhi Gao , Yujun Wang

Unlike other vision tasks where Transformer-based approaches are becoming increasingly common, stereo depth estimation is still dominated by convolution-based approaches. This is mainly due to the limited availability of real-world ground…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Soomin Kim , Hyesong Choi , Jihye Ahn , Dongbo Min

The technology to generate Spatially Resolved Transcriptomics (SRT) data is rapidly being improved and applied to investigate a variety of biological tissues. The ability to interrogate how spatially localised gene expression can lend new…

Quantitative Methods · Quantitative Biology 2021-08-04 Natalie Charitakis , Mirana Ramialison , Hieu T. Nim

Spatially Resolved Transcriptomics (SRT) is a cutting-edge technique that captures the spatial context of cells within tissues, enabling the study of complex biological networks. Recent graph-based methods leverage both gene expression and…

Machine Learning · Computer Science 2025-06-24 Yunhak Oh , Junseok Lee , Yeongmin Kim , Sangwoo Seo , Namkyeong Lee , Chanyoung Park