English
Related papers

Related papers: Spatial Coordinates as a Cell Language: A Multi-Se…

200 papers

Sequential sentence classification (SSC) in scientific publications is crucial for supporting downstream tasks such as fine-grained information retrieval and extractive summarization. However, current SSC methods are constrained by model…

Computation and Language · Computer Science 2024-12-02 Mengfei Lan , Lecheng Zheng , Shufan Ming , Halil Kilicoglu

In order to understand the complexities of cellular biology, researchers are interested in two important metrics: the genetic expression information of cells and their spatial coordinates within a tissue sample. However, state-of-the art…

Machine Learning · Computer Science 2023-11-02 J. Ding , S. N. Zaman , P. Y. Chen , D. Wang

Understanding spatial relations is a crucial cognitive ability for both humans and AI. While current research has predominantly focused on the benchmarking of text-to-image (T2I) models, we propose a more comprehensive evaluation that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Shang Hong Sim , Clarence Lee , Alvin Tan , Cheston Tan

Sequence models have demonstrated the ability to perform tasks like channel equalization and symbol detection by automatically adapting to current channel conditions. This is done without requiring any explicit optimization and by…

Signal Processing · Electrical Eng. & Systems 2024-11-01 Zihang Song , Matteo Zecchin , Bipin Rajendran , Osvaldo Simeone

State space models (SSMs) have recently achieved strong performance on long sequence modeling tasks while offering improved memory and computational efficiency compared to transformer based architectures. However, their evaluation has been…

Machine Learning · Computer Science 2026-03-13 Fatemeh Valeh , Monika Farsang , Radu Grosu , Gerhard Schütz

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced performance on 2D visual tasks. However, improving their spatial intelligence remains a challenge. Existing 3D MLLMs always rely on additional 3D or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Diankun Wu , Fangfu Liu , Yi-Hsin Hung , Yueqi Duan

Multimodal Small-to-Medium sized Language Models (MSLMs) have demonstrated strong capabilities in integrating visual and textual information but still face significant limitations in visual comprehension and mathematical reasoning,…

Machine Learning · Computer Science 2026-01-27 Ashutosh Bajpai , Akshat Bhandari , Akshay Nambi , Tanmoy Chakraborty

Effective image and sentence matching depends on how to well measure their global visual-semantic similarity. Based on the observation that such a global similarity arises from a complex aggregation of multiple local similarities between…

Computer Vision and Pattern Recognition · Computer Science 2017-12-07 Yan Huang , Wei Wang , Liang Wang

General Multimodal Large Language Models (MLLMs) often underperform in capturing domain-specific nuances in medical diagnosis, trailing behind fully supervised baselines. Although fine-tuning provides a remedy, the high costs of expert…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Wenkai Zhao , Zipei Wang , Mengjie Fang , Di Dong , Jie Tian , Lingwei Zhang

The development of single-cell and spatial transcriptomics has revolutionized our capacity to investigate cellular properties, functions, and interactions in both cellular and spatial contexts. However, the analysis of single-cell and…

Genomics · Quantitative Biology 2024-12-09 Shuang Ge , Shuqing Sun , Huan Xu , Qiang Cheng , Zhixiang Ren

We propose SpatialLLM, a novel approach advancing spatial intelligence tasks in complex urban scenes. Unlike previous methods requiring geographic analysis tools or domain expertise, SpatialLLM is a unified language model directly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Jiabin Chen , Haiping Wang , Jinpeng Li , Yuan Liu , Zhen Dong , Bisheng Yang

Single-cell foundation models such as scGPT represent a significant advancement in single-cell omics, with an ability to achieve state-of-the-art performance on various downstream biological tasks. However, these models are inherently…

Machine Learning · Computer Science 2025-07-15 Steven Palayew , Bo Wang , Gary Bader

State-space models (SSMs) have recently attention as an efficient alternative to computationally expensive attention-based models for sequence modeling. They rely on linear recurrences to integrate information over time, enabling fast…

Machine Learning · Computer Science 2026-01-01 Mahdi Karami , Ali Behrouz , Peilin Zhong , Razvan Pascanu , Vahab Mirrokni

The rapid evolution of large language models (LLMs) holds promise for reforming the methodology of spatio-temporal data mining. However, current works for evaluating the spatio-temporal understanding capability of LLMs are somewhat limited…

Computation and Language · Computer Science 2024-06-28 Wenbin Li , Di Yao , Ruibo Zhao , Wenjie Chen , Zijie Xu , Chengxue Luo , Chang Gong , Quanliang Jing , Haining Tan , Jingping Bi

Multi-modal large language models (MLLMs) have rapidly advanced in visual tasks, yet their spatial understanding remains limited to single images, leaving them ill-suited for physical-world applications that require multi-frame reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Runsen Xu , Weiyao Wang , Hao Tang , Xingyu Chen , Xiaodong Wang , Fu-Jen Chu , Matt Feiszli , Kevin J. Liang

Although large multimodal models (LMMs) have demonstrated remarkable capabilities in visual scene interpretation and reasoning, their capacity for complex and precise 3-dimensional spatial reasoning remains uncertain. Existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Xingrui Wang , Wufei Ma , Tiezheng Zhang , Celso M de Melo , Jieneng Chen , Alan Yuille

Understanding the intricate cellular environment within biological tissues is crucial for uncovering insights into complex biological functions. While single-cell RNA sequencing has significantly enhanced our understanding of cellular…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Bingjun Li , Mostafa Karami , Masum Shah Junayed , Sheida Nabavi

Spatial relation reasoning is a crucial task for multimodal large language models (MLLMs) to understand the objective world. However, current benchmarks have issues like relying on bounding boxes, ignoring perspective substitutions, or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jingping Liu , Ziyan Liu , Zhedong Cen , Yan Zhou , Yinan Zou , Weiyan Zhang , Haiyun Jiang , Tong Ruan

In digital pathology, both detection and classification of cells are important for automatic diagnostic and prognostic tasks. Classifying cells into subtypes, such as tumor cells, lymphocytes or stromal cells is particularly challenging.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Shahira Abousamra , David Belinsky , John Van Arnam , Felicia Allard , Eric Yee , Rajarsi Gupta , Tahsin Kurc , Dimitris Samaras , Joel Saltz , Chao Chen

Large language models (LLMs) and emerging agentic frameworks are beginning to transform single-cell biology by enabling natural-language reasoning, generative annotation, and multimodal data integration. However, progress remains fragmented…

Computation and Language · Computer Science 2025-11-25 Sajib Acharjee Dip , Adrika Zafor , Bikash Kumar Paul , Uddip Acharjee Shuvo , Muhit Islam Emon , Xuan Wang , Liqing Zhang
‹ Prev 1 2 3 10 Next ›