English
Related papers

Related papers: A Dataset for Spatiotemporal-Sensitive POI Questio…

200 papers

Interpretable communication is essential for safe and trustworthy autonomous driving, yet current vision-language models (VLMs) often operate under idealized assumptions and struggle to capture user intent in real-world scenarios. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Djamahl Etchegaray , Yuxia Fu , Zi Huang , Yadan Luo

Answers to the same question may change depending on the extra-linguistic contexts (when and where the question was asked). To study this challenge, we introduce SituatedQA, an open-retrieval QA dataset where systems must produce the…

Computation and Language · Computer Science 2021-09-14 Michael J. Q. Zhang , Eunsol Choi

This paper presents MobQA, a benchmark dataset designed to evaluate the semantic understanding capabilities of large language models (LLMs) for human mobility data through natural language question answering. While existing models excel at…

Computation and Language · Computer Science 2025-08-18 Hikaru Asano , Hiroki Ouchi , Akira Kasuga , Ryo Yonetani

Vision-Language Models (VLMs) have been applied to autonomous driving to support decision-making in complex real-world scenarios. However, their training on static, web-sourced image-text pairs fundamentally limits the precise…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Keishi Ishihara , Kento Sasaki , Tsubasa Takahashi , Daiki Shiono , Yu Yamaguchi

Large Language Models (LLMs) have made significant progress in recent years, achieving remarkable results in question-answering tasks (QA). However, they still face two major challenges: hallucination and outdated information after the…

Answering real-world tourism questions that seek Point-of-Interest (POI) recommendations is challenging, as it requires both spatial and non-spatial reasoning, over a large candidate pool. The traditional method of encoding each pair of…

Computation and Language · Computer Science 2024-01-05 Haonan Li , Martin Tomko , Timothy Baldwin

Large language models (LLMs) have shown nearly saturated performance on many natural language processing (NLP) tasks. As a result, it is natural for people to believe that LLMs have also mastered abilities such as time understanding and…

Computation and Language · Computer Science 2023-10-10 Yifan Wei , Yisong Su , Huanhuan Ma , Xiaoyan Yu , Fangyu Lei , Yuanzhe Zhang , Jun Zhao , Kang Liu

Machine reading is a fundamental task for testing the capability of natural language understanding, which is closely related to human cognition in many aspects. With the rising of deep learning techniques, algorithmic models rival human…

Computation and Language · Computer Science 2020-07-17 Jian Liu , Leyang Cui , Hanmeng Liu , Dandan Huang , Yile Wang , Yue Zhang

Understanding human mobility through Point-of-Interest (POI) trajectory modeling is increasingly important for applications such as urban planning, personalized services, and generative agent simulation. However, progress in this field is…

Machine Learning · Computer Science 2026-02-11 Wilson Wongso , Hao Xue , Flora D. Salim

Next Point-of-Interest (POI) recommendation is a critical task in location-based services, yet it faces the fundamental challenge of coupled spatiotemporal asymmetry inherent in urban mobility. Specifically, transition intents between…

Machine Learning · Computer Science 2026-03-03 Zhuoxuan Li , Tangwei Ye , Jieyuan Pei , Haina Liang , Zhongyuan Lai , Zihan Liu , Yiming Wu , Qi Zhang , Liang Hu

The rapid progress of Multimodal Large Language Models (MLLMs) has unlocked the potential for enhanced 3D scene understanding and spatial reasoning. A recent line of work explores learning spatial reasoning directly from multi-view images,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Kanghee Lee , Injae Lee , Minseok Kwak , Jungi Hong , Kwonyoung Ryu , Jaesik Park

With the rapid growth of location-based social networks (LBSNs), Point-Of-Interest (POI) recommendation has been broadly studied in this decade. Recently, the next POI recommendation, a natural extension of POI recommendation, has attracted…

Information Retrieval · Computer Science 2021-07-01 Yang Li , Yadan Luo , Zheng Zhang , Shazia W. Sadiq , Peng Cui

Vision-language models (VLMs) work well in tasks ranging from image captioning to visual question answering (VQA), yet they struggle with spatial reasoning, a key skill for understanding our physical world that humans excel at. We find that…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Michael Ogezi , Freda Shi

Humans gather information by engaging in conversations involving a series of interconnected questions and answers. For machines to assist in information gathering, it is therefore essential to enable them to answer conversational questions.…

Computation and Language · Computer Science 2019-04-02 Siva Reddy , Danqi Chen , Christopher D. Manning

As a core task in location-based services (LBS) (e.g., navigation maps), query and point of interest (POI) matching connects users' intent with real-world geographic information. Recently, pre-trained models (PTMs) have made advancements in…

Computation and Language · Computer Science 2023-05-25 Ruixue Ding , Boli Chen , Pengjun Xie , Fei Huang , Xin Li , Qiang Zhang , Yao Xu

Existing question answering (QA) datasets are no longer challenging to most powerful Large Language Models (LLMs). Traditional QA benchmarks like TriviaQA, NaturalQuestions, ELI5 and HotpotQA mainly study ``known unknowns'' with clear…

Computation and Language · Computer Science 2024-02-29 Corby Rosset , Ho-Lam Chung , Guanghui Qin , Ethan C. Chau , Zhuo Feng , Ahmed Awadallah , Jennifer Neville , Nikhil Rao

Recent benchmarks and datasets have been proposed to improve spatial reasoning in vision-language models (VLMs), yet existing open resources remain limited in scale, visual diversity, and instruction expressiveness. In this work, we…

While diverse question answering (QA) datasets have been proposed and contributed significantly to the development of deep learning models for QA tasks, the existing datasets fall short in two aspects. First, we lack QA datasets covering…

Computation and Language · Computer Science 2021-10-15 Qiyuan Zhang , Lei Wang , Sicheng Yu , Shuohang Wang , Yang Wang , Jing Jiang , Ee-Peng Lim

The pursuit of spatial intelligence fundamentally relies on access to large-scale, fine-grained 3D data. However, existing approaches predominantly construct spatial understanding benchmarks by generating question-answer (QA) pairs from a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yuanyuan Gao , Hao Li , Yifei Liu , Xinhao Ji , Yuning Gong , Yuanjun Liao , Fangfu Liu , Manyuan Zhang , Yuchen Yang , Dan Xu , Xue Yang , Huaxi Huang , Hongjie Zhang , Ziwei Liu , Xiao Sun , Dingwen Zhang , Zhihang Zhong

Spatio-temporal forecasting is crucial in transportation, logistics, and supply chain management. However, current methods struggle with large, complex datasets. We propose a dynamic, multi-modal approach that integrates the strengths of…

Machine Learning · Computer Science 2024-08-27 Sagar Srinivas Sakhinana , Geethan Sannidhi , Chidaksh Ravuru , Venkataramana Runkana