English
Related papers

Related papers: GeoGLUE: A GeoGraphic Language Understanding Evalu…

200 papers

Empirical methods in geoparsing have thus far lacked a standard evaluation framework describing the task, metrics and data used to compare state-of-the-art systems. Evaluation is further made inconsistent, even unrepresentative of…

Computation and Language · Computer Science 2019-09-17 Milan Gritta , Mohammad Taher Pilehvar , Nigel Collier

Evaluating the performance of various model architectures, such as transformers, large language models (LLMs), and other NLP systems, requires comprehensive benchmarks that measure performance across multiple dimensions. Among these, the…

Computation and Language · Computer Science 2025-12-29 Duygu Altinok

We present OpenGlue: a free open-source framework for image matching, that uses a Graph Neural Network-based matcher inspired by SuperGlue \cite{sarlin20superglue}. We show that including additional geometrical information, such as local…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Ostap Viniavskyi , Mariia Dobko , Dmytro Mishkin , Oles Dobosevych

Large Language Models (LLMs) are increasingly deployed in applications that interact with the physical world, such as navigation, robotics, or mapping, making robust geospatial reasoning a critical capability. Despite that, LLMs' ability to…

Artificial Intelligence · Computer Science 2026-02-19 Thinh Hung Truong , Jey Han Lau , Jianzhong Qi

Large language models (LLMs) have showcased remarkable capabilities in understanding and generating language. However, their ability in comprehending ancient languages, particularly ancient Chinese, remains largely unexplored. To bridge…

Computation and Language · Computer Science 2023-10-17 Yixuan Zhang , Haonan Li

Cross-view geo-localisation identifies coarse geographical position of an automated vehicle by matching a ground-level image to a geo-tagged satellite image from a database. Despite the advancements in Cross-view geo-localisation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Barkin Dagda , Muhammad Awais , Saber Fallah

Geographic Question Answering (GeoQA) addresses natural language queries in geographic domains to fulfill complex user demands and improve information retrieval efficiency. Traditional QA systems, however, suffer from limited comprehension,…

Information Retrieval · Computer Science 2025-04-04 Jian Wang , Zhuo Zhao , Zeng Jie Wang , Bo Da Cheng , Lei Nie , Wen Luo , Zhao Yuan Yu , Ling Wang Yuan

English Natural Language Understanding (NLU) systems have achieved great performances and even outperformed humans on benchmarks like GLUE and SuperGLUE. However, these benchmarks contain only textbook Standard American English (SAE). Other…

Computation and Language · Computer Science 2022-09-14 Caleb Ziems , Jiaao Chen , Camille Harris , Jessica Anderson , Diyi Yang

By employing large language models (LLMs) to retrieve documents and generate natural language responses, Generative Engines, such as Google AI overview and ChatGPT, provide significantly enhanced user experiences and have rapidly become the…

Information Retrieval · Computer Science 2025-10-14 Yujiang Wu , Shanshan Zhong , Yubin Kim , Chenyan Xiong

Geospatial Knowledge Graphs (GeoKGs) model geoentities (e.g., places and natural features) and spatial relationships in an interconnected manner, providing strong knowledge support for geographic applications, including data retrieval,…

Artificial Intelligence · Computer Science 2024-10-25 Lei Hu , Wenwen Li , Yunqiang Zhu

Spoken language understanding (SLU) tasks have been studied for many decades in the speech research community, but have not received as much attention as lower-level tasks like speech and speaker recognition. In particular, there are not…

Computation and Language · Computer Science 2023-06-19 Suwon Shon , Siddhant Arora , Chyi-Jiunn Lin , Ankita Pasad , Felix Wu , Roshan Sharma , Wei-Lun Wu , Hung-Yi Lee , Karen Livescu , Shinji Watanabe

Worldwide geo-localization involves determining the exact geographic location of images captured globally, typically guided by geographic cues such as climate, landmarks, and architectural styles. Despite advancements in geo-localization…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Furong Jia , Lanxin Liu , Ce Hou , Fan Zhang , Xinyan Liu , Yu Liu

Recent research has shown that integrating domain knowledge into deep learning architectures is effective -- it helps reduce the amount of required data, improves the accuracy of the models' decisions, and improves the interpretability of…

This paper proposes MapGPT which is a novel approach that integrates the capabilities of language models, specifically large language models (LLMs), with spatial data processing techniques. This paper introduces MapGPT, which aims to bridge…

Artificial Intelligence · Computer Science 2023-10-19 Ashley Fernandez , Swaraj Dube

Cross-View Geo-Localization (CVGL) focuses on identifying correspondences between images captured from distinct perspectives of the same geographical location. However, existing CVGL approaches are typically restricted to a single view or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xudong Lu , Zhi Zheng , Yi Wan , Yongxiang Yao , Annan Wang , Renrui Zhang , Panwang Xia , Qiong Wu , Qingyun Li , Weifeng Lin , Xiangyu Zhao , Peifeng Ma , Xue Yang , Hongsheng Li

Geometric problem solving constitutes a critical branch of mathematical reasoning, requiring precise analysis of shapes and spatial relationships. Current evaluations of geometric reasoning in vision-language models (VLMs) face limitations,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yuan Feng , Yue Yang , Xiaohan He , Jiatong Zhao , Jianlong Chen , Zijun Chen , Daocheng Fu , Qi Liu , Renqiu Xia , Bo Zhang , Junchi Yan

Evaluation plays a significant role in modern natural language processing. Most modern NLP benchmarks consist of arbitrary sets of tasks that neither guarantee any generalization potential for the model once applied outside the test set nor…

Computation and Language · Computer Science 2024-02-27 Maxim K. Surkov , Ivan P. Yamshchikov

Historical maps contain rich geographic information about the past of a region. They are sometimes the only source of information before the availability of digital maps. Despite their valuable content, it is often challenging to access and…

Information Retrieval · Computer Science 2020-12-08 Kai Sun , Yingjie Hu , Jia Song , Yunqiang Zhu

Artificial Intelligence (AI), along with the recent progress in biomedical language understanding, is gradually changing medical practice. With the development of biomedical language understanding benchmarks, AI applications are widely used…

Privacy policies provide individuals with information about their rights and how their personal information is handled. Natural language understanding (NLU) technologies can support individuals and practitioners to understand better privacy…

Computation and Language · Computer Science 2023-05-15 Jianfeng Chi , Wasi Uddin Ahmad , Yuan Tian , Kai-Wei Chang