English
Related papers

Related papers: StepGame: A New Benchmark for Robust Multi-Hop Spa…

200 papers

Multi-hop question answering requires models to gather information from different parts of a text to answer a question. Most current approaches learn to address this task in an end-to-end way with neural networks, without maintaining an…

Computation and Language · Computer Science 2021-06-08 Jifan Chen , Shih-ting Lin , Greg Durrett

Multimodal large language models (MLLMs) have achieved strong performance on perception-oriented tasks, yet their ability to perform mathematical spatial reasoning, defined as the capacity to parse and manipulate two- and three-dimensional…

Learning representations of spatial references in natural language is a key challenge in tasks like autonomous navigation and robotic manipulation. Recent work has investigated various neural architectures for learning multi-modal…

Computation and Language · Computer Science 2020-10-08 Tsung-Yen Yang , Andrew S. Lan , Karthik Narasimhan

"Thinking in pictures," [1] i.e., spatial-temporal reasoning, effortless and instantaneous for humans, is believed to be a significant ability to perform logical induction and a crucial factor in the intellectual history of technology…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Chi Zhang , Baoxiong Jia , Feng Gao , Yixin Zhu , Hongjing Lu , Song-Chun Zhu

Predicting the next activity in an ongoing process is one of the most common classification tasks in the business process management (BPM) domain. It allows businesses to optimize resource allocation, enhance operational efficiency, and…

Artificial Intelligence · Computer Science 2024-03-15 Alon Oved , Segev Shlomov , Sergey Zeltyn , Nir Mashkif , Avi Yaeli

Spatio-temporal reasoning in time series involves the explicit synthesis of temporal dynamics, spatial dependencies, and textual context. This capability is vital for high-stakes decision-making in systems such as traffic networks, power…

Computation and Language · Computer Science 2026-04-24 Juntong Ni , Shiyu Wang , Qi He , Ming Jin , Wei Jin

When training powerful AI systems to perform complex tasks, it may be challenging to provide training signals which are robust to optimization. One concern is \textit{measurement tampering}, where the AI system manipulates multiple…

Machine Learning · Computer Science 2023-10-02 Fabien Roger , Ryan Greenblatt , Max Nadeau , Buck Shlegeris , Nate Thomas

Humans rapidly learn abstract knowledge when encountering novel environments and flexibly deploy this knowledge to guide efficient and intelligent action. Can modern AI systems learn and plan in a similar way? We study this question using a…

Multi-hop reasoning over real-life knowledge graphs (KGs) is a highly challenging problem as traditional subgraph matching methods are not capable to deal with noise and missing information. To address this problem, it has been recently…

Artificial Intelligence · Computer Science 2022-07-05 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Xiaoli Li , Ru Li , Jeff Z. Pan

Existing reasoning tasks often have an important assumption that the input contents can be always accessed while reasoning, requiring unlimited storage resources and suffering from severe time delay on long sequences. To achieve efficient…

Machine Learning · Computer Science 2021-06-03 Zhu Zhang , Chang Zhou , Jianxin Ma , Zhijie Lin , Jingren Zhou , Hongxia Yang , Zhou Zhao

One critical challenge for large language models (LLMs) for making complex reasoning is their reliance on matching reasoning patterns from training data, instead of proactively selecting the most appropriate cognitive strategy to solve a…

Computation and Language · Computer Science 2025-03-18 Qin Liu , Wenxuan Zhou , Nan Xu , James Y. Huang , Fei Wang , Sheng Zhang , Hoifung Poon , Muhao Chen

We propose a novel, path-based reasoning approach for the multi-hop reading comprehension task where a system needs to combine facts from multiple passages to answer a question. Although inspired by multi-hop reasoning over knowledge…

Computation and Language · Computer Science 2019-07-10 Souvik Kundu , Tushar Khot , Ashish Sabharwal , Peter Clark

Text embeddings are widely used to analyse large corpora of complex texts. However, it is unclear whether the embeddings capture the same semantic distances as the human experts using them. Ensuring alignment between embedding…

Computation and Language · Computer Science 2026-05-27 Jonathan Rystrøm , Sofie Burgos-Thorsen , Zihao Fu , Johan Irving Søltoft , Kenneth C. Enevoldsen , Chris Russell

Understanding why a spacecraft maneuvers -- rather than simply that it did -- is an increasingly important problem for space domain awareness as Earth orbits grow crowded and contested. Current analysis pipelines are built for detection:…

Computation and Language · Computer Science 2026-05-26 Hao Liu , Siyuan Yang , Qinglei Hu , Dongyu Li

A well-defined benchmark is essential for measuring and accelerating research progress of machine learning models. In this paper, we present a benchmark for high-level mathematical reasoning and study the reasoning capabilities of neural…

Logic in Computer Science · Computer Science 2021-03-25 Wenda Li , Lei Yu , Yuhuai Wu , Lawrence C. Paulson

Deep neural networks (DNNs) have successfully been applied in many fields in the past decades. However, the increasing number of multiply-and-accumulate (MAC) operations in DNNs prevents their application in resource-constrained and…

Machine Learning · Computer Science 2022-11-29 Wenhao Sun , Grace Li Zhang , Xunzhao Yin , Cheng Zhuo , Huaxi Gu , Bing Li , Ulf Schlichtmann

Despite scaling to massive context windows, Large Language Models (LLMs) struggle with multi-hop reasoning due to inherent position bias, which causes them to overlook information at certain positions. Whether these failures stem from an…

Artificial Intelligence · Computer Science 2026-04-22 Meiru Zhang , Zaiqiao Meng , Nigel Collier

Automated reasoning with unstructured natural text is a key requirement for many potential applications of NLP and for developing robust AI systems. Recently, Language Models (LMs) have demonstrated complex reasoning capacities even without…

Computation and Language · Computer Science 2023-06-14 Mehran Kazemi , Quan Yuan , Deepti Bhatia , Najoung Kim , Xin Xu , Vaiva Imbrasaite , Deepak Ramachandran

We present Phi-4-reasoning-vision-15B, a compact open-weight multimodal reasoning model, and share the motivations, design choices, experiments, and learnings that informed its development. Our goal is to contribute practical insight to the…

Artificial Intelligence · Computer Science 2026-03-05 Jyoti Aneja , Michael Harrison , Neel Joshi , Tyler LaBonte , John Langford , Eduardo Salinas

Conversational Spoken Language Models (SLMs) are emerging as a promising paradigm for real-time speech interaction. However, their capacity of temporal dynamics, including the ability to manage timing, tempo and simultaneous speaking,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-04 Kai-Wei Chang , En-Pei Hu , Chun-Yi Kuan , Wenze Ren , Wei-Chih Chen , Guan-Ting Lin , Yu Tsao , Shao-Hua Sun , Hung-yi Lee , James Glass