English
Related papers

Related papers: Bridging Structure and Language: Graph-Based Visua…

200 papers

Large Language Models (LLMs) have achieved impressive results in processing text data, which has sparked interest in applying these models beyond textual data, such as graphs. In the field of graph learning, there is a growing interest in…

Artificial Intelligence · Computer Science 2024-10-10 Sheng Ouyang , Yulan Hu , Ge Chen , Yong Liu

We present a continuation to our previous work, in which we developed the MR-CKR framework to reason with knowledge overriding across contexts organized in multi-relational hierarchies. Reasoning is realized via ASP with algebraic measures,…

Artificial Intelligence · Computer Science 2023-05-04 Loris Bozzato , Thomas Eiter , Rafael Kiesel , Daria Stepanova

While recent vision-and-language models (VLMs) like CLIP are a powerful tool for analyzing text and images in a shared semantic space, they do not explicitly model the hierarchical nature of the set of texts which may describe an image.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Morris Alper , Hadar Averbuch-Elor

Cartographic reasoning is the skill of interpreting geographic relationships by aligning legends, map scales, compass directions, map texts, and geometries across one or more map images. Although essential as a concrete cognitive capability…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Jiyoon Pyo , Yuankun Jiao , Dongwon Jung , Zekun Li , Leeje Jang , Sofia Kirsanova , Jina Kim , Yijun Lin , Qin Liu , Junyi Xie , Hadi Askari , Nan Xu , Muhao Chen , Yao-Yi Chiang

Learning interpretable multimodal representations inherently relies on uncovering the conditional dependencies between heterogeneous features. However, sparse graph estimation techniques, such as Graphical Lasso (GLasso), to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Fei Wang , Yutong Zhang , Xiong Wang

Prediction of road users' behaviors in the context of autonomous driving has gained considerable attention by the scientific community in the last years. Most works focus on predicting behaviors based on kinematic information alone, a…

Discourse Representation Theory (DRT) is a formal account for representing the meaning of natural language discourse. Meaning in DRT is modeled via a Discourse Representation Structure (DRS), a meaning representation with a model-theoretic…

Computation and Language · Computer Science 2021-01-01 Lasha Abzianidze , Johan Bos , Stephan Oepen

Embodied scene understanding serves as the cornerstone for autonomous agents to perceive, interpret, and respond to open driving scenarios. Such understanding is typically founded upon Vision-Language Models (VLMs). Nevertheless, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Yunsong Zhou , Linyan Huang , Qingwen Bu , Jia Zeng , Tianyu Li , Hang Qiu , Hongzi Zhu , Minyi Guo , Yu Qiao , Hongyang Li

Visual-spatial understanding, the ability to infer object relationships and layouts from visual input, is fundamental to downstream tasks such as robotic navigation and embodied interaction. However, existing methods face spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Haoyu Zhang , Meng Liu , Zaijing Li , Haokun Wen , Weili Guan , Yaowei Wang , Liqiang Nie

Conversational recommender systems (CRSs) often utilize external knowledge graphs (KGs) to introduce rich semantic information and recommend relevant items through natural language dialogues. However, original KGs employed in existing CRSs…

Artificial Intelligence · Computer Science 2022-12-26 Xiaoyu Zhang , Xin Xin , Dongdong Li , Wenxuan Liu , Pengjie Ren , Zhumin Chen , Jun Ma , Zhaochun Ren

Answering complex questions about textual narratives requires reasoning over both stated context and the world knowledge that underlies it. However, pretrained language models (LM), the foundation of most modern QA systems, do not robustly…

Computation and Language · Computer Science 2022-01-25 Xikun Zhang , Antoine Bosselut , Michihiro Yasunaga , Hongyu Ren , Percy Liang , Christopher D. Manning , Jure Leskovec

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable…

Artificial Intelligence · Computer Science 2024-04-19 Stefan Dernbach , Khushbu Agarwal , Alejandro Zuniga , Michael Henry , Sutanay Choudhury

Visual Place Recognition (VPR) in long-term deployment requires reasoning beyond pixel similarity: systems must make transparent, interpretable decisions that remain robust under lighting, weather and seasonal change. We present Text2Graph…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Saeideh Yousefzadeh , Hamidreza Pourreza

Robots interacting with humans through natural language can unlock numerous applications such as Referring Grasp Synthesis (RGS). Given a text query, RGS determines a stable grasp pose to manipulate the referred object in the robot's…

Robotics · Computer Science 2025-03-14 Vineet Bhat , Prashanth Krishnamurthy , Ramesh Karri , Farshad Khorrami

The development of high-level autonomous driving (AD) is shifting from perception-centric limitations to a more fundamental bottleneck, namely, a deficit in robust and generalizable reasoning. Although current AD systems manage structured…

Artificial Intelligence · Computer Science 2026-03-13 Kejin Yu , Yuhan Sun , Taiqiang Wu , Ruixu Zhang , Zhiqiang Lin , Yuxin Meng , Junjie Wang , Yujiu Yang

Driving in safety-critical scenarios requires quick, context-aware decision-making grounded in both situational understanding and experiential reasoning. Large Language Models (LLMs), with their powerful general-purpose reasoning…

Artificial Intelligence · Computer Science 2025-06-26 Wenbin Gan , Minh-Son Dao , Koji Zettsu

Integrating large language models (LLMs) into autonomous driving motion planning has recently emerged as a promising direction, offering enhanced interpretability, better controllability, and improved generalization in rare and long-tail…

Artificial Intelligence · Computer Science 2025-07-29 Zhipeng Tang , Sha Zhang , Jiajun Deng , Chenjie Wang , Guoliang You , Yuting Huang , Xinrui Lin , Yanyong Zhang

Traffic Sign Recognition (TSR) is a core perception capability for autonomous driving, where robustness to cross-region variation, long-tailed categories, and semantic ambiguity is essential for reliable real-world deployment. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Guoyang Zhao , Weiqing Qi , Kai Zhang , Chenguang Zhang , Zeying Gong , Zhihai Bi , Kai Chen , Benshan Ma , Ming Liu , Jun Ma

Predicting the near-term behavior of a reactive agent is crucial in many robotic scenarios, yet remains challenging when observations of that agent are sparse or intermittent. Vision-Language Models (VLMs) offer a promising avenue by…

Large language models (LLMs) achieve strong performance by generating long chains of thought, but longer traces always introduce redundant or ineffective reasoning steps. One typical behavior is that they often perform unnecessary…

Computation and Language · Computer Science 2026-01-13 Jinyi Han , Zixiang Di , Zishang Jiang , Ying Liao , Jiaqing Liang , Yongqi Wang , Yanghua Xiao