English
Related papers

Related papers: ChartAnchor: Chart Grounding with Structural-Seman…

200 papers

Dense and accurate depth estimation is essential for robotic manipulation, grasping, and navigation, yet currently available depth sensors are prone to errors on transparent, specular, and general non-Lambertian surfaces. To mitigate these…

Robotics · Computer Science 2026-05-05 Simon Dorer , Martin Büchner , Nick Heppert , Abhinav Valada

Multimodal Large Language Models (MLLMs) are increasingly used to carry out visual workflows such as navigating GUIs, where the next step depends on verified visual compositional conditions (e.g., "if a permission dialog appears and the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Haozhan Shen , Shilin Yan , Hongwei Xue , Shuaiqi Lu , Xiaojun Tang , Guannan Zhang , Tiancheng Zhao , Jianwei Yin

Understanding transformer-based language models is becoming increasingly crucial, particularly as they play pivotal roles in advancing towards artificial general intelligence. However, language model research faces significant challenges,…

Computation and Language · Computer Science 2024-01-17 Zhongwang Zhang , Zhiwei Wang , Junjie Yao , Zhangchen Zhou , Xiaolong Li , Weinan E , Zhi-Qin John Xu

Multimodal reasoning, which integrates language and visual cues into problem solving and decision making, is a fundamental aspect of human intelligence and a crucial step toward artificial general intelligence. However, the evaluation of…

The recent prevalence of pretrained language models (PLMs) has dramatically shifted the paradigm of semantic parsing, where the mapping from natural language utterances to structured logical forms is now formulated as a Seq2Seq task.…

Computation and Language · Computer Science 2022-12-06 Lunyiu Nie , Jiuding Sun , Yanlin Wang , Lun Du , Lei Hou , Juanzi Li , Shi Han , Dongmei Zhang , Jidong Zhai

Mathematical reasoning is essential for problem-solving in education, science, and industry, serving as a crucial benchmark for evaluating artificial intelligence systems. As Large Language Models (LLMs) improve their reasoning…

Computation and Language · Computer Science 2026-05-20 Husnain Amjad , Raja Khurram Shahzad , Aamir Shahzad , Mehwish Fatima

Collaborative dialogue relies on participants incrementally establishing common ground, yet in asymmetric settings they may believe they agree while referring to different entities. We introduce a perspectivist annotation scheme for the…

Computation and Language · Computer Science 2026-03-17 Nan Li , Albert Gatt , Massimo Poesio

With the rapid progress of Multimodal LLMs, evaluating their mathematical reasoning capabilities has become an increasingly important research direction. In particular, visual-textual mathematical reasoning serves as a key indicator of an…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Hao Liang , Linzhuang Sun , Minxuan Zhou , Zirong Chen , Meiyi Qiang , Mingan Lin , Tianpeng Li , Fan Yang , Zenan Zhou , Wentao Zhang

Logic provides a controlled testbed for evaluating LLM-based reasoners, yet standard SAT-style benchmarks often conflate surface difficulty (length, wording, clause order) with the structural phenomena that actually determine…

Artificial Intelligence · Computer Science 2026-02-16 Naïm Es-sebbani , Esteban Marquer , Yakoub Salhi , Zied Bouraoui

Convex analysis is a modern branch of mathematics with many applications. As Large Language Models (LLMs) start to automate research-level math and sciences, it is important for LLMs to demonstrate the ability to understand and reason with…

Artificial Intelligence · Computer Science 2026-02-05 Yepeng Liu , Yu Huang , Yu-Xiang Wang , Yingbin Liang , Yuheng Bu

Current molecular understanding approaches predominantly focus on the descriptive aspect of human perception, providing broad, topic-level insights. However, the referential aspect -- linking molecular concepts to specific structural…

Artificial Intelligence · Computer Science 2025-05-02 Jiaxin Wu , Ting Zhang , Rubing Chen , Wengyu Zhang , Chen Jason Zhang , Xiao-Yong Wei , Li Qing

Mathematical reasoning is a hallmark of human intelligence, and whether large language models (LLMs) can meaningfully perform it remains a central question in artificial intelligence and cognitive science. As LLMs are increasingly…

Computation and Language · Computer Science 2026-04-03 Linyang He , Qiyao Yu , Hanze Dong , Baohao Liao , Xinxing Xu , Micah Goldblum , Jiang Bian , Nima Mesgarani

Despite the existing evolution of Multimodal Large Language Models (MLLMs), a non-neglectable limitation remains in their struggle with visual text grounding, especially in text-rich images of documents. Document images, such as scanned…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Ming Li , Ruiyi Zhang , Jian Chen , Chenguang Wang , Jiuxiang Gu , Yufan Zhou , Franck Dernoncourt , Wanrong Zhu , Tianyi Zhou , Tong Sun

Chart reasoning is a critical capability for Vision Language Models (VLMs). However, the development of open-source models is severely hindered by the lack of high-quality training data. Existing datasets suffer from a dual challenge:…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Zheng Liu , Honglin Lin , Chonghan Qin , Xiaoyang Wang , Xin Gao , Yu Li , Mengzhang Cai , Yun Zhu , Zhanping Zhong , Qizhi Pei , Zhuoshi Pan , Xiaoran Shang , Bin Cui , Conghui He , Wentao Zhang , Lijun Wu

Large Language Models (LLMs) have shown to be capable of various tasks, yet their capability in interpreting and reasoning over tabular data remains an underexplored area. In this context, this study investigates from three core…

Computation and Language · Computer Science 2023-12-29 Tianyang Liu , Fei Wang , Muhao Chen

While Multimodal Large Language Models (MLLMs) demonstrate proficiency in 2D scenes, extending their perceptual intelligence to 3D point cloud understanding remains a significant challenge. Current approaches focus primarily on aligning 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Dongxu Zhang , Yiding Sun , Pengcheng Li , Yumou Liu , Hongqiang Lin , Haoran Xu , Xiaoxuan Mu , Liang Lin , Wenbiao Yan , Ning Yang , Chaowei Fang , Juanjuan Zhao , Jihua Zhu , Conghui He , Cheng Tan

Understanding infographic charts with design-driven visual elements (e.g., pictograms, icons) requires both visual recognition and reasoning, posing challenges for multimodal large language models (MLLMs). However, existing visual-question…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Tianchi Xie , Minzhi Lin , Mengchen Liu , Yilin Ye , Changjian Chen , Shixia Liu

Multimodal Large Language Models (MLLMs) have revolutionized GUI automation, yet their efficacy is largely established on idealized, single-layer interfaces. This paper identifies a critical reliability gap: state-of-the-art agents face…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Haoren Zhao , Tianyi Chen , Zhen Wang

The rapid advancement of multimodal large language models (MLLMs) offers new opportunities for complex scientific challenges, yet their application in earth science-especially at the graduate level-remains underexplored due to a lack of…

Artificial Intelligence · Computer Science 2026-05-05 Xiangyu Zhao , Wanghan Xu , Bo Liu , Yuhao Zhou , Fenghua Ling , Ben Fei , Xiaoyu Yue , Lei Bai , Wenlong Zhang , Xiao-Ming Wu

Scientific reasoning is a key aspect of human intelligence, requiring the integration of multimodal inputs, domain expertise, and multi-step inference across various subjects. Existing benchmarks for multimodal large language models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Longteng Guo , Xuanxu Lin , Dongze Hao , Tongtian Yue , Pengkang Huo , Jiatong Ma , Yuchen Liu , Jing Liu