English
Related papers

Related papers: MathSticks: A Benchmark for Visual Symbolic Compos…

200 papers

Existing evaluation protocols for brain visual decoding predominantly rely on coarse metrics that obscure inter-model differences, lack neuroscientific foundation, and fail to capture fine-grained visual distinctions. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Weihao Xia , Cengiz Oztireli

Visuals are valuable tools for teaching math word problems (MWPs), helping young learners interpret textual descriptions into mathematical expressions before solving them. However, creating such visuals is labor-intensive and there is a…

Computation and Language · Computer Science 2025-06-05 Junling Wang , Anna Rutkiewicz , April Yi Wang , Mrinmaya Sachan

Visual Reasoning CAPTCHAs (VRCs) combine visual scenes with natural-language queries that demand compositional inference over objects, attributes, and spatial relations. They are increasingly deployed as a primary defense against automated…

Cryptography and Security · Computer Science 2026-01-13 Minfeng Qi , Dongyang He , Qin Wang , Lefeng Zhang

Recent advances in reinforcement learning (RL) have led to substantial improvements in the mathematical reasoning abilities of LLMs, as measured by standard benchmarks. Yet these gains often persist even when models are trained with flawed…

Artificial Intelligence · Computer Science 2026-01-06 Jian Yao , Ran Cheng , Kay Chen Tan

Automated visualization design navigates a tension between symbolic systems and generative models. Constraint solvers enforce structural and perceptual validity, but the rules they require are difficult to author and too rigid to capture…

Human-Computer Interaction · Computer Science 2026-03-10 Péter Ferenc Gyarmati , Dominik Moritz , Torsten Möller , Laura Koesten

Mathematical reasoning is a hallmark of human intelligence, and whether large language models (LLMs) can meaningfully perform it remains a central question in artificial intelligence and cognitive science. As LLMs are increasingly…

Computation and Language · Computer Science 2026-04-03 Linyang He , Qiyao Yu , Hanze Dong , Baohao Liao , Xinxing Xu , Micah Goldblum , Jiang Bian , Nima Mesgarani

Mathematical reasoning remains one of the most challenging domains for large language models (LLMs), requiring not only linguistic understanding but also structured logical deduction and numerical precision. While recent LLMs demonstrate…

Computation and Language · Computer Science 2026-01-27 Mahbub E Sobhani , Md. Faiyaz Abdullah Sayeedi , Tasnim Mohiuddin , Md Mofijul Islam , Swakkhar Shatabda

Compositional visual reasoning has emerged as a key research frontier in multimodal AI, aiming to endow machines with the human-like ability to decompose visual scenes, ground intermediate concepts, and perform multi-step logical inference.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Fucai Ke , Joy Hsu , Zhixi Cai , Zixian Ma , Xin Zheng , Xindi Wu , Sukai Huang , Weiqing Wang , Pari Delir Haghighi , Gholamreza Haffari , Ranjay Krishna , Jiajun Wu , Hamid Rezatofighi

We present VISPROG, a neuro-symbolic approach to solving complex and compositional visual tasks given natural language instructions. VISPROG avoids the need for any task-specific training. Instead, it uses the in-context learning ability of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Tanmay Gupta , Aniruddha Kembhavi

Code has emerged as a precise and executable medium for reasoning and action in the agent era. Yet, progress has largely focused on language-centric tasks such as program synthesis and debugging, leaving visual-centric coding underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Kevin Qinghong Lin , Yuhao Zheng , Hangyu Ran , Dantong Zhu , Dongxing Mao , Linjie Li , Philip Torr , Alex Jinpeng Wang

Large language models (LLMs) often make reasoning errors when solving mathematical problems, and how to automatically detect and correct these errors has become an important research direction. However, existing approaches \textit{mainly…

Computation and Language · Computer Science 2025-11-19 Biaojie Zeng , Min Zhang , Juan Zhou , Fengrui Liu , Ruiyang Huang , Xin Lin

Visual representation learning has been a cornerstone in computer vision, involving typical forms such as visual embeddings, structural symbols, and text-based representations. Despite the success of CLIP-type visual embeddings, they often…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yiwu Zhong , Zi-Yuan Hu , Michael R. Lyu , Liwei Wang

Visual reasoning is dominated by end-to-end neural networks scaled to billions of model parameters and training examples. However, even the largest models struggle with compositional reasoning, generalization, fine-grained spatial and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Aleksandar Stanić , Sergi Caelles , Michael Tschannen

Robotics tasks are highly compositional by nature. For example, to perform a high-level task like cleaning the table a robot must employ low-level capabilities of moving the effectors to the objects on the table, pick them up and then move…

Robotics · Computer Science 2024-11-15 Sanjay Haresh , Daniel Dijkman , Apratim Bhattacharyya , Roland Memisevic

Visual reasoning tasks such as visual question answering (VQA) require an interplay of visual perception with reasoning about the question semantics grounded in perception. However, recent advances in this area are still primarily driven by…

Machine Learning · Computer Science 2020-08-27 Saeed Amizadeh , Hamid Palangi , Oleksandr Polozov , Yichen Huang , Kazuhito Koishida

Humans can learn and reason under substantial uncertainty in a space of infinitely many concepts, including structured relational concepts ("a scene with objects that have the same color") and ad-hoc categories defined through goals…

Artificial Intelligence · Computer Science 2020-10-07 Ramakrishna Vedantam , Arthur Szlam , Maximilian Nickel , Ari Morcos , Brenden Lake

Recent large language models (LLMs) achieve near-saturation accuracy on many established mathematical reasoning benchmarks, raising concerns about their ability to diagnose genuine reasoning competence. This saturation largely stems from…

Multimodal Large Language Models (MLLMs) have made rapid progress in single-video understanding, yet their ability to reason across multiple independent video streams remains poorly understood. Existing multi-video benchmarks rely largely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Sara Ghazanfari , Siddharth Garg , Prashanth Krishnamurthy , Farshad Khorrami

CoT has significantly enhanced the reasoning ability of LLMs while it faces challenges when extended to multimodal domains, particularly in mathematical tasks. Existing MLLMs typically perform textual reasoning solely from a single static…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Lihong Wang , Liangqi Li , Weiwei Feng , Jiamin Wu , Changtao Miao , Tieru Wu , Rui Ma , Bo Zhang , Zhe Li

Spatial reasoning is a key aspect of cognitive psychology and remains a bottleneck for current vision-language models (VLMs). While extensive research has aimed to evaluate or improve VLMs' understanding of basic spatial relations, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Mengdi Jia , Zekun Qi , Shaochen Zhang , Wenyao Zhang , Xinqiang Yu , Jiawei He , He Wang , Li Yi