English
Related papers

Related papers: The Perception-Physics Paradox: Probing Scientific…

200 papers

Language-conditioned robotic manipulation in open-world settings requires not only accurate task execution but also the ability to detect failures for robust deployment in real-world environments. Although recent advances in vision-language…

Robotics · Computer Science 2026-02-20 Clemence Grislain , Hamed Rahimi , Olivier Sigaud , Mohamed Chetouani

Learning versatile, fine-grained representations from irregular event streams is pivotal yet nontrivial, primarily due to the heavy annotation that hinders scalability in dataset size, semantic richness, and application scope. To mitigate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Zhiwen Chen , Junhui Hou , Zhiyu Zhu , Jinjian Wu , Guangming Shi

Humans perform visual perception at multiple levels, including low-level object recognition and high-level semantic interpretation such as behavior understanding. Subtle differences in low-level details can lead to substantial changes in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Guanzhen Li , Yuxi Xie , Min-Yen Kan

Optical aberrations prevent telescopes from reaching their theoretical diffraction limit. Once estimated, these aberrations can be compensated for using deformable mirrors in a closed loop. Focal plane wavefront sensing enables the…

Cognitive science research treats visual perception, the ability to understand and make sense of a visual input, as one of the early developmental signs of intelligence. Its TVPS-4 framework categorizes and tests human perception into seven…

Computation and Language · Computer Science 2026-01-23 Samrajnee Ghosh , Naman Agarwal , Hemanshu Garg , Chinmay Mittal , Mausam , Parag Singla

While multimodal large language models (MLLMs) exhibit strong performance on single-video tasks (e.g., video question answering), their capability for spatiotemporal pattern reasoning across multiple videos remains a critical gap in pattern…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Nannan Zhu , Yonghao Dong , Teng Wang , Xueqian Li , Shengjun Deng , Yijia Wang , Zheng Hong , Tiantian Geng , Guo Niu , Hanyan Huang , Xiongfei Yao , Shuaiwei Jiao

Machine learning models often struggle with distribution shifts in real-world scenarios, whereas humans exhibit robust adaptation. Models that better align with human perception may achieve higher out-of-distribution generalization. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Mohammad-Javad Darvishi-Bayazi , Md Rifat Arefin , Jocelyn Faubert , Irina Rish

Cross-view localization aims to estimate the 3-DoF pose of a ground-view image by aligning it with aerial or satellite imagery. Existing methods typically address this task through direct regression or feature alignment in a shared…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Panwang Xia , Qiong Wu , Lei Yu , Yi Liu , Mingtao Xiong , Xudong Lu , Yi Liu , Haoyu Guo , Yongxiang Yao , Junjian Zhang , Xiangyuan Cai , Hongwei Hu , Zhi Zheng , Yongjun Zhang , Yi Wan

In recent years, vision and language pre-training (VLP) models have advanced the state-of-the-art results in a variety of cross-modal downstream tasks. Aligning cross-modal semantics is claimed to be one of the essential capabilities of VLP…

Computation and Language · Computer Science 2022-10-19 Zheng Ma , Shi Zong , Mianzhi Pan , Jianbing Zhang , Shujian Huang , Xinyu Dai , Jiajun Chen

Vision-Language Models (VLMs) have recently witnessed significant progress in visual comprehension. As the permitting length of image context grows, VLMs can now comprehend a broader range of views and spaces. Current benchmarks provide…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yiqi Zhu , Ziyue Wang , Can Zhang , Peng Li , Yang Liu

We present a framework for perspective-aware reasoning in vision-language models (VLMs) through mental imagery simulation. Perspective-taking, the ability to perceive an environment or situation from an alternative viewpoint, is a key…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Phillip Y. Lee , Jihyeon Je , Chanho Park , Mikaela Angelina Uy , Leonidas Guibas , Minhyuk Sung

Hallucination is a long-standing problem that has been actively investigated in Vision-Language Models (VLMs). Existing research commonly attributes hallucinations to technical limitations or sycophancy bias, where the latter means the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Xiangrui Liu , Man Luo , Agneet Chatterjee , Hua Wei , Chitta Baral , Yezhou Yang

Recent advances in large language models (LLMs) and vision-language models (LVLMs) have shown promise across many tasks, yet their scientific reasoning capabilities remain untested, particularly in multimodal settings. We present…

Machine Learning · Computer Science 2025-06-03 Xinwu Ye , Chengfan Li , Siming Chen , Wei Wei , Xiangru Tang

Perceptual constancy is the ability to maintain stable perceptions of objects despite changes in sensory input, such as variations in distance, angle, or lighting. This ability is crucial for visual understanding in a dynamic world. Here,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Haoran Sun , Bingyang Wang , Suyang Yu , Yijiang Li , Qingying Gao , Haiyun Lyu , Lianyu Huang , Zelong Hong , Jiahui Ge , Qianli Ma , Hang He , Yifan Zhou , Lingzi Guo , Lantao Mei , Maijunxian Wang , Dezhi Luo , Hokin Deng

World models enable agents to predict future dynamics conditioned on actions, making the choice of latent representation central to planning and control. Such representations are often either learned directly from pixels with limited…

Artificial Intelligence · Computer Science 2026-05-26 Minghao Fu , Fan Feng , Nicklas Hansen , Biwei Huang

Post-training has greatly improved reasoning in frontier vision-language models, yet its gains for perception remain comparatively limited, creating a bottleneck for end-to-end visual reasoning. To investigate this gap, we introduce a…

Computation and Language · Computer Science 2026-05-29 Xueqing Wu , Yu-Chi Lin , Kai-Wei Chang , Nanyun Peng

The ability to derive precise spatial and physical insights is a cornerstone of vision-language models (VLMs), yet their poor performances in related spatial intelligence tasks such as physical reasoning remain a fundamental barrier. The…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Jian Lan , Zhicheng Liu , Xinpeng Wang , Yuhao Zhou , Haokun Chen , Jiancheng Lv , Barbara Plank , Thomas Seidl

Multimodal large language models (MLLMs) have achieved remarkable progress on vision-language tasks, yet their reasoning processes remain sometimes unreliable. We introduce PRISM-Bench, a benchmark of puzzle-based visual challenges designed…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yusu Qian , Cheng Wan , Chao Jia , Yinfei Yang , Qingyu Zhao , Zhe Gan

Benchmark accuracy is often implicitly assumed to reflect grounded visual understanding in vision-language models (VLMs), yet it remains unclear to what extent such scores truly reflect reliance on visual evidence. Motivated by a surprising…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zixuan Lan , Luzhe Sun , Matthew R. Walter , Jiawei Zhou

Vision-language models (VLMs) have demonstrated remarkable capabilities in understanding and reasoning about visual content, but significant challenges persist in tasks requiring cross-viewpoint understanding and spatial reasoning. We…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Dingming Li , Hongxing Li , Zixuan Wang , Yuchen Yan , Hang Zhang , Siqi Chen , Guiyang Hou , Shengpei Jiang , Wenqi Zhang , Yongliang Shen , Weiming Lu , Yueting Zhuang