English
Related papers

Related papers: Forest Before Trees: Latent Superposition for Effi…

200 papers

Recent advancements in large language models (LLMs) have greatly improved their capabilities on complex reasoning tasks through Long Chain-of-Thought (CoT). However, this approach often results in substantial redundancy, impairing…

Computation and Language · Computer Science 2025-08-18 Qiguang Chen , Dengyun Peng , Jinhao Liu , HuiKang Su , Jiannan Guan , Libo Qin , Wanxiang Che

Recently, single image super-resolution (SR) under large scaling factors has witnessed impressive progress by introducing pre-trained generative adversarial networks (GANs) as priors. However, most GAN-Priors based SR methods are…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Jiahui Zhang , Fangneng Zhan , Yingchen Yu , Rongliang Wu , Xiaoqin Zhang , Shijian Lu

Compositional visual reasoning has emerged as a key research frontier in multimodal AI, aiming to endow machines with the human-like ability to decompose visual scenes, ground intermediate concepts, and perform multi-step logical inference.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Fucai Ke , Joy Hsu , Zhixi Cai , Zixian Ma , Xin Zheng , Xindi Wu , Sukai Huang , Weiqing Wang , Pari Delir Haghighi , Gholamreza Haffari , Ranjay Krishna , Jiajun Wu , Hamid Rezatofighi

Latent reasoning enables reasoning over continuous hidden states rather than explicit tokens, avoiding the language bottleneck and inference overhead of chain-of-thought for medical VQA. However, existing methods suffer from modality…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Qiaoru Li , Shaotian Liang , Jintao Chen , Haoran Sun , Yuxiang Cai , Jianwei Yin , Yankai Jiang

Latent visual reasoning aims to mimic human's imagination process by meditating through hidden states of Multimodal Large Language Models. While recognized as a promising paradigm for visual reasoning, the underlying mechanisms driving its…

Computation and Language · Computer Science 2026-02-27 You Li , Chi Chen , Yanghao Li , Fanhu Zeng , Kaiyu Huang , Jinan Xu , Maosong Sun

Vision-Language-Action (VLA) tasks require reasoning over complex visual scenes and executing adaptive actions in dynamic environments. While recent studies on reasoning VLAs show that explicit chain-of-thought (CoT) can improve…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Chi-Pin Huang , Yunze Man , Zhiding Yu , Min-Hung Chen , Jan Kautz , Yu-Chiang Frank Wang , Fu-En Yang

Recent work shows that, beyond discrete reasoning through explicit chain-of-thought steps, which are limited by the boundaries of natural languages, large language models (LLMs) can also reason continuously in latent space, allowing richer…

Computation and Language · Computer Science 2026-03-03 Dachuan Shi , Abedelkadir Asi , Keying Li , Xiangchi Yuan , Leyan Pan , Wenke Lee , Wen Xiao

Current reinforcement learning objectives for large-model reasoning primarily focus on maximizing expected rewards. This paradigm can lead to overfitting to dominant reward signals, while neglecting alternative yet valid reasoning…

Machine Learning · Computer Science 2026-02-24 Wendi Li , Sharon Li

Discrete Diffusion Language Models have emerged as a compelling paradigm for unified multimodal generation, yet their deployment is hindered by high inference latency arising from iterative decoding. Existing acceleration strategies often…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Chenglin Wang , Yucheng Zhou , Shawn Chen , Tao Wang , Kai Zhang

The success of deep neural networks has inspired many to wonder whether other learners could benefit from deep, layered architectures. We present a general framework called forward thinking for deep learning that generalizes the…

Machine Learning · Statistics 2017-05-23 Kevin Miller , Chris Hettinger , Jeffrey Humpherys , Tyler Jarvis , David Kartchner

Large language models (LLMs) achieve strong reasoning performance by allocating substantial computation at inference time, often generating long and verbose reasoning traces. While recent work on efficient reasoning reduces this overhead…

Computation and Language · Computer Science 2026-04-28 Han Wang , Xiaodong Yu , Jialian Wu , Jiang Liu , Ximeng Sun , Mohit Bansal , Zicheng Liu

Multimodal large language models are increasingly expected to perform thinking with images, yet existing visual latent reasoning methods still rely on explicit textual chain-of-thought interleaved with visual latent tokens. This interleaved…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Houcheng Jiang , Jiajun Fu , Junfeng Fang , Chen Gao , Xiang Wang , Xiangnan He , Yong Li

Vision-and-Language Navigation (VLN) requires agents to accurately perceive complex visual environments and reason over navigation instructions and histories. However, existing methods passively process redundant visual inputs and treat all…

Robotics · Computer Science 2026-03-17 Wei Xue , Mingcheng Li , Xuecheng Wu , Jingqun Tang , Dingkang Yang , Lihua Zhang

While language reasoning models excel in many tasks, visual reasoning remains challenging for current large multimodal models (LMMs). As a result, most LMMs default to verbalizing perceptual content into text, a strong limitation for tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 André G. Viveiros , Nuno Gonçalves , Matthias Lindemann , André Martins

As textual reasoning with large language models (LLMs) has advanced significantly, there has been growing interest in enhancing the multimodal reasoning capabilities of large vision-language models (LVLMs). However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Junfei Wu , Jian Guan , Kaituo Feng , Qiang Liu , Shu Wu , Liang Wang , Wei Wu , Tieniu Tan

Tree of Thoughts (ToT) enhances Large Language Model (LLM) reasoning by structuring problem-solving as a spanning tree. However, recent methods focus on search accuracy while overlooking computational efficiency. The challenges of…

Artificial Intelligence · Computer Science 2025-02-28 Yifu Ding , Wentao Jiang , Shunyu Liu , Yongcheng Jing , Jinyang Guo , Yingjie Wang , Jing Zhang , Zengmao Wang , Ziwei Liu , Bo Du , Xianglong Liu , Dacheng Tao

Despite significant advances in Vision Language Models (VLMs), they remain constrained by the complexity and redundancy of visual input. When images contain large amounts of irrelevant information, VLMs are susceptible to interference, thus…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Xinyu Zhang , Yuxuan Dong , Lingling Zhang , Chengyou Jia , Zhuohang Dang , Basura Fernando , Jun Liu , Mike Zheng Shou

Text-prompted image segmentation enables fine-grained visual understanding and is critical for applications such as human-computer interaction and robotics. However, existing supervised fine-tuning methods typically ignore explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Lianghui Zhu , Bin Ouyang , Yuxuan Zhang , Tianheng Cheng , Rui Hu , Haocheng Shen , Longjin Ran , Xiaoxin Chen , Li Yu , Wenyu Liu , Xinggang Wang

Auto-Regressive (AR) models have recently gained prominence in image generation, often matching or even surpassing the performance of diffusion models. However, one major limitation of AR models is their sequential nature, which processes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Doohyuk Jang , Sihwan Park , June Yong Yang , Yeonsung Jung , Jihun Yun , Souvik Kundu , Sung-Yub Kim , Eunho Yang

Reasoning is a hallmark of human intelligence, enabling adaptive decision-making in complex and unfamiliar scenarios. In contrast, machine intelligence remains bound to training data, lacking the ability to dynamically refine solutions at…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Shaheer U. Saeed , Yipei Wang , Veeru Kasivisvanathan , Brian R. Davidson , Matthew J. Clarkson , Yipeng Hu , Daniel C. Alexander