English
Related papers

Related papers: DDA-Thinker: Decoupled Dual-Atomic Reinforcement L…

200 papers

Reinforcement learning (RL) for large language model reasoning is frequently hindered by signal loss, a phenomenon where standard uniform sampling with small group sizes fails to uncover informative learning signals for difficult prompts.…

Machine Learning · Computer Science 2025-12-08 Wei Xiong , Chenlu Ye , Baohao Liao , Hanze Dong , Xinxing Xu , Christof Monz , Jiang Bian , Nan Jiang , Tong Zhang

While showing sophisticated reasoning abilities, large language models (LLMs) still struggle with long-horizon decision-making tasks due to deficient exploration and long-term credit assignment, especially in sparse-reward scenarios.…

Artificial Intelligence · Computer Science 2025-05-27 Zican Hu , Wei Liu , Xiaoye Qu , Xiangyu Yue , Chunlin Chen , Zhi Wang , Yu Cheng

Unified models capable of interleaved generation have emerged as a promising paradigm, with the community increasingly converging on autoregressive modeling for text and flow matching for image generation. To advance this direction, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jie Liu , Zilyu Ye , Linxiao Yuan , Shenhan Zhu , Yu Gao , Jie Wu , Kunchang Li , Xionghui Wang , Xiaonan Nie , Weilin Huang , Wanli Ouyang

Reinforcement fine-tuning (RFT) is a proliferating paradigm for LMM training. Analogous to high-level reasoning tasks, RFT is similarly applicable to low-level vision domains, including image quality assessment (IQA). Existing RFT-based IQA…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Ziheng Jia , Jiaying Qian , Zicheng Zhang , Zijian Chen , Xiongkuo Min

This work concerns itself with the task of reconstructing all edges of an arbitrary 3D wire-frame model projected to an image plane. We explore a bottom-up part-wise procedure undertaken by an RL agent to segment and reconstruct these 2D…

Machine Learning · Computer Science 2025-03-24 Julian Ziegler , Patrick Frenzel , Mirco Fuchs

Unsupervised deraining has attracted attention for its ability to learn the real-world distribution of rain without paired supervision. However, the lack of strong constraints makes it difficult for the network to converge, especially with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Yinghao Chen , Yeying Jin , Xiang Chen , Yanyan Wei , Ziyang Yan , Yaowen Fu

We introduce MIM (Masked Image Modeling)-Refiner, a contrastive learning boost for pre-trained MIM models. MIM-Refiner is motivated by the insight that strong representations within MIM models generally reside in intermediate layers.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Benedikt Alkin , Lukas Miklautz , Sepp Hochreiter , Johannes Brandstetter

Rectified flow (RF) models have recently demonstrated superior generative performance compared to DDIM-based diffusion models. However, in real-world applications, they suffer from two major challenges: (1) low inversion accuracy that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Weiming Chen , Zhihan Zhu , Yijia Wang , Zhihai He

We introduce Tinker, a versatile framework for high-fidelity 3D editing that operates in both one-shot and few-shot regimes without any per-scene finetuning. Unlike prior techniques that demand extensive per-scene optimization to ensure…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Canyu Zhao , Xiaoman Li , Tianjian Feng , Zhiyue Zhao , Hao Chen , Chunhua Shen

Reinforcement learning (RL) has emerged as an effective paradigm for improving the reasoning capability of vision-language models (VLMs). However, RL-based optimization typically depends on costly high-quality annotations that are difficult…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Lin Qiu , Hanqing Zeng , Yao Liu , Bingjun Sun , Guangdeng Liao , Ji Liu

Recent studies demonstrate that multimodal large language models (MLLMs) can proficiently evaluate visual quality through interpretable assessments. However, existing approaches typically treat quality scoring and reasoning descriptions as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Zhuoxuan Cai , Jian Zhang , Xinbin Yuan , Peng-Tao Jiang , Wenxiang Chen , Bowen Tang , Lujian Yao , Qiyuan Wang , Jinwen Chen , Bo Li

Mixed-Modal Image Retrieval (MMIR) as a flexible search paradigm has attracted wide attention. However, previous approaches always achieve limited performance, due to two critical factors are seriously overlooked. 1) The contribution of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Fuxiang Huang , Lei Zhang , Xiaowei Fu , Suqi Song

Improving the multi-step reasoning ability of Large Language Models (LLMs) is a critical yet challenging task. The dominant paradigm, outcome-supervised reinforcement learning (RLVR), rewards only correct final answers, often propagating…

Artificial Intelligence · Computer Science 2025-10-14 Beining Wang , Weihang Su , Hongtao Tian , Tao Yang , Yujia Zhou , Ting Yao , Qingyao Ai , Yiqun Liu

Keypoints are what enable Structure-from-Motion (SfM) systems to scale to thousands of images. However, designing a keypoint detection objective is a non-trivial task, as SfM is non-differentiable. Typically, an auxiliary objective…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Johan Edstedt , Georg Bökman , Mårten Wadenbäck , Michael Felsberg

Incorrect information poses significant challenges by disrupting content veracity and integrity, yet most detection approaches struggle to jointly balance textual content verification with external knowledge modification under collapsed…

Computation and Language · Computer Science 2026-05-06 Zhongxing Zhang , Emily K. Vraga , Jisu Huh , Jaideep Srivastava

Large reasoning models (LRMs) like OpenAI o1 and DeepSeek-R1 achieve high accuracy on complex tasks by adopting long chain-of-thought (CoT) reasoning paths. However, the inherent verbosity of these processes frequently results in redundancy…

Computation and Language · Computer Science 2026-03-10 Chenzhi Hu , Qinzhe Hu , Yuhang Xu , Junyi Chen , Ruijie Wang , Shengzhong Liu , Jianxin Li , Fan Wu , Guihai Chen

The remarkable capabilities of modern large reasoning models are largely unlocked through post-training techniques such as supervised fine-tuning (SFT) and reinforcement learning (RL). However, the architectural mechanisms behind such…

Artificial Intelligence · Computer Science 2026-04-15 Yein Park , Minbyul Jeong , Jaewoo Kang

Recent advances in large language models (LLMs) have shown remarkable progress, yet their capacity for logical ``slow-thinking'' reasoning persists as a critical research frontier. Current inference scaling paradigms suffer from two…

Computation and Language · Computer Science 2025-03-21 Jinyi Liu , Yan Zheng , Rong Cheng , Qiyu Wu , Wei Guo , Fei Ni , Hebin Liang , Yifu Yuan , Hangyu Mao , Fuzheng Zhang , Jianye Hao

Visual programming, a modular and generalizable paradigm, integrates different modules and Python operators to solve various vision-language tasks. Unlike end-to-end models that need task-specific data, it advances in performing visual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Minghe Gao , Juncheng Li , Hao Fei , Liang Pang , Wei Ji , Guoming Wang , Zheqi Lv , Wenqiao Zhang , Siliang Tang , Yueting Zhuang

Successful Artificial Intelligence systems often require numerous labeled data to extract information from document images. In this paper, we investigate the problem of improving the performance of Artificial Intelligence systems in…

Information Retrieval · Computer Science 2022-09-27 Bao-Sinh Nguyen , Dung Tien Le , Hieu M. Vu , Tuan Anh D. Nguyen , Minh-Tien Nguyen , Hung Le