English
Related papers

Related papers: Recursive Inference Scaling: A Winning Path to Sca…

200 papers

Time series with missing data are signals encountered in important settings for machine learning. Some of the most successful prior approaches for modeling such time series are based on recurrent neural networks that transform the input and…

Machine Learning · Computer Science 2021-04-20 Alberto García-Durán , Robert West

Large reasoning models (LRMs) excel at a long chain of reasoning but often fail to faithfully follow instructions regarding output format, constraints, or specific requirements. We investigate whether this gap can be closed by integrating…

Machine Learning · Computer Science 2026-02-27 Zhehao Huang , Yuhang Liu , Baijiong Lin , Yixin Lou , Zhengbao He , Hanling Tian , Tao Li , Xiaolin Huang

Recursive least squares (RLS) algorithms were once widely used for training small-scale neural networks, due to their fast convergence. However, previous RLS algorithms are unsuitable for training deep neural networks (DNNs), since they…

Machine Learning · Computer Science 2021-09-08 Chunyuan Zhang , Qi Song , Hui Zhou , Yigui Ou , Hongyao Deng , Laurence Tianruo Yang

Recent reasoning-focused language models such as DeepSeek R1 and OpenAI o1 have demonstrated strong performance on structured reasoning benchmarks including GSM8K, MATH, and multi-hop question answering tasks. However, their performance…

Computation and Language · Computer Science 2026-03-31 Rahul Soni

Existing web-scale recommendation systems commonly use supervised learning methods that prioritize immediate user feedback. Although reinforcement learning (RL) offers a solution to optimize longer-term goals, such as in-session engagement,…

Machine Learning · Computer Science 2025-08-04 Mehdi Ben Ayed , Fei Feng , Jay Adams , Vishwakarma Singh , Kritarth Anand , Jiajing Xu

Referring Remote Sensing Image Segmentation (RRSIS) is a new challenge that combines computer vision and natural language processing, delineating specific regions in aerial images as described by textual queries. Traditional Referring Image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Sihan Liu , Yiwei Ma , Xiaoqing Zhang , Haowei Wang , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Reverse thinking plays a crucial role in human reasoning. Humans can reason not only from a problem to a solution but also in reverse, i.e., start from the solution and reason towards the problem. This often enhances overall reasoning…

Achieving precise alignment between user intent and generated visuals remains a central challenge in text-to-visual generation, as a single attempt often fails to produce the desired output. To handle this, prior approaches mainly scale the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Subin Kim , Sangwoo Mo , Mamshad Nayeem Rizve , Yiran Xu , Difan Liu , Jinwoo Shin , Tobias Hinz

Image registration is essential for medical image applications where alignment of voxels across multiple images is needed for qualitative or quantitative analysis. With recent advancements in deep neural networks and parallel computing,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-23 Yi Zhang , Yidong Zhao , Hui Xue , Peter Kellman , Stefan Klein , Qian Tao

Inference scaling empowers LLMs with unprecedented reasoning ability, with reinforcement learning as the core technique to elicit complex reasoning. However, key technical details of state-of-the-art reasoning LLMs are concealed (such as in…

Retrieval-augmented generation (RAG) improves language model (LM) performance by providing relevant context at test time for knowledge-intensive situations. However, the relationship between parametric knowledge acquired during pretraining…

Computation and Language · Computer Science 2026-04-02 Karan Singh , Michael Yu , Varun Gangal , Zhuofu Tao , Sachin Kumar , Emmy Liu , Steven Y. Feng

Scaling laws with respect to the amount of training data and the number of parameters allow us to predict the cost-benefit trade-offs of pretraining language models (LMs) in different configurations. In this paper, we consider another…

Computation and Language · Computer Science 2024-07-19 Rulin Shao , Jacqueline He , Akari Asai , Weijia Shi , Tim Dettmers , Sewon Min , Luke Zettlemoyer , Pang Wei Koh

State-of-the-art sequential recommendation relies heavily on self-attention-based recommender models. Yet such models are computationally expensive and often too slow for real-time recommendation. Furthermore, the self-attention operation…

Information Retrieval · Computer Science 2023-11-09 Zhenrui Yue , Yueqi Wang , Zhankui He , Huimin Zeng , Julian McAuley , Dong Wang

Referring Image Segmentation (RIS) is a challenging task that requires an algorithm to segment objects referred by free-form language expressions. Despite significant progress in recent years, most state-of-the-art (SOTA) methods still…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yong Xien Chng , Henry Zheng , Yizeng Han , Xuchong Qiu , Gao Huang

Irregular Multivariate Time Series (IMTS) are characterized by uneven intervals between consecutive timestamps, which carry sampling pattern information valuable and informative for learning temporal and variable dependencies. In addition,…

Machine Learning · Computer Science 2026-02-26 Boyuan Li , Zhen Liu , Yicheng Luo , Qianli Ma

As Large Language Models (LLMs) are increasingly deployed in safety-critical domains, rigorously evaluating their robustness against adversarial jailbreaks is essential. However, current safety evaluations often overestimate robustness…

Machine Learning · Computer Science 2026-01-08 Zhakshylyk Nurlanov , Frank R. Schmidt , Florian Bernard

We propose ReinFlow, a simple yet effective online reinforcement learning (RL) framework that fine-tunes a family of flow matching policies for continuous robotic control. Derived from rigorous RL theory, ReinFlow injects learnable noise…

Robotics · Computer Science 2026-01-09 Tonghe Zhang , Chao Yu , Sichang Su , Yu Wang

Rhetorical Role Labeling (RRL) assigns a functional role to each sentence in a document and is widely used in legal, medical, and scientific domains. While language models (LMs) achieve strong average performance, they remain unreliable on…

Computation and Language · Computer Science 2026-05-19 Anas Belfathi , Nicolas Hernandez , Laura Monceaux , Warren Bonnard , Richard Dufour

Recent work on domain-specific reasoning with large language models (LLMs) often relies on training-intensive approaches that require parameter updates. While activation steering has emerged as a parameter efficient alternative, existing…

Artificial Intelligence · Computer Science 2026-01-21 Wencheng Ye , Xiaoyang Yuan , Yi Bin , Pengpeng Zeng , Hengyu Jin , Liang Peng , Heng Tao Shen

Hallucination remains a fundamental challenge for Multimodal Large Language Models (MLLMs). While Direct Preference Optimization (DPO) is a key alignment framework, existing approaches often rely heavily on costly external evaluators for…

Machine Learning · Computer Science 2026-02-04 Yuanshuai Li , Yuping Yan , Jirui Han , Fei Ming , Lingjuan Lv , Yaochu Jin