中文
相关论文

相关论文: Temporal Difference Learning with Constrained Init…

200 篇论文

Reinforcement learning (RL) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs). While RL has demonstrated substantial performance gains, it still faces key challenges, including low…

机器学习 · 计算机科学 2025-11-18 Yihang Yao , Guangtao Zeng , Raina Wu , Yang Zhang , Ding Zhao , Zhang-Wei Hong , Chuang Gan

In classical AI, perception relies on learning state-based representations, while planning, which can be thought of as temporal reasoning over action sequences, is typically achieved through search. We study whether such reasoning can…

机器学习 · 计算机科学 2025-09-30 Alicja Ziarko , Michal Bortkiewicz , Michal Zawalski , Benjamin Eysenbach , Piotr Milos

Despite recent progress in reinforcement learning (RL) from raw pixel data, sample inefficiency continues to present a substantial obstacle. Prior works have attempted to address this challenge by creating self-supervised auxiliary tasks,…

机器学习 · 计算机科学 2024-05-27 Ruijie Zheng , Xiyao Wang , Yanchao Sun , Shuang Ma , Jieyu Zhao , Huazhe Xu , Hal Daumé , Furong Huang

Unsupervised/self-supervised representation learning in time series is critical since labeled samples are usually scarce in real-world scenarios. Existing approaches mainly leverage the contrastive learning framework, which automatically…

机器学习 · 计算机科学 2023-07-10 Wenrui Zhang , Ling Yang , Shijia Geng , Shenda Hong

Discrete-continuous hybrid action space is a natural setting in many practical problems, such as robot control and game AI. However, most previous Reinforcement Learning (RL) works only demonstrate the success in controlling with either…

机器学习 · 计算机科学 2022-03-17 Boyan Li , Hongyao Tang , Yan Zheng , Jianye Hao , Pengyi Li , Zhen Wang , Zhaopeng Meng , Li Wang

Supervised (pre-)training currently yields state-of-the-art performance for representation learning for visual recognition, yet it comes at the cost of (1) intensive manual annotations and (2) an inherent restriction in the scope of data…

计算机视觉与模式识别 · 计算机科学 2016-12-05 Ruohan Gao , Dinesh Jayaraman , Kristen Grauman

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

机器学习 · 计算机科学 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

Conventional deep learning prioritizes unconstrained optimization, yet biological systems operate under strict metabolic constraints. We propose that these physical constraints shape dynamics to function not as limitations, but as a…

机器学习 · 计算机科学 2026-01-23 Xia Chen

With the excellent representation capabilities of Pre-Trained Models (PTMs), remarkable progress has been made in non-rehearsal Class-Incremental Learning (CIL) research. However, it remains an extremely challenging task due to three…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Jiawei Zhan , Jun Liu , Jinlong Peng , Xiaochen Chen , Bin-Bin Gao , Yong Liu , Chengjie Wang

Linear TD($\lambda$) is one of the most fundamental reinforcement learning algorithms for policy evaluation. Previously, convergence rates are typically established under the assumption of linearly independent features, which does not hold…

机器学习 · 计算机科学 2025-10-15 Zixuan Xie , Xinyu Liu , Rohan Chandra , Shangtong Zhang

Interactive Recommendation (IR) has gained significant attention recently for its capability to quickly capture dynamic interest and optimize both short and long term objectives. IR agents are typically implemented through Deep…

信息检索 · 计算机科学 2025-06-17 Jingyu Li , Zhiyong Feng , Dongxiao He , Hongqi Chen , Qinghang Gao , Guoli Wu

The approximation and convergence properties of implicit neural representations (INRs) are known to be highly sensitive to parameter initialization strategies. While several data-driven initialization methods demonstrate significant…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Kushal Vyas , Alper Kayabasi , Daniel Kim , Vishwanath Saragadam , Ashok Veeraraghavan , Guha Balakrishnan

This paper studies offline reinforcement learning with linear function approximation in a setting with decision-theoretic, but not estimation sparsity. The structural restrictions of the data-generating process presume that the transitions…

机器学习 · 统计学 2024-01-24 Angela Zhou

Supervised causal learning has shown promise in causal discovery, yet it often struggles with generalization across diverse interventional settings, particularly when intervention targets are unknown. To address this, we propose TICL…

机器学习 · 计算机科学 2026-02-24 Wei Chen , Rui Ding , Bojun Huang , Yang Zhang , Qiang Fu , Yuxuan Liang , Han Shi , Dongmei Zhang

Causal representation learning (CRL) models aim to transform high-dimensional data into a latent space, enabling interventions to generate counterfactual samples or modify existing data based on the causal relationships among latent…

机器学习 · 计算机科学 2026-03-19 Alireza Sadeghi , Wael AbdAlmageed

Quantitative T1rho mapping has shown promise in clinical and research studies. However, it suffers from long scan times. Deep learning-based techniques have been successfully applied in accelerated quantitative MR parameter mapping.…

图像与视频处理 · 电气工程与系统科学 2024-07-25 Yuanyuan Liu , Jinwen Xie , Zhuo-Xu Cui , Qingyong Zhu , Jing Cheng , Dong Liang , Yanjie Zhu

Predictive models trained on observational data often fail to generalise to the distributions they encounter when deployed, especially when the training data is a product of the system being optimised. Recommender systems are a canonical…

机器学习 · 统计学 2026-05-27 Yorgos Felekis , Michael O'Riordan , Oriol Corcoll , Ciarán M. Gilligan-Lee

Quadrupedal locomotion via Reinforcement Learning (RL) is commonly addressed using the teacher-student paradigm, where a privileged teacher guides a proprioceptive student policy. However, key challenges such as representation misalignment…

机器人学 · 计算机科学 2025-12-02 Amr Mousa , Neil Karavis , Michele Caprio , Wei Pan , Richard Allmendinger

Implicit Neural Representations (INRs) provide a powerful continuous framework for modeling complex visual and geometric signals, but spectral bias remains a fundamental challenge, limiting their ability to capture high-frequency details.…

机器学习 · 计算机科学 2025-12-01 Yesom Park , Kelvin Kan , Thomas Flynn , Yi Huang , Shinjae Yoo , Stanley Osher , Xihaier Luo

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

机器学习 · 计算机科学 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen