中文
相关论文

相关论文: Behavior-Aware Auxiliary Corrections for Off-Polic…

200 篇论文

Aligning structured data is a fundamental problem in computer vision and machine learning, underlying tasks such as time series analysis, human action recognition, and visual representation learning. Existing alignment methods, including…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Lei Wang , Syuan-Hao Li , Yongsheng Gao , Piotr Koniusz

Off-policy learning refers to the problem of learning the value function of a way of behaving, or policy, while following a different policy. Gradient-based off-policy learning algorithms, such as GTD and TDC/GQ, converge even when using…

人工智能 · 计算机科学 2015-12-15 Lucas Lehnert , Doina Precup

Dynamic graph representation learning plays a crucial role in understanding evolving behaviors. However, existing methods often struggle with flexibility, adaptability, and the preservation of temporal and structural dynamics. To address…

机器学习 · 计算机科学 2025-01-22 He Yu , Jing Liu

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Kaiyu Guo , Zijian Wang , Tan Pan , Brian C. Lovell , Mahsa Baktashmotlagh

Dynamic graph representation learning has become essential for analyzing evolving networks in domains such as social network analysis, recommendation systems, and traffic analysis. However, existing continuous-time methods face three key…

机器学习 · 计算机科学 2025-10-14 Soheila Farokhi , Xiaojun Qi , Hamid Karimi

This study proposes a dynamic rule data mining algorithm based on an improved Transformer architecture, aiming to improve the accuracy and efficiency of rule mining in a dynamic data environment. With the increase in data volume and…

机器学习 · 计算机科学 2025-03-17 Jie Liu , Yiwei Zhang , Yuan Sheng , Yujia Lou , Haige Wang , Bohuan Yang

TD($\lambda$) in value-based MARL algorithms or the Temporal Difference critic learning in Actor-Critic-based (AC-based) algorithms synergistically integrate elements from Monte-Carlo simulation and Q function bootstrapping via dynamic…

机器学习 · 计算机科学 2026-05-13 Yue Deng , Zirui Wang , Yin Zhang

We consider the problem of learning the best possible policy from a fixed dataset, known as offline Reinforcement Learning (RL). A common taxonomy of existing offline RL works is policy regularization, which typically constrains the learned…

机器学习 · 计算机科学 2023-08-16 Yuhang Ran , Yi-Chen Li , Fuxiang Zhang , Zongzhang Zhang , Yang Yu

Reinforcement learning algorithms have been widely used in dynamic and control systems. However, interpreting their internal learning behavior remains a challenge. In the authors' previous work, a critic match loss landscape visualization…

机器学习 · 计算机科学 2026-03-17 Jingyi Liu , Jian Guo , Eberhard Gill

Temporal difference (TD) learning is a cornerstone reinforcement learning (RL) method for policy evaluation, where the goal is to estimate the value function of a Markov decision process under a fixed policy. While a substantial body of…

机器学习 · 计算机科学 2026-02-02 Donghwan Lee , Do Wan Kim

We present differentiable predictive control (DPC), a method for learning constrained neural control policies for linear systems with probabilistic performance guarantees. We employ automatic differentiation to obtain direct policy…

系统与控制 · 电气工程与系统科学 2022-01-28 Jan Drgona , Aaron Tuor , Draguna Vrabie

Data-driven predictive control (DPC), using linear combinations of recorded trajectory data, has recently emerged as a popular alternative to traditional model predictive control (MPC). Without an explicitly enforced prediction model, the…

系统与控制 · 电气工程与系统科学 2025-03-31 Manuel Klädtke , Moritz Schulze Darup

Dynamic community detection methods often lack effective mechanisms to ensure temporal consistency, hindering the analysis of network evolution. In this paper, we propose a novel deep graph clustering framework with temporal consistency…

人工智能 · 计算机科学 2024-01-09 Dexu Kong , Anping Zhang , Yang Li

This study presents an Actor-Critic Cooperative Compensated Model Predictive Controller (AC3MPC) designed to address unknown system dynamics. To avoid the difficulty of modeling highly complex dynamics and ensuring realtime control…

机器人学 · 计算机科学 2026-01-27 Prakhar Gupta , Jonathon M Smereka , Yunyi Jia

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

机器人学 · 计算机科学 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

This paper introduces a dual-regularized ADMM approach to distributed, time-varying optimization. The proposed algorithm is designed in a prediction-correction framework, in which the computing nodes predict the future local costs based on…

最优化与控制 · 数学 2024-05-07 Nicola Bastianello , Andrea Simonetto , Ruggero Carli

We study the problem of computing the value function from a discretely-observed trajectory of a continuous-time diffusion process. We develop a new class of algorithms based on easily implementable numerical schemes that are compatible with…

机器学习 · 计算机科学 2024-07-09 Wenlong Mou , Yuhua Zhu

Off-policy reinforcement learning aims to leverage experience collected from prior policies for sample-efficient learning. However, in practice, commonly used off-policy approximate dynamic programming methods based on Q-learning and…

机器学习 · 计算机科学 2019-11-26 Aviral Kumar , Justin Fu , George Tucker , Sergey Levine

To obtain better value estimation in reinforcement learning, we propose a novel algorithm based on the double actor-critic framework with temporal difference error-driven regularization, abbreviated as TDDR. TDDR employs double actors, with…

机器学习 · 计算机科学 2024-10-01 Haohui Chen , Zhiyong Chen , Aoxiang Liu , Wentuo Fang

Affine formation control (AFC) is a subset of formation control methods that enables coordinated multiagent movement while preserving affine relationships, and has recently gained increasing popularity due to its broad applicability across…

信号处理 · 电气工程与系统科学 2025-08-26 Zhonggang Li , Raj Thilak Rajan