English
Related papers

Related papers: STAS: Spatial-Temporal Return Decomposition for Mu…

200 papers

In real-world scenarios, human actions often fall into a long-tailed distribution. It makes the existing skeleton-based action recognition works, which are mostly designed based on balanced datasets, suffer from a sharp performance…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jiahang Zhang , Lilang Lin , Jiaying Liu

Many practical applications of reinforcement learning require agents to learn from sparse and delayed rewards. It challenges the ability of agents to attribute their actions to future outcomes. In this paper, we consider the problem…

Machine Learning · Computer Science 2022-03-18 Zhizhou Ren , Ruihan Guo , Yuan Zhou , Jian Peng

Due to the partial observability and communication constraints in many multi-agent reinforcement learning (MARL) tasks, centralized training with decentralized execution (CTDE) has become one of the most widely used MARL paradigms. In CTDE,…

Multiagent Systems · Computer Science 2022-03-17 Jian Zhao , Xunhan Hu , Mingyu Yang , Wengang Zhou , Jiangcheng Zhu , Houqiang Li

Reinforcement Learning (RL) has proven highly effective in aligning Large Language Models (LLMs) with human preferences. Typical RL methods optimize under an overall sequence reward, which can lead to a suboptimal learning process. This…

Machine Learning · Computer Science 2025-02-26 Yanshi Li , Shaopan Xiong , Gengru Chen , Xiaoyang Li , Yijia Luo , Xingyuan Bu , Yingshui Tan , Wenbo Su , Bo Zheng

We study multi-agent reinforcement learning (MARL) in a stochastic network of agents. The objective is to find localized policies that maximize the (discounted) global reward. In general, scalability is a challenge in this setting because…

Machine Learning · Computer Science 2021-11-03 Yiheng Lin , Guannan Qu , Longbo Huang , Adam Wierman

In continuing tasks, average-reward reinforcement learning may be a more appropriate problem formulation than the more common discounted reward formulation. As usual, learning an optimal policy in this setting typically requires a large…

Artificial Intelligence · Computer Science 2023-01-18 Yuqian Jiang , Sudarshanan Bharadwaj , Bo Wu , Rishi Shah , Ufuk Topcu , Peter Stone

Oftentimes, environments for sequential decision-making problems can be quite sparse in the provision of evaluative feedback to guide reinforcement-learning agents. In the extreme case, long trajectories of behavior are merely punctuated…

Machine Learning · Computer Science 2023-08-22 Akash Velu , Skanda Vaidyanath , Dilip Arumugam

We present a multi-agent actor-critic method that aims to implicitly address the credit assignment problem under fully cooperative settings. Our key motivation is that credit assignment among agents may not require an explicit formulation…

Machine Learning · Computer Science 2020-10-23 Meng Zhou , Ziyu Liu , Pengwei Sui , Yixuan Li , Yuk Ying Chung

Spatiotemporal predictive learning aims to generate future frames by learning from historical frames. In this paper, we investigate existing methods and present a general framework of spatiotemporal predictive learning, in which the spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Cheng Tan , Zhangyang Gao , Lirong Wu , Yongjie Xu , Jun Xia , Siyuan Li , Stan Z. Li

Spiking neural networks (SNNs) offer energy efficiency over artificial neural networks (ANNs) but suffer from high latency and computational overhead due to their multi-timestep operational nature. While various dynamic computation methods…

Machine Learning · Computer Science 2025-08-21 Donghwa Kang , Doohyun Kim , Sang-Ki Ko , Jinkyu Lee , Brent ByungHoon Kang , Hyeongboo Baek

This paper studies the computational offloading of video action recognition in edge computing. To achieve effective semantic information extraction and compression, following semantic communication we propose a novel spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Nan Li , Mehdi Bennis , Alexandros Iosifidis , Qi Zhang

Spatio-Temporal Graph Neural Networks (STGNNs) have emerged as a powerful tool for modeling dynamic graph-structured data across diverse domains. However, they often fail to generalize in Spatio-Temporal Out-of-Distribution (STOOD)…

Machine Learning · Computer Science 2025-10-14 Haoyu Zhang , Wentao Zhang , Hao Miao , Xinke Jiang , Yuchen Fang , Yifan Zhang

Self-supervised learning presents a remarkable performance to utilize unlabeled data for various video tasks. In this paper, we focus on applying the power of self-supervised methods to improve semi-supervised action proposal generation.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Xiang Wang , Shiwei Zhang , Zhiwu Qing , Yuanjie Shao , Changxin Gao , Nong Sang

Stochastic partial observability poses a major challenge for decentralized coordination in multi-agent reinforcement learning but is largely neglected in state-of-the-art research due to a strong focus on state-based centralized training…

Spatio-temporal feature learning is of central importance for action recognition in videos. Existing deep neural network models either learn spatial and temporal features independently (C2D) or jointly with unconstrained parameters (C3D).…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

Spatial-temporal forecasting is crucial and widely applicable in various domains such as traffic, energy, and climate. Benefiting from the abundance of unlabeled spatial-temporal data, self-supervised methods are increasingly adapted to…

Machine Learning · Computer Science 2024-12-20 Qi Zheng , Zihao Yao , Yaying Zhang

Sparse rewards are a major bottleneck in multi-agent reinforcement learning (MARL), where simultaneous learning induces non-stationarity and makes reward design especially delicate. Reward shaping can accelerate learning, but in the…

Multiagent Systems · Computer Science 2026-05-25 Elie Abboud , Oren Gal

Recently, post-training methods based on reinforcement learning, with a particular focus on Group Relative Policy Optimization (GRPO), have emerged as the robust paradigm for further advancement of text-to-image (T2I) models. However, these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Haoyuan Sun , Jing Wang , Yuxin Song , Yu Lu , Bo Fang , Yifu Luo , Jun Yin , Pengyu Zeng , Miao Zhang , Tiantian Zhang , Xueqian Wang , Shijian Lu

In a broad class of reinforcement learning applications, stochastic rewards have heavy-tailed distributions, which lead to infinite second-order moments for stochastic (semi)gradients in policy evaluation and direct policy optimization. In…

Machine Learning · Computer Science 2023-06-21 Semih Cayci , Atilla Eryilmaz

This paper presents a meta-learning framework for credit risk assessment of Italian Small and Medium Enterprises (SMEs) that explicitly addresses the temporal misalignment of credit scoring models. The approach aligns financial statement…

Risk Management · Quantitative Finance 2026-01-13 O. Didkovskyi , A. Vidali , N. Jean , G. Le Pera