English
Related papers

Related papers: Learning Permutations with Sinkhorn Policy Gradien…

200 papers

Policy gradient methods are widely used for control in reinforcement learning, particularly for the continuous action setting. There have been a host of theoretically sound algorithms proposed for the on-policy setting, due to the existence…

Machine Learning · Computer Science 2019-06-21 Ehsan Imani , Eric Graves , Martha White

Direct policy gradient methods for reinforcement learning are a successful approach for a variety of reasons: they are model free, they directly optimize the performance metric of interest, and they allow for richly parameterized policies.…

Machine Learning · Computer Science 2020-08-14 Alekh Agarwal , Mikael Henaff , Sham Kakade , Wen Sun

With the help of special neuromorphic hardware, spiking neural networks (SNNs) are expected to realize artificial intelligence (AI) with less energy consumption. It provides a promising energy-efficient way for realistic control tasks by…

Neural and Evolutionary Computing · Computer Science 2024-01-12 Ding Chen , Peixi Peng , Tiejun Huang , Yonghong Tian

In this paper, a novel racing environment for OpenAI Gym is introduced. This environment operates with continuous action- and state-spaces and requires agents to learn to control the acceleration and steering of a car while navigating a…

Machine Learning · Computer Science 2020-01-16 Mario S. Holubar , Marco A. Wiering

While bigger and deeper neural network architectures continue to advance the state-of-the-art for many computer vision tasks, real-world adoption of these networks is impeded by hardware and speed constraints. Conventional model compression…

Machine Learning · Computer Science 2017-12-19 Anubhav Ashok , Nicholas Rhinehart , Fares Beainy , Kris M. Kitani

The task of learning to map an input set onto a permuted sequence of its elements is challenging for neural networks. Set-to-sequence problems occur in natural language processing, computer vision and structure prediction, where…

Machine Learning · Computer Science 2022-06-09 Mateusz Jurewicz , Leon Derczynski

This paper introduces a Spiking Diffusion Policy (SDP) learning method for robotic manipulation by integrating Spiking Neurons and Learnable Channel-wise Membrane Thresholds (LCMT) into the diffusion policy model, thereby enhancing…

Robotics · Computer Science 2024-09-18 Zhixing Hou , Maoxu Gao , Hang Yu , Mengyu Yang , Chio-In Ieong

Reinforcement learning considers the problem of finding policies that maximize an expected cumulative reward in a Markov decision process with unknown transition probabilities. In this paper we consider the problem of finding optimal…

Machine Learning · Computer Science 2020-10-19 Santiago Paternain , Juan Andres Bazerque , Alejandro Ribeiro

Image compression is an essential approach for decreasing the size in bytes of the image without deteriorating the quality of it. Typically, classic algorithms are used but recently deep-learning has been successfully applied. In this work,…

Image and Video Processing · Electrical Eng. & Systems 2019-06-17 Nicoló Savioli

Generative model-based imitation learning methods have recently achieved strong results in learning high-complexity motor skills from human demonstrations. However, imitation learning of interactive policies that coordinate with humans in…

Robotics · Computer Science 2025-11-18 Max M. Sun , Todd Murphey

Reinforcement learning consists of finding policies that maximize an expected cumulative long-term reward in a Markov decision process with unknown transition probabilities and instantaneous rewards. In this paper, we consider the problem…

Systems and Control · Computer Science 2018-07-31 Santiago Paternain , Juan Andrés Bazerque , Austin Small , Alejandro Ribeiro

Deep reinforcement learning algorithms can perform poorly in real-world tasks due to the discrepancy between source and target environments. This discrepancy is commonly viewed as the disturbance in transition dynamics. Many existing…

Machine Learning · Computer Science 2021-12-21 Yufei Kuang , Miao Lu , Jie Wang , Qi Zhou , Bin Li , Houqiang Li

We present the perceptor gradients algorithm -- a novel approach to learning symbolic representations based on the idea of decomposing an agent's policy into i) a perceptor network extracting symbols from raw observation data and ii) a task…

Machine Learning · Computer Science 2019-05-06 Svetlin Penkov , Subramanian Ramamoorthy

Policy-gradient methods have received increased attention recently as a mechanism for learning to act in partially observable environments. They have shown promise for problems admitting memoryless policies but have been less successful…

Machine Learning · Computer Science 2025-12-08 Douglas Aberdeen , Jonathan Baxter

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

Machine Learning · Computer Science 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang

A fundamental challenge in multiagent reinforcement learning is to learn beneficial behaviors in a shared environment with other simultaneously learning agents. In particular, each agent perceives the environment as effectively…

In multi-agent tasks, the central challenge lies in the dynamic adaptation of strategies. However, directly conditioning on opponents' strategies is intractable in the prevalent deep reinforcement learning paradigm due to a fundamental…

Computer Science and Game Theory · Computer Science 2025-12-25 Yue Lin , Shuhui Zhu , Wenhao Li , Ang Li , Dan Qiao , Pascal Poupart , Hongyuan Zha , Baoxiang Wang

Deep reinforcement learning for multi-agent cooperation and competition has been a hot topic recently. This paper focuses on cooperative multi-agent problem based on actor-critic methods under local observations settings. Multi agent deep…

Artificial Intelligence · Computer Science 2017-10-04 Xiangxiang Chu , Hangjun Ye

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke

Sorting and permutation learning are key concepts in optimization and machine learning, especially when organizing high-dimensional data into meaningful spatial layouts. The Gumbel-Sinkhorn method, while effective, requires N*N parameters…

Machine Learning · Computer Science 2025-04-29 Kai Uwe Barthel , Florian Barthel , Peter Eisert