English
Related papers

Related papers: Adaptive Model-Based Reinforcement Learning for Or…

200 papers

Local-remote systems allow robots to execute complex tasks in hazardous environments such as space and nuclear power stations. However, establishing accurate positional mapping between local and remote devices can be difficult due to time…

Artificial Intelligence · Computer Science 2023-09-21 Luc McCutcheon , Saber Fallah

Several works have addressed the problem of incorporating constraints in the reinforcement learning (RL) framework, however majority of them can only guarantee the satisfaction of soft constraints. In this work, we address the problem of…

Machine Learning · Computer Science 2020-06-16 Kwangyeon Kim , Akshita Gupta , Hong-Cheol Choi , Inseok Hwang

Robotic systems that rely primarily on self-supervised learning have the potential to decrease the amount of human annotation and engineering effort required to learn control strategies. In the same way that prior robotic systems have…

Machine Learning · Computer Science 2025-06-11 Chongyi Zheng , Benjamin Eysenbach , Homer Walke , Patrick Yin , Kuan Fang , Ruslan Salakhutdinov , Sergey Levine

The hard X-ray instruments at the Linac Coherent Light Source are in the design phase for upgrades that will take full advantage of the high repetition rates that will become available with LCLS-II-HE. The current X-ray Correlation…

Accelerator Physics · Physics 2023-08-16 Aashwin Mishra , Nicholas Brennan , Tianyu Huang , Jason Jaquith , Hasan Yavas , Matthew Seaberg

Reinforcement Learning (RL) provides a powerful framework for decision-making in complex environments. However, implementing RL in hardware-efficient and bio-inspired ways remains a challenge. This paper presents a novel Spiking Neural…

Neural and Evolutionary Computing · Computer Science 2023-08-09 Sergio F. Chevtchenko , Yeshwanth Bethi , Teresa B. Ludermir , Saeed Afshar

Reconfigurable intelligent surfaces (RIS) have recently been proposed as an effective means for spatial interference suppression in large reflector antenna systems. Existing RIS weight optimization algorithms typically rely on accurate…

Signal Processing · Electrical Eng. & Systems 2025-12-25 Xinrui Li , R. Michael Buehrer

We propose the *State Space Neural Operator* (SS-NO), a compact architecture for learning solution operators of time-dependent partial differential equations (PDEs). Our formulation extends structured state space models (SSMs) to joint…

Machine Learning · Computer Science 2026-03-09 Nodens Koren , Samuel Lanthaler

This letter introduces a novel unmanned aerial vehicle (UAV)-intelligent reflecting surface (IRS) structure into near-field localization systems to enhance the design flexibility of IRS, thereby obtaining additional performance gains.…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Hanfu Zhang , Yidan Mei , Erwu Liu , Rui Wang

This paper investigates the model aggregation process in an over-the-air federated learning (AirFL) system, where an intelligent reflecting surface (IRS) is deployed to assist the transmission from users to the base station (BS). With the…

Information Theory · Computer Science 2021-03-23 Jingheng Zheng , Wanli Ni , Hui Tian

This paper investigates a downlink multiple-input single-output intelligent reflecting surface (IRS) aided non-orthogonal multiple access (NOMA) system, where a base station (BS) serves multiple users with the aid of IRSs. Our goal is to…

Signal Processing · Electrical Eng. & Systems 2020-11-12 Xidong Mu , Yuanwei Liu , Li Guo , Jiaru Lin , Naofal Al-Dhahir

Modeling the dynamic behavior of deformable objects is crucial for creating realistic digital worlds. While conventional simulations produce high-quality motions, their computational costs are often prohibitive. Subspace simulation…

We introduce Neural Optimal Design of Experiments, a learning-based framework for optimal experimental design in inverse problems that avoids classical bilevel optimization and indirect sparsity regularization. NODE jointly trains a neural…

Machine Learning · Computer Science 2026-01-08 John E. Darges , Babak Maboudi Afkham , Matthias Chung

Stability arguments are often used to prevent learning algorithms from having ever increasing activity and weights that hinder generalization. However, stability conditions can clash with the sparsity required to augment the energy…

Neural and Evolutionary Computing · Computer Science 2024-01-08 Luca Herranz-Celotti , Jean Rouat

Adversarial neural networks solve many important problems in data science, but are notoriously difficult to train. These difficulties come from the fact that optimal weights for adversarial nets correspond to saddle points, and not…

Machine Learning · Computer Science 2018-02-12 Abhay Yadav , Sohil Shah , Zheng Xu , David Jacobs , Tom Goldstein

Visual-inertial systems rely on precise calibrations of both camera intrinsics and inter-sensor extrinsics, which typically require manually performing complex motions in front of a calibration target. In this work we present a novel…

The high penetration of renewable energy and power electronic equipment bring significant challenges to the efficient construction of adaptive emergency control strategies against various presumed contingencies in today's power systems.…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Congbo Bi , Lipeng Zhu , Di Liu , Chao Lu

This paper studies the constrained/safe reinforcement learning (RL) problem with sparse indicator signals for constraint violations. We propose a model-based approach to enable RL agents to effectively explore the environment with unknown…

Artificial Intelligence · Computer Science 2021-03-09 Zuxin Liu , Hongyi Zhou , Baiming Chen , Sicheng Zhong , Martial Hebert , Ding Zhao

Interacting with the actual environment to acquire data is often costly and time-consuming in robotic tasks. Model-based offline reinforcement learning (RL) provides a feasible solution. On the one hand, it eliminates the requirements of…

Machine Learning · Computer Science 2023-10-17 Pengqin Wang , Meixin Zhu , Shaojie Shen

Recently there has been substantial interest in spectral methods for learning dynamical systems. These methods are popular since they often offer a good tradeoff between computational and statistical efficiency. Unfortunately, they can be…

Machine Learning · Statistics 2015-11-05 Ahmed Hefny , Carlton Downey , Geoffrey Gordon

Current and future high-contrast imaging instruments require extreme adaptive optics (XAO) systems to reach contrasts necessary to directly image exoplanets. Telescope vibrations and the temporal error induced by the latency of the control…

Instrumentation and Methods for Astrophysics · Physics 2021-08-26 Rico Landman , Sebastiaan Y. Haffert , Vikram M. Radhakrishnan , Christoph U. Keller