English
Related papers

Related papers: Online and Stable Learning of Analysis Operators

200 papers

Precision medicine is of considerable interest in clinical, academic and regulatory parties. The key to precision medicine is the optimal treatment regime. Recently, Zhou et al. (2017) developed residual weighted learning (RWL) to construct…

Methodology · Statistics 2017-11-30 Xin Zhou , Michael R. Kosorok

Electronic computers have evolved drastically over the past years with an ever-growing demand for improved performance. However, the transfer of information from memory and high energy consumption have emerged as issues that require…

Operator learning seeks to approximate mappings from input functions to output solutions, particularly in the context of partial differential equations (PDEs). While recent advances such as DeepONet and Fourier Neural Operator (FNO) have…

Machine Learning · Computer Science 2025-05-27 Yile Li , Shandian Zhe

Robot locomotion learning using reinforcement learning suffers from training sample inefficiency and exhibits the non-understandable/black-box nature. Thus, this work presents a novel SME-AGOL to address such problems. Firstly, Sequential…

Robotics · Computer Science 2025-05-19 Arthicha Srisuchinnawong , Poramate Manoonpong

A novel physics-informed operator learning technique based on spectral methods is introduced to model the complex behavior of heterogeneous materials. The Lippmann-Schwinger operator in Fourier space is employed to construct physical…

Materials Science · Physics 2025-06-26 Ali Harandi , Hooman Danesh , Kevin Linka , Stefanie Reese , Shahed Rezaei

This paper proposes a framework to study the convergence of stochastic optimization and learning algorithms. The framework is modeled over the different challenges that these algorithms pose, such as (i) the presence of random additive…

Optimization and Control · Mathematics 2024-07-01 Nicola Bastianello , Liam Madden , Ruggero Carli , Emiliano Dall'Anese

Stochastic bilevel optimization (SBO) has been integrated into many machine learning paradigms recently, including hyperparameter optimization, meta learning, and reinforcement learning. Along with the wide range of applications, there have…

Machine Learning · Computer Science 2026-04-07 Xuelin Zhang , Hong Chen , Bin Gu , Tieliang Gong , Feng Zheng

While the rapid progress of deep learning fuels end-to-end reinforcement learning (RL), direct application, especially in high-dimensional space like robotic scenarios still suffers from low sample efficiency. Therefore State Representation…

Stochastic compositional optimization arises in many important machine learning tasks such as value function evaluation in reinforcement learning and portfolio management. The objective function is the composition of two expectations of…

Machine Learning · Statistics 2020-01-28 Huizhuo Yuan , Xiangru Lian , Ji Liu

Post-training alignment has produced dozens of competing algorithms -- DPO, SimPO, KTO, GRPO, and others -- yet practitioners lack controlled comparisons to guide algorithm selection. We present OXRL, a unified framework implementing 51…

Machine Learning · Computer Science 2026-03-23 Xiaoyi Li

Self-predictive unsupervised learning methods such as BYOL or SimSiam have shown impressive results, and counter-intuitively, do not collapse to trivial representations. In this work, we aim at exploring the simplest possible mathematical…

Machine Learning · Computer Science 2023-02-10 Pierre H. Richemond , Allison Tam , Yunhao Tang , Florian Strub , Bilal Piot , Felix Hill

While Adversarial Imitation Learning (AIL) algorithms have recently led to state-of-the-art results on various imitation learning benchmarks, it is unclear as to what impact various design decisions have on performance. To this end, we…

Machine Learning · Computer Science 2022-02-15 Eddy Hudson , Garrett Warnell , Peter Stone

Offline Multi-Agent Reinforcement Learning (MARL) is an emerging field that aims to learn optimal multi-agent policies from pre-collected datasets. Compared to single-agent case, multi-agent setting involves a large joint state-action space…

Artificial Intelligence · Computer Science 2024-12-19 Zongkai Liu , Qian Lin , Chao Yu , Xiawei Wu , Yile Liang , Donghui Li , Xuetao Ding

Most offline reinforcement learning (RL) methods suffer from the trade-off between improving the policy to surpass the behavior policy and constraining the policy to limit the deviation from the behavior policy as computing $Q$-values using…

Machine Learning · Computer Science 2023-03-29 Haoran Xu , Li Jiang , Jianxiong Li , Zhuoran Yang , Zhaoran Wang , Victor Wai Kin Chan , Xianyuan Zhan

In this paper, we introduce the Spectral Coefficient Learning via Operator Network (SCLON), a novel operator learning-based approach for solving parametric partial differential equations (PDEs) without the need for data harnessing. The…

Machine Learning · Computer Science 2023-10-04 Junho Choi , Taehyun Yun , Namjung Kim , Youngjoon Hong

Reinforcement learning (RL) algorithms such as PPO and GRPO are widely used to train large language models (LLMs) for multi-turn agentic tasks. However, in off-policy training pipelines, these methods often exhibit unstable optimization…

Fourier Neural Operators (FNOs) have proven to be an efficient and effective method for resolution-independent operator learning in a broad variety of application areas across scientific machine learning. A key reason for their success is…

Time domain simulation, i.e., modeling the system's evolution over time, is a crucial tool for studying and enhancing power system stability and dynamic performance. However, these simulations become computationally intractable for…

Machine Learning · Computer Science 2025-10-14 Matthew Schlegel , Matthew E. Taylor , Mostafa Farrokhabadi

Optimization problems are central to decision-making in manufacturing, logistics, scheduling, and other industrial settings. Translating complicated descriptions of these problems into solver-ready formulations requires specialized…

Modeling and predicting the dynamics of complex multiscale systems remains a significant challenge due to their inherent nonlinearities and sensitivity to initial conditions, as well as limitations of traditional machine learning methods…

Machine Learning · Computer Science 2025-10-23 Elias Al Ghazal , Jad Mounayer , Beatriz Moya , Sebastian Rodriguez , Chady Ghnatios , Francisco Chinesta