English
Related papers

Related papers: Center-Outward q-Dominance: A Sample-Computable Pr…

200 papers

When deploying a trained machine learning model in the real world, it is inevitable to receive inputs from out-of-distribution (OOD) sources. For instance, in continual learning settings, it is common to encounter OOD samples due to the…

Machine Learning · Computer Science 2024-01-23 Chuanwen Feng , Wenlong Chen , Ao Ke , Yilong Ren , Xike Xie , S. Kevin Zhou

In this review/tutorial article, we present recent progress on optimal control of partially observed Markov Decision Processes (POMDPs). We first present regularity and continuity conditions for POMDPs and their belief-MDP reductions, where…

Optimization and Control · Mathematics 2025-01-03 Ali Devran Kara , Serdar Yuksel

Stochastic optimal control problems have a long tradition in applied probability, with the questions addressed being of high relevance in a multitude of fields. Even though theoretical solutions are well understood in many scenarios, their…

Statistics Theory · Mathematics 2024-05-28 Sören Christensen , Claudia Strauch , Lukas Trottner

Recent advances in end-to-end autonomous driving show that policies trained on patch-aligned features extracted from foundation models generalize better to Out-of-Distribution (OOD). We hypothesize that due to the self-attention mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Amir Mallak , Erfan Aasi , Shiva Sreeram , Tsun-Hsuan Wang , Daniela Rus , Alaa Maalouf

Two classes of methods have been proposed for escaping from saddle points with one using the second-order information carried by the Hessian and the other adding the noise into the first-order information. The existing analysis for…

Optimization and Control · Mathematics 2018-03-05 Yi Xu , Rong Jin , Tianbao Yang

Many Pareto-based multi-objective evolutionary algorithms require to rank the solutions of the population in each iteration according to the dominance principle, what can become a costly operation particularly in the case of dealing with…

Neural and Evolutionary Computing · Computer Science 2020-02-19 Javier Moreno , Daniel Rodriguez , Antonio Nebro , Jose A. Lozano

We study the problem of efficient exploration in order to learn an accurate model of an environment, modeled as a Markov decision process (MDP). Efficient exploration in this problem requires the agent to identify the regions in which…

This paper addresses the portfolio selection problem for nonlinear law-dependent preferences in continuous time, which inherently exhibit time inconsistency. Employing the method of stochastic maximum principle, we establish verification…

Mathematical Finance · Quantitative Finance 2023-11-15 Zongxia Liang , Jianming Xia , Fengyi Yuan

Motivated by the widespread use of temporal-difference (TD-) and Q-learning algorithms in reinforcement learning, this paper studies a class of biased stochastic approximation (SA) procedures under a mild "ergodic-like" assumption on the…

Machine Learning · Statistics 2020-09-02 Gang Wang , Bingcong Li , Georgios B. Giannakis

Real-world multiobjective optimization problems usually involve conflicting objectives that change over time, which requires the optimization algorithms to quickly track the Pareto optimal front (POF) when the environment changes. In recent…

Neural and Evolutionary Computing · Computer Science 2021-02-25 Dejun Xu , Min Jiang , Weizhen Hu , Shaozi Li , Renhu Pan , Gary G. Yen

Recent control algorithms for Markov decision processes (MDPs) have been designed using an implicit analogy with well-established optimization algorithms. In this paper, we adopt the quasi-Newton method (QNM) from convex optimization to…

Optimization and Control · Mathematics 2026-01-06 Mohammad Amin Sharifi Kolarijani , Peyman Mohajerin Esfahani

Stochastic first-order methods are standard for training large-scale machine learning models. Random behavior may cause a particular run of an algorithm to result in a highly suboptimal objective value, whereas theoretical guarantees are…

Optimization and Control · Mathematics 2024-09-02 Eduard Gorbunov , Marina Danilova , Innokentiy Shibaev , Pavel Dvurechensky , Alexander Gasnikov

It is well-known that decision-making problems from stochastic control can be formulated by means of a forward-backward stochastic differential equation (FBSDE). Recently, the authors of Ji et al. 2022 proposed an efficient deep learning…

Optimization and Control · Mathematics 2024-08-01 Zhipeng Huang , Balint Negyesi , Cornelis W. Oosterlee

Stochastic dominance is a technique for evaluating the performance of online algorithms that provides an intuitive, yet powerful stochastic order between the compared algorithms. Accordingly this holds for bijective analysis, which can be…

Data Structures and Algorithms · Computer Science 2016-07-22 Spyros Angelopoulos , Marc P. Renault , Pascal Schweitzer

Statistical query (SQ) algorithms are algorithms that have access to an {\em SQ oracle} for the input distribution $D$ instead of i.i.d.~ samples from $D$. Given a query function $\phi:X \rightarrow [-1,1]$, the oracle returns an estimate…

Machine Learning · Computer Science 2017-04-18 Vitaly Feldman

A new formulation of Stochastic Model Predictive Output Feedback Control is presented and analyzed as a translation of Stochastic Optimal Output Feedback Control into a receding horizon setting. This requires lifting the design into a…

Optimization and Control · Mathematics 2020-05-01 Martin A Sehr , Robert R Bitmead

Stochastic Optimal Control Problems (SOCPs) plays a major role in the sequential decision-making challenges. There exist various iterative algorithms, under framework of stochastic maximum principle, that sequentially find the optimal…

Optimization and Control · Mathematics 2026-03-17 Mohsen Amidzadeh

Offline preference optimization is a key method for enhancing and controlling the quality of Large Language Model (LLM) outputs. Typically, preference optimization is approached as an offline supervised learning task using manually-crafted…

Machine Learning · Computer Science 2024-11-05 Chris Lu , Samuel Holt , Claudio Fanconi , Alex J. Chan , Jakob Foerster , Mihaela van der Schaar , Robert Tjarko Lange

We consider the control problem of the stochastic Navier-Stokes equations in multidimensional domains introduced in \cite{ocpc} restricted to noise terms defined by Q-Wiener processes. Using a stochastic maximum principle, we derive a…

Optimization and Control · Mathematics 2018-10-30 Peter Benner , Christoph Trautwein

In recent years, a range of measures of partial stochastic dominance have been introduced. These measures attempt to determine the extent to which one distribution is dominated by another. We assess these measures from intuitive, axiomatic,…

Probability · Mathematics 2024-10-01 Takashi Kamihigashi , John Stachurski