English
Related papers

Related papers: Model-Adaptive Approach to Dynamic Discrete Choice…

200 papers

Stochastic gradient descent (SGD) is a powerful optimization technique that is particularly useful in online learning scenarios. Its convergence analysis is relatively well understood under the assumption that the data samples are…

Machine Learning · Computer Science 2024-10-03 Ethan Che , Jing Dong , Xin T. Tong

The motivation for this paper stems from the desire to develop an adaptive sampling method for solving constrained optimization problems in which the objective function is stochastic and the constraints are deterministic. The method…

Optimization and Control · Mathematics 2021-01-01 Yuchen Xie , Raghu Bollapragada , Richard Byrd , Jorge Nocedal

Continuous-time Markov decision processes are an important class of models in a wide range of applications, ranging from cyber-physical systems to synthetic biology. A central problem is how to devise a policy to control the system in order…

Systems and Control · Computer Science 2016-06-01 Ezio Bartocci , Luca Bortolussi , Tomǎš Brázdil , Dimitrios Milios , Guido Sanguinetti

Stochastic-gradient-based optimization has been a core enabling methodology in applications to large-scale problems in machine learning and related areas. Despite the progress, the gap between theory and practice remains significant, with…

Optimization and Control · Mathematics 2021-01-01 Lihua Lei , Michael I. Jordan

This paper investigates gradient-based adaptive prediction and control for nonlinear stochastic dynamical systems under a weak convexity condition on the prediction-based loss. This condition accommodates a broad range of nonlinear models…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Yujing Liu , Xin Zheng , Zhixin Liu , Lei Guo

An efficient and flexible engine for computing fixed points is critical for many practical applications. In this paper, we firstly present a goal-directed fixed point computation strategy in the logic programming paradigm. The strategy…

Programming Languages · Computer Science 2007-05-23 Hai-Feng Guo , Gopal Gupta

Generalized additive model is a powerful statistical learning and predictive modeling tool that has been applied in a wide range of applications. The need of high-dimensional additive modeling is eminent in the context of dealing with high…

Methodology · Statistics 2021-07-08 Kaixu Yang , Tapabrata Maiti

In this work we propose a deep adaptive sampling (DAS) method for solving partial differential equations (PDEs), where deep neural networks are utilized to approximate the solutions of PDEs and deep generative models are employed to…

Numerical Analysis · Mathematics 2022-07-06 Kejun Tang , Xiaoliang Wan , Chao Yang

This paper is concerned with the computing efficiency of model predictive control (MPC) problems for dynamical systems with both rate and amplitude constraints on the inputs. Instead of augmenting the decision variables of the underlying…

Optimization and Control · Mathematics 2020-03-13 Idris Kempf , Paul Goulart , Stephen Duncan

This paper presents a novel distributed active set method for model predictive control of linear systems. The method combines a primal active set strategy with a decentralized conjugate gradient method to solve convex quadratic programs. An…

Optimization and Control · Mathematics 2021-03-24 Gösta Stomberg , Alexander Engelmann , Timm Faulwasser

We propose a parallel adaptive constraint-tightening approach to solve a linear model predictive control problem for discrete-time systems, based on inexact numerical optimization algorithms and operator splitting methods. The underlying…

Optimization and Control · Mathematics 2015-03-24 Laura Ferranti , Tamas Keviczky

Deep Neural Networks and Reinforcement Learning methods have empirically shown great promise in tackling challenging combinatorial problems. In those methods a deep neural network is used as a solution generator which is then trained by…

Machine Learning · Computer Science 2023-11-08 Constantine Caramanis , Dimitris Fotakis , Alkis Kalavasis , Vasilis Kontonis , Christos Tzamos

This paper investigates adaptive model predictive control (MPC) for a class of constrained linear systems with unknown model parameters. This is also posed as the dual control problem consisting of system identification and regulation. We…

Optimization and Control · Mathematics 2020-11-24 Kunwu Zhang , Yang Shi

We propose a new method of adaptive piecewise approximation based on Sinc points for ordinary differential equations. The adaptive method is a piecewise collocation method which utilizes Poly-Sinc interpolation to reach a preset level of…

Numerical Analysis · Mathematics 2022-09-29 Omar Khalil , Hany El-Sharkawy , Maha Youssef , Gerd Baumann

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

The predictive advantage of combining several different predictive models is widely accepted. Particularly in time series forecasting problems, this combination is often dynamic to cope with potential non-stationary sources of variation…

Machine Learning · Statistics 2021-04-06 Vitor Cerqueira , Luis Torgo , Carlos Soares , Albert Bifet

Computer models are used to model complex processes in various disciplines. Often, a key source of uncertainty in the behavior of complex computer models is uncertainty due to unknown model input parameters. Statistical computer model…

Methodology · Statistics 2013-08-02 Won Chang , Murali Haran , Roman Olson , Klaus Keller

Computer models are used as replacements for physical experiments in a large variety of applications. Nevertheless, direct use of the computer model for the ultimate scientific objective is often limited by the complexity and cost of the…

Methodology · Statistics 2019-07-03 Sonja Surjanovic , William J. Welch

We develop a Bayesian framework for variable selection in linear regression with autocorrelated errors, accommodating lagged covariates and autoregressive structures. This setting occurs in time series applications where responses depend on…

Methodology · Statistics 2025-08-18 Alokesh Manna , Sujit K. Ghosh

We study the global linear convergence of policy gradient (PG) methods for finite-horizon continuous-time exploratory linear-quadratic control (LQC) problems. The setting includes stochastic LQC problems with indefinite costs and allows…

Optimization and Control · Mathematics 2024-03-05 Michael Giegrich , Christoph Reisinger , Yufei Zhang