English
Related papers

Related papers: Model-Adaptive Approach to Dynamic Discrete Choice…

200 papers

Model predictive control (MPC) is an optimal control method that predicts the future states of the system being controlled and estimates the optimal control inputs that drive the predicted states to the required reference. The computations…

Systems and Control · Electrical Eng. & Systems 2023-05-05 Eslam Mostafa , Hussein A. Aly , Ahmed Elliethy

We present doubly stochastic gradient MCMC, a simple and generic method for (approximate) Bayesian inference of deep generative models (DGMs) in a collapsed continuous parameter space. At each MCMC sampling step, the algorithm randomly…

Machine Learning · Computer Science 2016-03-08 Chao Du , Jun Zhu , Bo Zhang

In this paper, we propose a statistical aggregation method for agent-based models with heterogeneous agents that interact both locally on a complex adaptive network and globally on a market. The method combines three approaches from…

Theoretical Economics · Economics 2020-11-04 Jakob J. Kolb , Finn Müller-Hansen , Jürgen Kurths , Jobst Heitzig

Conjugate gradient (CG) methods are a class of important methods for solving linear equations and nonlinear optimization problems. In this paper, we propose a new stochastic CG algorithm with variance reduction and we prove its linear…

Machine Learning · Computer Science 2018-10-17 Xiao-Bo Jin , Xu-Yao Zhang , Kaizhu Huang , Guang-Gang Geng

In this paper, we propose a dynamically low-dimensional approximation method to solve a class of time-dependent multiscale stochastic diffusion equations. A dynamically bi-orthogonal (DyBO) method was developed to explore low-dimensional…

Numerical Analysis · Mathematics 2019-02-05 Eric T. Chung , Sai-Mang Pun , Zhiwen Zhang

Current causal discovery approaches require restrictive model assumptions in the absence of interventional data to ensure structure identifiability. These assumptions often do not hold in real-world applications leading to a loss of…

Machine Learning · Statistics 2025-06-25 Anish Dhir , Ruby Sedgwick , Avinash Kori , Ben Glocker , Mark van der Wilk

This paper is concerned with the detection of multiple change-points in the joint distribution of independent categorical variables. The procedures introduced rely on model selection and are based on a penalized least-squares criterion.…

Statistics Theory · Mathematics 2008-01-08 Nathalie Akakpo

We introduce a new linearly constrained minimum variance (LCMV) beamformer that combines the set-membership (SM) technique with the conjugate gradient (CG) method, and develop a low-complexity adaptive filtering algorithm for beamforming.…

Information Theory · Computer Science 2013-03-06 Lei Wang , Rodrigo C. de Lamare

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2021-10-15 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

We tackle the challenging issue of aggressive fine-tuning encountered during the process of transfer learning of pre-trained language models (PLMs) with limited labeled downstream data. This problem primarily results in a decline in…

Computation and Language · Computer Science 2023-12-13 Ibtihel Amara , Vinija Jain , Aman Chadha

Adaptive model predictive control (MPC) methods using set-membership identification to reduce parameter uncertainty are considered in this work. Strong duality is used to reformulate the set-membership equations exactly within the MPC…

Systems and Control · Electrical Eng. & Systems 2022-11-30 Anilkumar Parsi , Diyou Liu , Andrea Iannelli , Roy S. Smith

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conformal prediction has…

Machine Learning · Computer Science 2024-11-07 Erfan Hajihashemi , Yanning Shen

Distributed model training suffers from communication bottlenecks due to frequent model updates transmitted across compute nodes. To alleviate these bottlenecks, practitioners use gradient compression techniques like sparsification,…

Machine Learning · Computer Science 2020-11-02 Saurabh Agarwal , Hongyi Wang , Kangwook Lee , Shivaram Venkataraman , Dimitris Papailiopoulos

The stochastic volatility model is a popular tool for modeling the volatility of assets. The model is a nonlinear and non-Gaussian state space model, and consequently is difficult to fit. Many approaches, both classical and Bayesian, have…

Methodology · Statistics 2019-07-22 Chen Gong , David S. Stoffer

Neural networks have shown significant potential in solving partial differential equations (PDEs). While deep networks are capable of approximating complex functions, direct one-shot training often faces limitations in both accuracy and…

Numerical Analysis · Mathematics 2025-03-10 Mingxing Weng , Zhiping Mao , Jie Shen

We present a dynamic model selection approach for resource-constrained prediction. Given an input instance at test-time, a gating function identifies a prediction model for the input among a collection of models. Our objective is to…

Machine Learning · Statistics 2017-04-26 Feng Nan , Venkatesh Saligrama

This paper presents distributed adaptive algorithms based on the conjugate gradient (CG) method for distributed networks. Both incremental and diffusion adaptive solutions are all considered. The distributed conventional (CG) and modified…

Information Theory · Computer Science 2013-06-19 Songcen Xu , Rodrigo C. de Lamare

This paper proposes an Adaptive Learning Model Predictive Control strategy for uncertain constrained linear systems performing iterative tasks. The additive uncertainty is modeled as the sum of a bounded process noise and an unknown…

Systems and Control · Computer Science 2018-04-27 Monimoy Bujarbaruah , Xiaojing Zhang , Ugo Rosolia , Francesco Borrelli

Conditional generative models map input variables to complex, high-dimensional distributions, enabling realistic sample generation in a diverse set of domains. A critical challenge with these models is the absence of calibrated uncertainty,…

Machine Learning · Computer Science 2026-02-02 Qidong Yang , Qianyu Julie Zhu , Jonathan Giezendanner , Youssef Marzouk , Stephen Bates , Sherrie Wang

This paper proposes a novel low-rank approximation to the multivariate State-Space Model. The Stochastic Partial Differential Equation (SPDE) approach is applied component-wise to the independent-in-time Mat\'ern Gaussian innovation term in…