English
Related papers

Related papers: Anytime valid and asymptotically optimal inference…

200 papers

Stochastic gradient descent algorithms for training linear and kernel predictors are gaining more and more importance, thanks to their scalability. While various methods have been proposed to speed up their convergence, the model selection…

Machine Learning · Computer Science 2014-06-17 Francesco Orabona

We study adaptive estimation and inference in ill-posed linear inverse problems defined by conditional moment restrictions. Existing regularized estimators such as Regularized DeepIV (RDIV) require prior knowledge of the smoothness of the…

Machine Learning · Statistics 2026-03-03 Jiyuan Tan , Vasilis Syrgkanis

We recount recent history behind building compact models of nonlinear, complex processes and identifying their relevant macroscopic patterns or "macrostates". We give a synopsis of computational mechanics, predictive rate-distortion theory,…

Statistical Mechanics · Physics 2014-12-31 James P. Crutchfield , Ryan G. James , Sarah Marzen , Dowman P. Varn

Utility preference robust optimization (PRO) has recently been proposed to deal with optimal decision making problems where the decision maker's (DM) preference over gains and losses is ambiguous. In this paper, we take a step further to…

Optimization and Control · Mathematics 2024-03-11 Jian Hu , Dali Zhang , Huifu Xu , Sainan Zhang

Algorithms with predictions} has emerged as a powerful framework to combine the robustness of traditional online algorithms with the data-driven performance benefits of machine-learned (ML) predictions. However, most existing approaches in…

Data Structures and Algorithms · Computer Science 2025-10-17 Sizhe Li , Nicolas Christianson , Tongxin Li

We propose a data-driven method to establish probabilistic performance guarantees for parametric optimization problems solved via iterative algorithms. Our approach addresses two key challenges: providing convergence guarantees to…

Optimization and Control · Mathematics 2025-10-31 Jingyi Huang , Paul Goulart , Kostas Margellos

Large Language Models (LLMs) exhibit remarkable proficiency in addressing a diverse array of tasks within the Natural Language Processing (NLP) domain, with various prompt design strategies significantly augmenting their capabilities.…

Computation and Language · Computer Science 2024-08-05 Xiangyu Zhao , Chengqian Ma

We study discrete-time predictable forward processes when trading times do not coincide with performance evaluation times in a binomial tree model for the financial market. The key step in the construction of these processes is to solve a…

Mathematical Finance · Quantitative Finance 2023-12-05 Gechun Liang , Moris S. Strub , Yuwei Wang

Linear regression is a fundamental modeling tool in statistics and related fields. In this paper, we study an important variant of linear regression in which the predictor-response pairs are partially mismatched. We use an optimization…

Optimization and Control · Mathematics 2022-11-01 Rahul Mazumder , Haoyue Wang

We propose a novel method for automatic program synthesis. P-Tree Programming represents the program search space through a single probabilistic prototype tree. From this prototype tree we form program instances which we evaluate on a given…

Artificial Intelligence · Computer Science 2017-07-13 Christian Oesch

We analyze principal component regression (PCR) in a high-dimensional error-in-variables setting with fixed design. Under suitable conditions, we show that PCR consistently identifies the unique model with minimum $\ell_2$-norm. These…

Statistics Theory · Mathematics 2023-08-28 Anish Agarwal , Devavrat Shah , Dennis Shen

It is common to encounter situations where one must solve a sequence of similar computational problems. Running a standard algorithm with worst-case runtime guarantees on each instance will fail to take advantage of valuable structure…

Machine Learning · Computer Science 2019-04-29 Daniel Alabi , Adam Tauman Kalai , Katrina Ligett , Cameron Musco , Christos Tzamos , Ellen Vitercik

Mimicking and learning the long-term memory of efficient markets is a fundamental problem in the interaction between machine learning and financial economics to sequential data. Despite the prominence of this issue, current treatments…

Machine Learning · Statistics 2021-11-12 Shao-Qun Zhang , Zhi-Hua Zhou

For high-dimensional inference problems, statisticians have a number of competing interests. On the one hand, procedures should provide accurate estimation, reliable structure learning, and valid uncertainty quantification. On the other…

Statistics Theory · Mathematics 2021-01-11 Ryan Martin

Fully connected layers are a primary source of memory and computational overhead in deep neural networks due to their dense, often redundant parameterization. While various compression techniques exist, they frequently introduce complex…

Machine Learning · Computer Science 2025-12-16 Maksymilian Szorc

We consider a symmetric mixture of linear regressions with random samples from the pairwise comparison design, which can be seen as a noisy version of a type of Euclidean distance geometry problem. We analyze the expectation-maximization…

Statistics Theory · Mathematics 2023-06-23 Abhishek Dhawan , Cheng Mao , Ashwin Pananjady

We develop a new model selection method for the adaptive robust efficient nonparametric signal estimation observed with impulse noise which is defined by the general non Gaussian L\'evy processes. On the basis of the developed method, we…

Statistics Theory · Mathematics 2018-11-27 Slim Beltaief , Oleg Chernoyarov , Serguei Pergamenchtchikov

We study Bayesian inverse problems with mixed noise, modeled as a combination of additive and multiplicative Gaussian components. While traditional inference methods often assume fixed or known noise characteristics, real-world…

Machine Learning · Computer Science 2025-10-17 Paul Hagemann , Robert Gruhlke , Bernhard Stankewitz , Claudia Schillings , Gabriele Steidl

Existing well investigated Predictive Process Monitoring techniques typically construct a predictive model based on past process executions, and then use it to predict the future of new ongoing cases, without the possibility of updating it…

Machine Learning · Computer Science 2023-10-26 Williams Rizzi , Chiara Di Francescomarino , Chiara Ghidini , Fabrizio Maria Maggi

This paper proposes an Adaptive Stochastic Model Predictive Control (MPC) strategy for stable linear time-invariant systems in the presence of bounded disturbances. We consider multi-input, multi-output systems that can be expressed by a…

Systems and Control · Electrical Eng. & Systems 2019-12-11 Monimoy Bujarbaruah , Charlott Vallon