English
Related papers

Related papers: Stochastic Frontier meets Breakdown Frontier

200 papers

We propose a new approach to apply the chaining technique in conjunction with information-theoretic measures to bound the generalization error of machine learning algorithms. Different from the deterministic chaining approach based on…

Information Theory · Computer Science 2022-01-31 Ruida Zhou , Chao Tian , Tie Liu

Many problems in computational science and engineering become one-to-many after coarse graining, partial observation, or inverse reconstruction: a resolved state may not determine a unique subgrid forcing, a structural descriptor may not…

Machine Learning · Statistics 2026-05-28 Junfeng Chen

Modelling the evolution of a system using stochastic dynamics typically implies a greater subjective uncertainty in the adopted system coordinates as time progresses, and stochastic entropy production has been developed as a measure of this…

Statistical Mechanics · Physics 2023-02-06 Jonathan Dexter , Ian J. Ford

This paper provides a unified framework for analyzing tensor estimation problems that allow for nonlinear observations, heteroskedastic noise, and covariate information. We study a general class of high-dimensional models where each…

Information Theory · Computer Science 2025-06-10 Riccardo Rossetti , Galen Reeves

In stochastic control applications, typically only an ideal model (controlled transition kernel) is assumed and the control design is based on the given model, raising the problem of performance loss due to the mismatch between the assumed…

Systems and Control · Computer Science 2020-02-04 Ali Devran Kara , Serdar Yüksel

Uncertainty quantification is a fundamental problem in the analysis and interpretation of synthetic control (SC) methods. We develop conditional prediction intervals in the SC framework, and provide conditions under which these intervals…

Methodology · Statistics 2021-09-09 Matias D. Cattaneo , Yingjie Feng , Rocio Titiunik

Consider the standard stochastic reaction network model where the dynamics is given by a continuous-time Markov chain over a discrete lattice. For such models, estimation of parameter sensitivities is an important problem, but the existing…

Quantitative Methods · Quantitative Biology 2019-05-01 Patrik Dürrenberger , Ankit Gupta , Mustafa Khammash

In this work, we investigate Batch Normalization technique and propose its probabilistic interpretation. We propose a probabilistic model and show that Batch Normalization maximazes the lower bound of its marginalized log-likelihood. Then,…

Machine Learning · Statistics 2018-03-22 Andrei Atanov , Arsenii Ashukha , Dmitry Molchanov , Kirill Neklyudov , Dmitry Vetrov

We produce approximation bounds on a semidefinite programming relaxation for sparse principal component analysis. These bounds control approximation ratios for tractable statistics in hypothesis testing problems where data points are…

Optimization and Control · Mathematics 2012-06-19 Alexandre d'Aspremont , Francis Bach , Laurent El Ghaoui

We study asymptotic behaviour of stochastic approximation procedures with three main characteristics: truncations with random moving bounds, a matrix valued random step-size sequence, and a dynamically changing random regression function.…

Statistics Theory · Mathematics 2016-11-22 Teo Sharia , Lei Zhong

In this paper we propose a solution to the problem of parameter estimation of nonlinearly parameterized regressions--continuous or discrete time--and apply it for system identification and adaptive control. We restrict our attention to…

Optimization and Control · Mathematics 2019-10-18 Romeo Ortega , Vladislav Gromov , Emmanuel Nuño , Anton Pyrkin , Jose Guadalupe Romero

The problem of statistical inference in its various forms has been the subject of decades-long extensive research. Most of the effort has been focused on characterizing the behavior as a function of the number of available samples, with far…

Machine Learning · Computer Science 2024-11-12 Tomer Berg , Or Ordentlich , Ofer Shayevitz

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

Machine Learning · Statistics 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

We consider the problem of adaptive stabilization for discrete-time, multi-dimensional linear systems with bounded control input constraints and unbounded stochastic disturbances, where the parameters of the true system are unknown. To…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Seth Siriya , Jingge Zhu , Dragan Nešić , Ye Pu

In this paper we investigate the parameter estimation of the fiber lay-down process in the production of nonwovens. The parameter estimation is based on the mass per unit area data, which is available at least on an industrial scale. We…

Probability · Mathematics 2011-12-16 Wolfgang Bock , Thomas Götz , Uditha Prabhath Liyanage

Within an industrial manufacturing process, tolerancing is a key player. The dimensions uncertainties management starts during the design phase, with an assessment on variability of parts not yet produced. For one assembly step, we can gain…

Applications · Statistics 2019-12-20 Ambre Diet , Nicolas Couellan , Xavier Gendre , Julien Martin

We propose a stochastic approximation method for approximating the efficient frontier of chance-constrained nonlinear programs. Our approach is based on a bi-objective viewpoint of chance-constrained programs that seeks solutions on the…

Optimization and Control · Mathematics 2020-05-29 Rohit Kannan , James Luedtke

In this paper, we analyze the finite sample complexity of stochastic system identification using modern tools from machine learning and statistics. An unknown discrete-time linear system evolves over time under Gaussian noise without…

Machine Learning · Computer Science 2019-03-22 Anastasios Tsiamis , George J. Pappas

Applications of data envelopment analysis (DEA) show that many inefficient units are projected onto the weakly efficient parts of the frontier when efficiency scores are computed. However this fact disagrees with the main concept of the DEA…

Optimization and Control · Mathematics 2018-04-16 Vladimir E. Krivonozhko , Finn R. Førsund , Andrey V. Lychev

Multisite phosphorylation plays an important role in regulating switchlike protein activity and has been used widely in mathematical models. With the development of new experimental techniques and more molecular data, molecular…

Molecular Networks · Quantitative Biology 2020-09-15 Minghan Chen , Mansooreh Ahmadian , Layne Watson , Yang Cao