English
Related papers

Related papers: Analytic solutions for locally optimal designs for…

200 papers

This work concerns the analysis and design of distributed first-order optimization algorithms over time-varying graphs. The goal of such algorithms is to optimize a global function that is the average of local functions using only local…

Optimization and Control · Mathematics 2020-02-17 Akhil Sundararajan , Bryan Van Scoy , Laurent Lessard

In this paper we propose and study local linear and polynomial based estimators for implementing Approximate Bayesian Computation (ABC) style indirect inference and GMM estimators. This method makes use of nonparametric regression in the…

Statistics Theory · Mathematics 2020-03-13 Michael Creel , Jiti Gao , Han Hong , Dennis Kristensen

Graphical models are useful tools for describing structured high-dimensional probability distributions. Development of efficient algorithms for learning graphical models with least amount of data remains an active research topic.…

Machine Learning · Computer Science 2021-11-18 Marc Vuffray , Sidhant Misra , Andrey Y. Lokhov

In the common linear regression model the problem of determining optimal designs for least squares estimation is considered in the case where the observations are correlated. A necessary condition for the optimality of a given design is…

Statistics Theory · Mathematics 2013-03-13 Holger Dette , Andrey Pepelyshev , Anatoly Zhigljavsky

Despite recent advances in algorithmic fairness, methodologies for achieving fairness with generalized linear models (GLMs) have yet to be explored in general, despite GLMs being widely used in practice. In this paper we introduce two…

Machine Learning · Statistics 2022-06-22 Hyungrok Do , Preston Putzel , Axel Martin , Padhraic Smyth , Judy Zhong

Distributed model fitting refers to the process of fitting a mathematical or statistical model to the data using distributed computing resources, such that computing tasks are divided among multiple interconnected computers or nodes, often…

Computation · Statistics 2024-06-04 Xiaofei Wu , Rongmei Liang , Fabio Roli , Marcello Pelillo , Jing Yuan

Deep learning has recently been applied to various research areas of design optimization. This study presents the need and effectiveness of adopting deep learning for generative design (or design exploration) research area. This work…

Machine Learning · Computer Science 2020-05-27 Sangeun Oh , Yongsu Jung , Seongsin Kim , Ikjin Lee , Namwoo Kang

We introduce graph gamma process (GGP) linear dynamical systems to model real-valued multivariate time series. For temporal pattern discovery, the latent representation under the model is used to decompose the time series into a…

Methodology · Statistics 2020-07-28 Rahi Kalantari , Mingyuan Zhou

Generalized Additive Models (GAMs) are widely used explainable-by-design models in various applications. GAMs assume that the output can be represented as a sum of univariate functions, referred to as components. However, this assumption…

Machine Learning · Computer Science 2023-09-22 Vasilis Gkolemis , Anargiros Tzerefos , Theodore Dalamagas , Eirini Ntoutsi , Christos Diou

Adaptive Moment Estimation (ADAM) is a very popular training algorithm for deep neural networks and belongs to the family of adaptive gradient descent optimizers. However to the best of the authors knowledge no complete convergence analysis…

Machine Learning · Computer Science 2021-02-22 Sebastian Bock , Martin Georg Weiß

We investigate R-optimal designs for multi-response regression models with multi-factors, where the random errors in these models are correlated. Several theoretical results are derived for Roptimal designs, including scale invariance,…

Methodology · Statistics 2019-10-08 Pengqi Liu , Lucy Gao , Julie Zhou

We propose a general method for constructing confidence intervals and statistical tests for single or low-dimensional components of a large parameter vector in a high-dimensional model. It can be easily adjusted for multiplicity taking…

Statistics Theory · Mathematics 2014-06-24 Sara van de Geer , Peter Bühlmann , Ya'acov Ritov , Ruben Dezeure

This paper studies optimal estimation of large-dimensional nonlinear factor models. The key challenge is that the observed variables are possibly nonlinear functions of some latent variables where the functional forms are left unspecified.…

Statistics Theory · Mathematics 2023-11-14 Yingjie Feng

We consider the problem of constructing optimal designs for model discrimination between competing regression models. Various new properties of optimal designs with respect to the popular $T$-optimality criterion are derived, which in many…

Statistics Theory · Mathematics 2009-08-14 Holger Dette , Stefanie Titoff

We study pattern formation for a variational model displaying competition between a local term penalizing interfaces and a non-local term favoring oscillations. By means of a $\Gamma$--convergence analysis, we show that as the parameter J…

Analysis of PDEs · Mathematics 2017-08-22 Michael Goldman , Eris Runa

Strategic classification~(SC) explores how individuals or entities modify their features strategically to achieve favorable classification outcomes. However, existing SC methods, which are largely based on linear models or shallow neural…

The quality of generalized linear models (GLMs), frequently used by insurance companies, depends on the choice of interacting variables. The search for interactions is time-consuming, especially for data sets with a large number of…

Machine Learning · Statistics 2025-05-21 Yevhen Havrylenko , Julia Heger

The paper provides global optimization algorithms for two particularly difficult nonconvex problems raised by hybrid system identification: switching linear regression and bounded-error estimation. While most works focus on local…

Machine Learning · Computer Science 2017-11-27 Fabien Lauer

Learning to sample from intractable distributions over discrete sets without relying on corresponding training data is a central problem in a wide range of fields, including Combinatorial Optimization. Currently, popular deep learning-based…

Machine Learning · Computer Science 2025-08-25 Sebastian Sanokowski , Sepp Hochreiter , Sebastian Lehner

The maximum likelihood estimator (MLE) is pivotal in statistical inference, yet its application is often hindered by the absence of closed-form solutions for many models. This poses challenges in real-time computation scenarios,…

Methodology · Statistics 2025-04-16 Pedro L. Ramos , Eduardo Ramos , Francisco A. Rodrigues , Francisco Louzada