English
Related papers

Related papers: Balanced Identification as an Intersection of Opti…

200 papers

Frequentist statistical methods, such as hypothesis testing, are standard practice in papers that provide benchmark comparisons. Unfortunately, these methods have often been misused, e.g., without testing for their statistical test…

Methodology · Statistics 2021-05-18 David Issa Mattos , Jan Bosch , Helena Holmström Olsson

In this paper, we propose a novel online optimization algorithm built by combining ideas from control theory and system identification. The foundation of our algorithm is a control-based design that makes use of the internal model of the…

Optimization and Control · Mathematics 2025-11-26 Wouter J. A. van Weerelt , Lantian Zhang , Silun Zhang , Nicola Bastianello

As machine learning models grow increasingly competent, their predictions can supplement scarce or expensive data in various important domains. In support of this paradigm, algorithms have emerged to combine a small amount of high-fidelity…

Machine Learning · Computer Science 2025-07-08 Zhun Deng , Thomas P Zollo , Benjamin Eyre , Amogh Inamdar , David Madras , Richard Zemel

We tackle the problem of system identification, where we select inputs, observe the corresponding outputs from the true system, and optimize the parameters of our model to best fit the data. We propose a practical and computationally…

Systems and Control · Electrical Eng. & Systems 2025-10-02 Alexandros E. Tzikas , Mykel J. Kochenderfer

Models notoriously suffer from dataset biases which are detrimental to robustness and generalization. The identify-emphasize paradigm shows a promising effect in dealing with unknown biases. However, we find that it is still plagued by two…

Machine Learning · Computer Science 2022-11-29 Bowen Zhao , Chen Chen , Qian-Wei Wang , Anfeng He , Shu-Tao Xia

The exploration of complex physical or technological processes usually requires exploiting available information from different sources: (i) physical laws often represented as a family of parameter dependent partial differential equations…

Numerical Analysis · Mathematics 2020-02-04 Albert Cohen , Wolfgang Dahmen , Ron DeVore

In critical decision support systems based on medical imaging, the reliability of AI-assisted decision-making is as relevant as predictive accuracy. Although deep learning models have demonstrated significant accuracy, they frequently…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Hua Xu , Julián D. Arias-Londoño , Juan I. Godino-Llorente

Effective and accurate model selection is an important problem in modern data analysis. One of the major challenges is the computational burden required to handle large data sets that cannot be stored or processed on one machine. Another…

Machine Learning · Statistics 2018-06-26 Michael Minyi Zhang , Henry Lam , Lizhen Lin

We present a new theoretical and numerical assessment methodology for a one-dimensional process chain with general applicability to management problems such as the optimization of decision chains or production chains. The process is thereby…

Economics · Quantitative Finance 2017-12-04 Johannes Freiesleben , Nicolas Guérin

The integration of fairness and privacy in centralized data-driven applications is critical, especially as these systems increasingly influence sectors with significant societal impact. Current methods rarely address privacy, fairness, and…

Machine Learning · Computer Science 2026-05-26 Imesh Ekanayake , Elham Naghizade , Jeffrey Chan

Multidimensional population balance models (PBMs) describe chemical and biological processes having a distribution over two or more intrinsic properties (such as size and age, or two independent spatial variables). The incorporation of…

Computational Engineering, Finance, and Science · Computer Science 2025-04-29 Pavan Inguva , Richard D. Braatz

Uncertainty quantification is a central challenge in reliable and trustworthy machine learning. Naive measures such as last-layer scores are well-known to yield overconfident estimates in the context of overparametrized neural networks.…

Machine Learning · Computer Science 2023-05-24 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

The classification of the most used load balancing algorithms in distributed systems (including cloud technology, cluster systems, grid systems) is described. Comparative analysis of types of the load balancing algorithms is conducted in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-15 Igor Ivanisenko , Tamara Radivilova

Studies on simulation input uncertainty often built on the availability of input data. In this paper, we investigate an inverse problem where, given only the availability of output data, we nonparametrically calibrate the input models and…

Optimization and Control · Mathematics 2018-01-09 Aleksandrina Goeva , Henry Lam , Huajie Qian , Bo Zhang

This paper provides both an introduction to and a detailed overview of the principles and practice of classifier calibration. A well-calibrated classifier correctly quantifies the level of uncertainty or confidence associated with its…

Machine Learning · Computer Science 2023-06-16 Telmo Silva Filho , Hao Song , Miquel Perello-Nieto , Raul Santos-Rodriguez , Meelis Kull , Peter Flach

This paper presents a class of new algorithms for distributed statistical estimation that exploit divide-and-conquer approach. We show that one of the key benefits of the divide-and-conquer strategy is robustness, an important…

Statistics Theory · Mathematics 2018-08-29 Stanislav Minsker , Nate Strawn

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

In multi-center clinical trials, due to various reasons, the individual-level data are strictly restricted to be assessed publicly. Instead, the summarized information is widely available from published results. With the advance of…

Methodology · Statistics 2021-01-05 Jing Qin , Yukun Liu , Pengfei Li

We consider the problem of solving a large-scale system of linear equations in a distributed or federated manner by a taskmaster and a set of machines, each possessing a subset of the equations. We provide a comprehensive comparison of two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-24 Boris Velasevic , Rohit Parasnis , Christopher G. Brinton , Navid Azizan

As machine learning systems become democratized, it becomes increasingly important to help users easily debug their models. However, current data tools are still primitive when it comes to helping users trace model performance problems all…

Databases · Computer Science 2019-01-08 Yeounoh Chung , Tim Kraska , Neoklis Polyzotis , Ki Hyun Tae , Steven Euijong Whang