English
Related papers

Related papers: Optimal Sampling for Generalized Linear Model unde…

200 papers

Numerical simulations on mobile devices are an important tool for engineers and decision makers in the field. However, providing simulation results on mobile devices is challenging due to the complexity of the simulation, requiring remote…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-26 Christoph Dibak , Wolfgang Nowak , Frank Dürr , Kurt Rothermel

The transition of the power grid requires new technologies and methodologies, which can only be developed and tested in simulations. Especially larger simulation setups with many levels of detail can become quite slow. Therefore, the number…

Signal Processing · Electrical Eng. & Systems 2020-06-23 Stephan Balduin , Tom Westermann , Erika Puiutta

This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand…

Machine Learning · Computer Science 2024-04-04 Diego Botache , Jens Decke , Winfried Ripken , Abhinay Dornipati , Franz Götz-Hahn , Mohamed Ayeb , Bernhard Sick

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

Model merging techniques aim to integrate the abilities of multiple models into a single model. Most model merging techniques have hyperparameters, and their setting affects the performance of the merged model. Because several existing…

Machine Learning · Computer Science 2025-09-03 Rio Akizuki , Yuya Kudo , Nozomu Yoshinari , Yoichi Hirose , Toshiyuki Nishimoto , Kento Uchida , Shinichi Shirakawa

Neural network surrogate models have emerged as a promising approach to model solution fields for a wide variety of boundary value problems encountered in physical modeling. Stochastic problems represent an area of particularly high…

Machine Learning · Statistics 2026-05-18 Noah Wade , Kirubel Teferra

Random sampling has become a critical tool in solving massive matrix problems. For linear regression, a small, manageable set of data rows can be randomly selected to approximate a tall, skinny data matrix, improving processing time…

Data Structures and Algorithms · Computer Science 2014-08-22 Michael B. Cohen , Yin Tat Lee , Cameron Musco , Christopher Musco , Richard Peng , Aaron Sidford

The offline time of the reduced basis method can be very long given a large training set of parameter samples. This usually happens when the system has more than two independent parameters. On the other hand, if the training set includes…

Numerical Analysis · Mathematics 2023-04-04 Sridhar Chellappa , Lihong Feng , Peter Benner

In semi-supervised learning, the prevailing understanding suggests that observing additional unlabeled samples improves estimation accuracy for linear parameters only in the case of model misspecification. In this work, we challenge such a…

Methodology · Statistics 2025-09-03 Kai Chen , Yuqian Zhang

In this paper, we propose a sampling algorithm based on state-of-the-art statistical machine learning techniques to obtain conditional nonlinear optimal perturbations (CNOPs), which is different from traditional (deterministic) optimization…

Optimization and Control · Mathematics 2024-03-26 Bin Shi , Guodong Sun

Online media platforms often need to measure how frequently users are exposed to specific content attributes in order to evaluate trade-offs in A/B experiments. A direct approach is to sample content, label it using a high-quality rubric…

Applications · Statistics 2026-02-19 Zehao Xu , Tony Paek , Kevin O'Sullivan , Attila Dobi

We present an algorithm for a class of statistical inference problems. The main idea is to reformulate the inference problem as an optimization procedure, based on the generation of surrogate (auxiliary) functions. This approach is…

Optimization and Control · Mathematics 2018-05-22 Rodrigo Carvajal , Rafael Orellana , Dimitrios Katselis , Pedro Escárate , Juan. C. Agüero

Semi-supervised learning has received increasingly attention in statistics and machine learning. In semi-supervised learning settings, a labeled data set with both outcomes and covariates and an unlabeled data set with covariates only are…

Machine Learning · Statistics 2024-02-26 Zhuojun Quan , Yuanyuan Lin , Kani Chen , Wen Yu

When evaluating the effectiveness of a treatment, policy, or intervention, the desired measure of effectiveness may be expensive to collect, not routinely available, or may take a long time to occur. In these cases, it is sometimes possible…

Methodology · Statistics 2022-11-10 Denis Agniel , Layla Parast , Boris Hejblum

While a broad range of techniques have been proposed to tackle distribution shift, the simple baseline of training on an $\textit{undersampled}$ balanced dataset often achieves close to state-of-the-art-accuracy across several popular…

Machine Learning · Computer Science 2023-06-21 Niladri S. Chatterji , Saminul Haque , Tatsunori Hashimoto

Prediction rule ensembles (PRE) provide interpretable prediction models with relatively high accuracy.PRE obtain a large set of decision rules from a (boosted) decision tree ensemble, and achieves sparsitythrough application of…

Machine Learning · Statistics 2021-09-29 Benny Markovitch , Marjolein Fokkema

Model extraction attacks have become serious issues for service providers using machine learning. We consider an adversarial setting to prevent model extraction under the assumption that attackers will make their best guess on the service…

Machine Learning · Computer Science 2021-03-12 Yuto Mori , Atsushi Nitanda , Akiko Takeda

In this paper, a new sequential surrogate-based optimization (SSBO) algorithm is developed, which aims to improve the global search ability and local search efficiency for the global optimization of expensive black-box models. The proposed…

Machine Learning · Statistics 2018-11-30 Chunlin Gong , Xu Li , Hua Su , Jinlei Guo , Liangxian Gu

The use of surrogate models instead of computationally expensive simulation codes is very convenient in engineering. Roughly speaking, there are two kinds of surrogate models: the deterministic and the probabilistic ones. These last are…

Applications · Statistics 2015-12-24 Malek Ben Salem , Olivier Roustant , Fabrice Gamboa , Lionel Tomaso

We formulate the problem of performing optimal data compression under the constraints that compressed data can be used for accurate classification in machine learning. We show that this translates to a problem of minimizing the mutual…

Signal Processing · Electrical Eng. & Systems 2022-11-04 Jingchao Gao , Ao Tang , Weiyu Xu