English
Related papers

Related papers: Optimizing Input Data Collection for Ranking and S…

200 papers

We propose a technique called Optimal Analysis-Specific Importance Sampling (OASIS) to reduce the number of simulated events required for a high-energy experimental analysis to reach a target sensitivity. We provide recipes to obtain the…

High Energy Physics - Phenomenology · Physics 2021-02-17 Konstantin T. Matchev , Prasanth Shyamsundar

We consider distributed statistical optimization in one-shot setting, where there are $m$ machines each observing $n$ i.i.d. samples. Based on its observed samples, each machine then sends an $O(\log(mn))$-length message to a server, at…

Machine Learning · Computer Science 2019-11-12 Arsalan Sharifnassab , Saber Salehkaleybar , S. Jamaloddin Golestani

Modern stochastic optimization pipelines increasingly rely on learned generative models to represent uncertainty, while downstream decisions are evaluated almost entirely through Monte Carlo scenarios. This shifts the operational object of…

Optimization and Control · Mathematics 2026-05-01 Ziwei Zhang , Jonathan Yu-Meng Li

In forming learning objectives, one oftentimes needs to aggregate a set of individual values to a single output. Such cases occur in the aggregate loss, which combines individual losses of a learning model over each training sample, and in…

Machine Learning · Computer Science 2020-10-06 Shu Hu , Yiming Ying , Xin Wang , Siwei Lyu

We propose a method to optimally position a sensor system, which consists of multiple sensors, each has limited range and viewing angle, and they may fail with a certain failure rate. The goal is to find the optimal locations as well as the…

Optimization and Control · Mathematics 2016-04-20 Seong Jun Kim , Sung Ha Kang , Haomin Zhou

Dynamic and evolving operational and economic environments present significant challenges for decision-making. We explore a simulation optimization problem characterized by non-stationary input distributions with regime-switching dynamics…

Optimization and Control · Mathematics 2025-08-19 Jianglin Xia , Haowei Wang , Songhao Wang , Szu Hui Ng

Randomized benchmarking (RB) is a widely used method for estimating the average fidelity of gates implemented on a quantum computing device. The stochastic error of the average gate fidelity estimated by RB depends on the sampling strategy…

Quantum Physics · Physics 2021-09-17 Toshinari Itoko , Rudy Raymond

System identification is a fundamental problem in control and learning, particularly in high-stakes applications where data efficiency is critical. Classical approaches, such as the ordinary least squares estimator (OLS), achieve an…

Systems and Control · Electrical Eng. & Systems 2025-06-12 Xiong Zeng , Jing Yu , Necmiye Ozay

This paper tackles optimal sensor placement for Bayesian linear inverse problems, a popular version of the more general Optimal Experimental Design (OED) problem, using the D-optimality criterion. This is done by establishing connections…

Numerical Analysis · Mathematics 2025-04-07 Srinivas Eswar , Vishwas Rao , Arvind K. Saibaba

When dealing with datasets containing a billion instances or with simulations that require a supercomputer to execute, computational resources become part of the equation. We can improve the efficiency of learning and inference by…

Machine Learning · Computer Science 2014-03-06 Max Welling

The development of modern technology has enabled data collection of unprecedented size, which poses new challenges to many statistical estimation and inference problems. This paper studies the maximum score estimator of a semi-parametric…

Statistics Theory · Mathematics 2025-02-25 Xi Chen , Wenbo Jing , Weidong Liu , Yichen Zhang

We study a seemingly unexpected and relatively less understood overfitting aspect of a fundamental tool in sparse linear modeling - best subset selection, which minimizes the residual sum of squares subject to a constraint on the number of…

Methodology · Statistics 2022-01-11 Rahul Mazumder , Peter Radchenko , Antoine Dedieu

In this thesis, we focus on the design of an automatic algorithms that provide personalized ranking by adapting to the current conditions. To demonstrate the empirical efficiency of the proposed approaches we investigate their applications…

Machine Learning · Statistics 2022-05-17 Aleksandra Burashnikova

For nonparametric regression in the streaming setting, where data constantly flow in and require real-time analysis, a main challenge is that data are cleared from the computer system once processed due to limited computer memory and…

Statistics Theory · Mathematics 2022-08-19 Mingxue Quan , Zhenhua Lin

Sensor selection is a useful method to help reduce data throughput, as well as computational, power, and hardware requirements, while still maintaining acceptable performance. Although minimizing the Cram\'er-Rao bound has been adopted…

Signal Processing · Electrical Eng. & Systems 2023-08-01 Costas A. Kokke , Mario Coutiño , Laura Anitori , Richard Heusdens , Geert Leus

Convex composition optimization is an emerging topic that covers a wide range of applications arising from stochastic optimal control, reinforcement learning and multi-stage stochastic programming. Existing algorithms suffer from…

Optimization and Control · Mathematics 2020-09-01 Tianyi Lin , Chenyou Fan , Mengdi Wang , Michael I. Jordan

Designing effective score functions in Conformal Prediction (CP) for time-series data remains challenging due to conservativeness and/or computational inefficiency. We propose Optimal Selection Conformal Prediction (OSCP), which…

Optimization and Control · Mathematics 2026-05-05 Boyu Pang , Kostas Margellos

We introduce AlphaRank, an artificial intelligence approach to address the fixed-budget ranking and selection (R&S) problems. We formulate the sequential sampling decision as a Markov decision process and propose a Monte Carlo…

Machine Learning · Computer Science 2024-02-05 Ruihan Zhou , L. Jeff Hong , Yijie Peng

We introduce a new approach to develop stochastic optimization algorithms for a class of stochastic composite and possibly nonconvex optimization problems. The main idea is to combine two stochastic estimators to create a new hybrid one. We…

Optimization and Control · Mathematics 2020-05-05 Quoc Tran-Dinh , Nhan H. Pham , Dzung T. Phan , Lam M. Nguyen

A popular perspective in Reinforcement learning (RL) casts the problem as probabilistic inference on a graphical model of the Markov decision process (MDP). The core object of study is the probability of each state-action pair being visited…

Machine Learning · Computer Science 2023-11-23 Jean Tarbouriech , Tor Lattimore , Brendan O'Donoghue