English
Related papers

Related papers: Covariance Estimation and its Application in Large…

200 papers

The recent explosion in the amount and dimensionality of data has exacerbated the need of trading off computational and statistical efficiency carefully, so that inference is both tractable and meaningful. We propose a framework that…

Computation · Statistics 2015-06-29 Daniel L. Sussman , Alexander Volfovsky , Edoardo M. Airoldi

Large datasets are often affected by cell-wise outliers in the form of missing or erroneous data. However, discarding any samples containing outliers may result in a dataset that is too small to accurately estimate the covariance matrix.…

Statistics Theory · Mathematics 2023-11-13 Karim Lounici , Grégoire Pacreau

Simulation is a fundamental research tool in the computer architecture field. These kinds of tools enable the exploration and evaluation of architectural proposals capturing the most relevant aspects of the highly complex systems under…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-11 Adrian Colaso , Pablo Prieto , Jose-Angel Herrero , Pablo Abad , Valentin Puente , Jose-Angel Gregorio

We study operator-norm covariance estimation from heavy-tailed samples that may include a small fraction of arbitrary outliers. A simple and widely used safeguard is \emph{Euclidean norm clipping}, but its accuracy depends critically on an…

Machine Learning · Statistics 2026-02-17 Even He , Zaizai Yan

The accurate estimation of quantum observables is a critical task in science. With progress on the hardware, measuring a quantum system will become increasingly demanding, particularly for variational protocols that require extensive…

Online learning makes sequence of decisions with partial data arrival where next movement of data is unknown. In this paper, we have presented a new technique as multiple times weight updating that update the weight iteratively forsame…

Machine Learning · Computer Science 2019-01-09 Charanjeet , Anuj Sharma

Online labor markets have great potential as platforms for conducting experiments, as they provide immediate access to a large and diverse subject pool and allow researchers to conduct randomized controlled trials. We argue that online…

Human-Computer Interaction · Computer Science 2025-03-19 John J. Horton , David G. Rand , Richard J. Zeckhauser

Adaptive monitoring of a large population of dynamic processes is critical for the timely detection of abnormal events under limited resources in many healthcare and engineering systems. Examples include the risk-based disease screening and…

Machine Learning · Computer Science 2023-10-24 Tanapol Kosolwattana , Huazheng Wang , Ying Lin

Probit models are useful for modeling correlated discrete responses in many disciplines, including consumer choice data in economics and marketing. However, the Gaussian latent variable feature of probit models coupled with identification…

Methodology · Statistics 2024-09-30 Patrick Ding , Guido Imbens , Zhaonan Qu , Yinyu Ye

In this work, we consider the problem of online (real-time, single-shot) estimation of static or slow-varying parameters along quantum trajectories in quantum dynamical systems. Based on the measurement signal of a continuously-monitored…

Quantum Physics · Physics 2024-06-19 Henrik Glavind Clausen , Pierre Rouchon , Rafal Wisniewski

A common dilemma encountered by many upon implementing an optimization method or experiment, whether it be a reinforcement learning algorithm, or A/B testing, is deciding on what metric to optimize for. Very often short-term metrics, which…

Applications · Statistics 2019-06-17 Yoni Schamroth , Liron Gat Kahlon , Boris Rabinovich , David Steinberg

Simulation-based inference (SBI) is the preferred framework for estimating parameters of intractable models in science and engineering. A significant challenge in this context is the large computational cost of simulating data from complex…

Machine Learning · Statistics 2025-02-18 Ayush Bharti , Daolang Huang , Samuel Kaski , François-Xavier Briol

In this paper, we develop an online change-point detection procedure in the covariance structure of high-dimensional data. A new stopping rule is proposed to terminate the process as early as possible when a change in covariance structure…

Methodology · Statistics 2020-03-12 Lingjun Li , Jun Li

This paper presents a method for jointly estimating the state, input, and parameters of linear systems in an online fashion. The method is specially designed for measurements that are corrupted with non-Gaussian noise or outliers, which are…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Jean-Sébastien Brouillon , Keith Moffat , Florian Dörfler , Giancarlo Ferrari-Trecate

Optimizing an interactive system against a predefined online metric is particularly challenging, when the metric is computed from user feedback such as clicks and payments. The key challenge is the counterfactual nature: in the case of Web…

Machine Learning · Computer Science 2014-03-13 Lihong Li , Shunbao Chen , Jim Kleban , Ankur Gupta

Efficient methods for characterizing the performance of quantum measurements are important in the experimental quantum sciences. Ideally, one requires both a physically relevant distinguishability measure between measurement operations and…

Quantum Physics · Physics 2015-06-12 Easwar Magesan , Paola Cappellaro

Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with…

Machine Learning · Statistics 2026-03-24 Wanrong Zhu , Zhipeng Lou , Ziyang Wei , Wei Biao Wu

Modern stochastic optimization methods often rely on uniform sampling which is agnostic to the underlying characteristics of the data. This might degrade the convergence by yielding estimates that suffer from a high variance. A possible…

Machine Learning · Statistics 2018-06-07 Zalán Borsos , Andreas Krause , Kfir Y. Levy

Online experiments are the gold standard for evaluating impact on user experience and accelerating innovation in software. However, since experiments are typically limited in duration, observed treatment effects are not always permanently…

Human-Computer Interaction · Computer Science 2021-02-26 Soheil Sadeghi , Somit Gupta , Stefan Gramatovici , Jiannan Lu , Hao Ai , Ruhan Zhang

Obtaining the expectation value of an observable on a quantum computer is a crucial step in the variational quantum algorithms. For complicated observables such as molecular electronic Hamiltonians, a common strategy is to present the…

Quantum Physics · Physics 2022-04-20 Tzu-Ching Yen , Aadithya Ganeshram , Artur F. Izmaylov