中文
相关论文

相关论文: Optimal Dynamic Subset Sampling: Theory and Applic…

200 篇论文

Data selection is essential for training deep learning models. An effective data sampler assigns proper sampling probability for training data and helps the model converge to a good local minimum with high performance. Previous studies in…

机器学习 · 计算机科学 2024-10-10 Jiawei Yao , Chuming Li , Canran Xiao

Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational efficiency. If the…

统计方法学 · 统计学 2021-07-06 Jun Yu , HaiYing Wang , Mingyao Ai , Huiming Zhang

We study a ranking and selection (R&S) problem when all solutions share common parametric Bayesian input models updated with the data collected from multiple independent data-generating sources. Our objective is to identify the best system…

统计方法学 · 统计学 2025-02-25 Eunhye Song , Taeho Kim

Probabilistic graphical models, such as Markov random fields (MRFs), are useful for describing high-dimensional distributions in terms of local dependence structures. The probabilistic inference is a fundamental problem related to graphical…

数据结构与算法 · 计算机科学 2020-11-30 Weiming Feng , Kun He , Xiaoming Sun , Yitong Yin

Adaptive sampling is a useful algorithmic tool for data summarization problems in the classical centralized setting, where the entire dataset is available to the single processor performing the computation. Adaptive sampling repeatedly…

数据结构与算法 · 计算机科学 2020-04-24 Sepideh Mahabadi , Ilya Razenshteyn , David P. Woodruff , Samson Zhou

Consistent sampling is a technique for specifying, in small space, a subset $S$ of a potentially large universe $U$ such that the elements in $S$ satisfy a suitably chosen sampling condition. Given a subset $\mathcal{I}\subseteq U$ it…

数据结构与算法 · 计算机科学 2014-04-21 Konstantin Kutzkov , Rasmus Pagh

This paper considers a problem where multiple users make repeated decisions based on their own observed events. The events and decisions at each time step determine the values of a utility function and a collection of penalty functions. The…

最优化与控制 · 数学 2013-05-13 Michael J. Neely

This paper considers the problem of minimizing the time average of a controlled stochastic process subject to multiple time average constraints on other related processes. The probability distribution of the random events in the system is…

最优化与控制 · 数学 2016-12-20 Xiaohan Wei , Hao Yu , Michael J. Neely

The diffusion phenomenon has a remarkable impact on Online Social Networks (OSNs). Gathering diffusion data over these large networks encounters many challenges which can be alleviated by adopting a suitable sampling approach. The…

社会与信息网络 · 计算机科学 2014-05-29 Motahareh Eslami Mehdiabadi , Hamid R. Rabiee , Mostafa Salehi

This paper considers a distributed stochastic optimization problem where the goal is to minimize the time average of a cost function subject to a set of constraints on the time averages of a related stochastic processes called penalties. We…

信息论 · 计算机科学 2016-10-06 B. N. Bharath , Vaishali P

Faced with massive data, subsampling is a commonly used technique to improve computational efficiency, and using nonuniform subsampling probabilities is an effective approach to improve estimation efficiency. For computational efficiency,…

统计理论 · 数学 2022-05-19 Jing Wang , Jiahui Zou , HaiYing Wang

We consider the classical makespan minimization scheduling problem where $n$ jobs must be scheduled on $m$ identical machines. Using weighted random sampling, we developed two sublinear time approximation schemes: one for the case where $n$…

数据结构与算法 · 计算机科学 2026-05-05 Bin Fu , Yumei Huo , Hairong Zhao

In computational science workflows, it is often the case that 1) objective functions for optimization involve multiple simulation outputs, and 2) those simulations can be performed (at least partially) in parallel. In this work, we…

最优化与控制 · 数学 2026-05-28 Matt Menickelly

Sub-sampling is a common and often effective method to deal with the computational challenges of large datasets. However, for most statistical models, there is no well-motivated approach for drawing a non-uniform subsample. We show that the…

机器学习 · 统计学 2017-09-07 Daniel Ting , Eric Brochu

Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with…

数据分析、统计与概率 · 物理学 2021-03-15 Grant M. Rotskoff , Andrew R. Mitchell , Eric Vanden-Eijnden

Motivated by the Internet-of-things and sensor networks for cyberphysical systems, the problem of dynamic sensor activation for the tracking of a time-varying process is examined. The tradeoff is between energy efficiency, which decreases…

系统与控制 · 计算机科学 2017-11-30 Arpan Chattopadhyay , Urbashi Mitra

We propose a method for the accurate estimation of rare event or failure probabilities for expensive-to-evaluate numerical models in high dimensions. The proposed approach combines ideas from large deviation theory and adaptive importance…

统计计算 · 统计学 2023-03-28 Shanyin Tong , Georg Stadler

This article studies the fundamental problem of using i.i.d. coin tosses from an entropy source to efficiently generate random variables $X_i \sim P_i$ $(i \ge 1)$, where $(P_1, P_2, \dots)$ is a random sequence of rational discrete…

数据结构与算法 · 计算机科学 2026-05-08 Thomas L. Draper , Feras A. Saad

This paper considers a class of real-time decision making problems to minimize the expected value of a function that depends on a random variable $\xi$ under an unknown distribution $\mathbb{P}$. In this process, samples of $\xi$ are…

最优化与控制 · 数学 2020-09-08 Dan Li , Sonia Martinez

We consider the optimal value of information (VoI) problem, where the goal is to sequentially select a set of tests with a minimal cost, so that one can efficiently make the best decision based on the observed outcomes. Existing algorithms…

人工智能 · 计算机科学 2017-07-18 Yuxin Chen , Jean-Michel Renders , Morteza Haghir Chehreghani , Andreas Krause