中文
相关论文

相关论文: Practical algorithms for on-line sampling

200 篇论文

Data-driven algorithm design is a paradigm that uses statistical and machine learning techniques to select from a class of algorithms for a computational problem an algorithm that has the best expected performance with respect to some…

机器学习 · 计算机科学 2024-06-05 Hongyu Cheng , Sammy Khalife , Barbara Fiedorowicz , Amitabh Basu

Though neural network models demonstrate impressive performance, we do not understand exactly how these black-box models make individual predictions. This drawback has led to substantial research devoted to understand these models in areas…

机器学习 · 计算机科学 2020-01-10 Serena Booth , Ankit Shah , Yilun Zhou , Julie Shah

Hypothesis testing in high dimensional data is a notoriously difficult problem without direct access to competing models' likelihood functions. This paper argues that statistical divergences can be used to quantify the difference between…

数据分析、统计与概率 · 物理学 2024-08-02 Jeremy J. H. Wilkinson , Christopher G. Lester

Hypothesis testing is a statistical method used to draw conclusions about populations from sample data, typically represented in tables. With the prevalence of graph representations in real-life applications, hypothesis testing in graphs is…

机器学习 · 统计学 2025-02-27 Yun Wang , Chrysanthi Kosyfaki , Sihem Amer-Yahia , Reynold Cheng

For many tasks of data analysis, we may only have the information of the explanatory variable and the evaluation of the response values are quite expensive. While it is impractical or too costly to obtain the responses of all units, a…

统计计算 · 统计学 2023-04-07 Wei Zheng , Ting Tian , Xueqin Wang

This paper proposes an efficient example selection method for example-based word sense disambiguation systems. To construct a practical size database, a considerable overhead for manual sense disambiguation is required. Our method is…

cmp-lg · 计算机科学 2008-02-03 Atsushi Fujii , Kentaro Inui , Takenobu Tokunaga , Hozumi Tanaka

Many machine learning algorithms are based on the assumption that training examples are drawn independently. However, this assumption does not hold anymore when learning from a networked sample where two or more training examples may share…

机器学习 · 计算机科学 2017-02-21 Yuyi Wang , Jan Ramon , Zheng-Chu Guo

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

机器学习 · 计算机科学 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

We propose a hypothesis test based model selection criterion for the best subset selection of sparse linear models. We show it is consistent in that the probability of its choosing the true model approaches one and the parameter values of…

统计方法学 · 统计学 2020-11-17 Min Tsao

Online learning aims to perform nearly as well as the best hypothesis in hindsight. For some hypothesis classes, though, even finding the best hypothesis offline is challenging. In such offline cases, local search techniques are often…

人工智能 · 计算机科学 2012-06-18 Michael Bowling , Martin Zinkevich

One popular method for dealing with large-scale data sets is sampling. For example, by using the empirical statistical leverage scores as an importance sampling distribution, the method of algorithmic leveraging samples and rescales…

统计方法学 · 统计学 2013-06-25 Ping Ma , Michael W. Mahoney , Bin Yu

In the era of big data, analysts usually explore various statistical models or machine learning methods for observed data in order to facilitate scientific discoveries or gain predictive power. Whatever data and fitting procedures are…

机器学习 · 统计学 2018-10-24 Jie Ding , Vahid Tarokh , Yuhong Yang

A general Bayesian framework for model selection on random network models regarding their features is considered. The goal is to develop a principle Bayesian model selection approach to compare different fittable, not necessarily nested,…

统计方法学 · 统计学 2020-04-30 Papamichalis Marios

In Machine Learning, feature selection entails selecting a subset of the available features in a dataset to use for model development. There are many motivations for feature selection, it may result in better models, it may provide insight…

机器学习 · 计算机科学 2021-06-14 Padraig Cunningham , Bahavathy Kathirgamanathan , Sarah Jane Delany

This paper proposes an efficient example sampling method for example-based word sense disambiguation systems. To construct a database of practical size, a considerable overhead for manual sense disambiguation (overhead for supervision) is…

计算与语言 · 计算机科学 2007-05-23 Atsushi Fujii , Kentaro Inui , Takenobu Tokunaga , Hozumi Tanaka

We describe two techniques that significantly improve the running time of several standard machine-learning algorithms when data is sparse. The first technique is an algorithm that effeciently extracts one-way and two-way counts--either…

机器学习 · 计算机科学 2015-05-19 David Maxwell Chickering , David Heckerman

In this paper, we present a general scheme for building reproducible and extensible datasets for website phishing detection. The aim is to (1) enable comparison of systems using different features, (2) overtake the short-lived nature of…

密码学与安全 · 计算机科学 2024-04-24 Abdelhakim Hannousse , Salima Yahiouche

From social networks to P2P systems, network sampling arises in many settings. We present a detailed study on the nature of biases in network sampling strategies to shed light on how best to sample from networks. We investigate connections…

社会与信息网络 · 计算机科学 2011-09-20 Arun S. Maiya , Tanya Y. Berger-Wolf

Experimental comparisons of performance represent an important aspect of research on optimization algorithms. In this work we present a methodology for defining the required sample sizes for designing experiments with desired statistical…

神经与进化计算 · 计算机科学 2018-10-16 Felipe Campelo , Fernanda Takahashi

Increasing digitalization enables the use of machine learning methods for analyzing and optimizing manufacturing processes. A main application of machine learning is the construction of quality prediction models, which can be used, among…