English
Related papers

Related papers: How Many Samples Required in Big Data Collection: …

200 papers

An important question that often arises in the operation of networked systems is whether to collect the real-time data or to estimate them based on the previously collected data. Various factors should be taken into account such as how…

Optimization and Control · Mathematics 2021-03-30 Jalal Arabneydi , Amir G. Aghdam

We propose the Deep Distance Measurement Method (DDMM) to improve retrieval accuracy in unsupervised multivariate time series similarity retrieval. DDMM enables learning of minute differences within states in the entire time series and…

Machine Learning · Computer Science 2026-03-16 Susumu Naito , Kouta Nakata , Yasunori Taguchi

Divergence is not only an important mathematical concept in information theory, but also applied to machine learning problems such as low-dimensional embedding, manifold learning, clustering, classification, and anomaly detection. We…

Computation · Statistics 2016-11-22 Kun Yang , Hao Su , Wing Hung Wong

Recently, a Distribution Separation Method (DSM) is proposed for relevant feedback in information retrieval, which aims to approximate the true relevance distribution by separating a seed irrelevance distribution from the mixture one. While…

Information Retrieval · Computer Science 2015-10-19 Peng Zhang , Qian Yu , Yuexian Hou , Dawei Song , Jingfei Li , Bin Hu

Real-world large-scale datasets usually contain noisy labels and are imbalanced. Therefore, we propose derivative manipulation (DM), a novel and general example weighting approach for training robust deep models under these adverse…

Machine Learning · Computer Science 2020-10-06 Xinshao Wang , Elyor Kodirov , Yang Hua , Neil M. Robertson

Importance sampling is a well developed method in statistics. Given a random variable $X$, the problem of estimating its expected value $\mu$ is addressed. The standard approach is to use the sample mean as an estimator $\bar x$. In…

Applications · Statistics 2014-05-09 Georg Hofmann

Differential privacy (DP) considers a scenario, where an adversary has almost complete information about the entries of a database This worst-case assumption is likely to overestimate the privacy thread for an individual in real life.…

Cryptography and Security · Computer Science 2025-04-16 Dennis Breutigam , Rüdiger Reischuk

Importance sampling, which involves sampling from a probability density function (PDF) proportional to the product of an importance weight function and a base PDF, is a powerful technique with applications in variance reduction, biased or…

Machine Learning · Computer Science 2025-02-10 Heasung Kim , Taekyun Lee , Hyeji Kim , Gustavo de Veciana

Kernel embeddings of distributions and the Maximum Mean Discrepancy (MMD), the resulting distance between distributions, are useful tools for fully nonparametric two-sample testing and learning on distributions. However, it is rarely that…

Machine Learning · Statistics 2017-11-07 Ho Chung Leon Law , Christopher Yau , Dino Sejdinovic

Differential privacy is becoming one gold standard for protecting the privacy of publicly shared data. It has been widely used in social science, data science, public health, information technology, and the U.S. decennial census.…

Cryptography and Security · Computer Science 2022-06-07 Xuan Bi , Xiaotong Shen

We present a complete framework for determining the asymptotic (or logarithmic) efficiency of estimators of large deviation probabilities and rate functions based on importance sampling. The framework relies on the idea that importance…

Statistical Mechanics · Physics 2021-10-26 Arnaud Guyader , Hugo Touchette

A protocol for distributed estimation of discrete distributions is proposed. Each agent begins with a single sample from the distribution, and the goal is to learn the empirical distribution of the samples. The protocol is based on a simple…

Optimization and Control · Mathematics 2014-06-06 Anand D. Sarwate , Tara Javidi

This paper focuses on the problem of finding a particular data recommendation strategy based on the user preferences and a system expected revenue. To this end, we formulate this problem as an optimization by designing the recommendation…

Information Theory · Computer Science 2024-12-20 Shanyun Liu , Yunquan Dong , Pingyi Fan , Rui She , Shuo Wan

Importance sampling is a variance reduction technique for efficient estimation of rare-event probabilities by Monte Carlo. In standard importance sampling schemes, the system is simulated using an a priori fixed change of measure suggested…

Probability · Mathematics 2007-05-23 Paul Dupuis , Hui Wang

We study person-level differentially private (DP) mean estimation in the case where each person holds multiple samples. DP here requires the usual notion of distributional stability when $\textit{all}$ of a person's datapoints can be…

Data Structures and Algorithms · Computer Science 2024-07-22 Sushant Agarwal , Gautam Kamath , Mahbod Majid , Argyris Mouzakis , Rose Silver , Jonathan Ullman

The use of multiple Decision Models (DMs) enables to enhance the accuracy in decisions and at the same time allows users to evaluate the confidence in decision making. In this paper we explore the ability of multiple DMs to learn from a…

Artificial Intelligence · Computer Science 2008-05-27 Vitaly Schetinin , Dayou Li , Carsten Maple

An empirical investigation of the interaction of sample size and discretization - in this case the entropy-based method CAIM (Class-Attribute Interdependence Maximization) - was undertaken to evaluate the impact and potential bias…

Machine Learning · Statistics 2012-01-09 Casey Bennett

Learning the differential statistical dependency network between two contexts is essential for many real-life applications, mostly in the high dimensional low sample regime. In this paper, we propose a novel differential network estimator…

Machine Learning · Computer Science 2022-04-25 Arshdeep Sekhon , Zhe Wang , Yanjun Qi

The performance of multi-domain image-to-image translation has been significantly improved by recent progress in deep generative models. Existing approaches can use a unified model to achieve translations between all the visual domains.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Jie Cao , Huaibo Huang , Yi Li , Ran He , Zhenan Sun

Real-world data typically contain a large number of features that are often heterogeneous in nature, relevance, and also units of measure. When assessing the similarity between data points, one can build various distance measures using…

Machine Learning · Statistics 2022-05-27 Aldo Glielmo , Claudio Zeni , Bingqing Cheng , Gabor Csanyi , Alessandro Laio