English
Related papers

Related papers: How Big Should Your Data Really Be? Data-Driven Ne…

200 papers

Problem definition: We study a data-driven pricing problem in which a seller sets a price for a single item based on demand observed at a limited number of historical prices. Our goal is to quantify the value of such information and to…

Computer Science and Game Theory · Computer Science 2026-05-19 Achraf Bahamou , Omar Besbes , Omar Mouchtaki

Theoretical studies on transfer learning or domain adaptation have so far focused on situations with a known hypothesis class or model; however in practice, some amount of model selection is usually involved, often appearing under the…

Machine Learning · Statistics 2023-10-13 Steve Hanneke , Samory Kpotufe , Yasaman Mahdaviyeh

The cost of deriving actionable knowledge from large datasets has been decreasing thanks to a convergence of positive factors: low cost data generation, inexpensively scalable storage and processing infrastructure (cloud), software…

Databases · Computer Science 2016-04-22 Paolo Missier , Jacek Cala , Eldarina Wijaya

Supervised learning from training data with imbalanced class sizes, a commonly encountered scenario in real applications such as anomaly/fraud detection, has long been considered a significant challenge in machine learning. Motivated by…

Machine Learning · Computer Science 2019-05-27 Yunru Liu , Tingran Gao , Haizhao Yang

Machines, not humans, are the world's dominant knowledge accumulators but humans remain the dominant decision makers. Interpreting and disseminating the knowledge accumulated by machines requires expertise, time, and is prone to failure.…

Machine Learning · Computer Science 2016-06-09 Baxter S. Eaves , Patrick Shafto

Policy learning using historical observational data is an important problem that has found widespread applications. Examples include selecting offers, prices, advertisements to send to customers, as well as selecting which medication to…

Machine Learning · Computer Science 2023-09-13 Nian Si , Fan Zhang , Zhengyuan Zhou , Jose Blanchet

Motivated by stochastic optimization, we introduce the problem of learning from samples of contextual value distributions. A contextual value distribution can be understood as a family of real-valued distributions, where each sample…

Machine Learning · Computer Science 2025-05-23 Anna Heuser , Thomas Kesselheim

Dealing with distribution shifts is one of the central challenges for modern machine learning. One fundamental situation is the covariate shift, where the input distributions of data change from training to testing stages while the…

Machine Learning · Computer Science 2024-05-28 Yu-Jie Zhang , Zhen-Yu Zhang , Peng Zhao , Masashi Sugiyama

Newsvendor problems are an important and much-studied topic in stochastic inventory control. One strand of the literature on newsvendor problems is concerned with the fact that practitioners often make judgemental adjustments to the…

Optimization and Control · Mathematics 2022-09-26 Congzheng Liu , Adam N. Letchford , Ivan Svetunkov

Transfer learning allows practitioners to recognize and apply knowledge learned in previous tasks (source task) to new tasks or new domains (target task), which share some commonality. The two important factors impacting the performance of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Michael Bernico , Yuntao Li , Dingchao Zhang

The problem of statistical learning is to construct an accurate predictor of a random variable as a function of a correlated random variable on the basis of an i.i.d. training sample from their joint distribution. Allowable predictors are…

Information Theory · Computer Science 2009-04-30 Maxim Raginsky

Differences in data size per class, also known as imbalanced data distribution, have become a common problem affecting data quality. Big Data scenarios pose a new challenge to traditional imbalanced classification algorithms, since they are…

Machine Learning · Computer Science 2021-09-06 Diego García-Gil , Salvador García , Ning Xiong , Francisco Herrera

Having a sufficient quantity of quality data is a critical enabler of training effective machine learning models. Being able to effectively determine the adequacy of a dataset prior to training and evaluating a model's performance would be…

Machine Learning · Computer Science 2026-04-28 Arya Hatamian , Lionel Levine , Haniyeh Ehsani Oskouie , Majid Sarrafzadeh

We study the problem of classification with selectively labeled data, whose distribution may differ from the full population due to historical decision-making. We exploit the fact that in many applications historical decisions were made by…

Machine Learning · Statistics 2025-05-28 Jian Chen , Zhehao Li , Xiaojie Mao

This paper is concerned with sample size determination methodology for prediction models. We propose combining the individual calculations via a learning-type curve. We suggest two distinct ways of doing so, a deterministic skeleton of a…

Methodology · Statistics 2024-05-24 Alimu Dayimu , Nikola Simidjievski , Nikolaos Demiris , Jean Abraham

Consider the problem of finding a population or a probability distribution amongst many with the largest mean when these means are unknown but population samples can be simulated or otherwise generated. Typically, by selecting largest…

Probability · Mathematics 2018-09-11 Peter Glynn , Sandeep Juneja

When mining large datasets in order to predict new data, limitations of the principles behind statistical machine learning pose a serious challenge not only to the Big Data deluge, but also to the traditional assumptions that data…

Information Theory · Computer Science 2023-04-26 Felipe S. Abrahão , Hector Zenil , Fabio Porto , Michael Winter , Klaus Wehmuth , Itala M. L. D'Ottaviano

We take a unifying approach to single selection optimal stopping problems with random arrival order and independent sampling of items. In the problem we consider, a decision maker (DM) initially gets to sample each of $N$ items…

Computer Science and Game Theory · Computer Science 2021-08-11 José Correa , Andrés Cristi , Boris Epstein , José Soto

The exponential growth of volume, variety and velocity of data is raising the need for investigations of automated or semi-automated ways to extract useful patterns from the data. It requires deep expert knowledge and extensive…

Machine Learning · Computer Science 2020-07-22 Abbas Raza Ali , Marcin Budka , Bogdan Gabrys

When a new treatment is considered for use, whether a pharmaceutical drug or a search engine ranking algorithm, a typical question that arises is, will its performance exceed that of the current treatment? The conventional way to answer…

Machine Learning · Computer Science 2016-10-27 Nir Rosenfeld , Yishay Mansour , Elad Yom-Tov