English
Related papers

Related papers: Time and the Value of Data

200 papers

Lossy data transformations by definition lose information. Yet, in modern machine learning, methods like data pruning and lossy data augmentation can help improve generalization performance. We study this paradox using a solvable model of…

Statistical Mechanics · Physics 2025-09-19 Alex Nguyen , David J. Schwab , Vudtiwat Ngampruetikorn

Data valuation has found various applications in machine learning, such as data filtering, efficient learning and incentives for data sharing. The most popular current approach to data valuation is the Shapley value. While popular for its…

Machine Learning · Computer Science 2023-11-10 Lauren Watson , Zeno Kujawa , Rayna Andreeva , Hao-Tsung Yang , Tariq Elahi , Rik Sarkar

Errors or failures in a high-volume manufacturing environment can have significant impact that can result in both the loss of time and money. Identifying such failures early has been a top priority for manufacturing industries and various…

Machine Learning · Computer Science 2024-07-15 Siddarth Reddy Karuka , Abhinav Sunderrajan , Zheng Zheng , Yong Woon Tiean , Ganesh Nagappan , Allan Luk

Machine learning models are essential tools in various domains, but their performance can degrade over time due to changes in data distribution or other factors. On one hand, detecting and addressing such degradations is crucial for…

Machine Learning · Computer Science 2023-09-28 Florian Heinrichs

Abstract Machine learning models, trained on data from ab initio quantum simulations, are yielding molecular dynamics potentials with unprecedented accuracy. One limiting factor is the quantity of available training data, which can be…

Computational Physics · Physics 2020-06-11 Justin S. Smith , Nicholas Lubbers , Aidan P. Thompson , Kipton Barros

Data is a critical aspect of the world we live in. With systems producing and consuming vast amounts of data, it is essential for businesses to digitally transform and be equipped to derive the most value out of data. Data analytics…

Computers and Society · Computer Science 2021-11-09 Akash Ravi

Deleting data from a trained machine learning (ML) model is a critical task in many applications. For example, we may want to remove the influence of training points that might be out of date or outliers. Regulations such as EU's General…

Machine Learning · Computer Science 2021-02-24 Zachary Izzo , Mary Anne Smart , Kamalika Chaudhuri , James Zou

Machine learning models depend on the quality of input data. As electronic health records are widely adopted, the amount of data in health care is growing, along with complaints about the quality of medical notes. We use two prediction…

Computation and Language · Computer Science 2020-12-10 Chao-Chun Hsu , Shantanu Karnwal , Sendhil Mullainathan , Ziad Obermeyer , Chenhao Tan

Prediction of stock prices plays a significant role in aiding the decision-making of investors. Considering its importance, a growing literature has emerged trying to forecast stock prices with improved accuracy. In this study, we introduce…

Statistical Finance · Quantitative Finance 2023-11-14 Md Sabbirul Haque , Md Shahedul Amin , Jonayet Miah , Duc Minh Cao , Ashiqul Haque Ahmed

Motivated by the increasing prominence of loosely-coupled systems, such as mobile and sensor networks, which are characterised by intermittent connectivity and volatile data, we study the tagging of data with so-called expiration times.…

Databases · Computer Science 2007-05-23 Albrecht Schmidt , Christian S. Jensen

Quantifying the value of data within a machine learning workflow can play a pivotal role in making more strategic decisions in machine learning initiatives. The existing Shapley value based frameworks for data valuation in machine learning…

Machine Learning · Computer Science 2024-07-10 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Hong Ming Tan , Bowei Chen , Mohan Kankanhalli

Generative data augmentation, which scales datasets by obtaining fake labeled examples from a trained conditional generative model, boosts classification performance in various learning tasks including (semi-)supervised learning, few-shot…

Machine Learning · Computer Science 2023-05-30 Chenyu Zheng , Guoqiang Wu , Chongxuan Li

In collaborative data sharing and machine learning, multiple parties aggregate their data resources to train a machine learning model with better model performance. However, as the parties incur data collection costs, they are only willing…

Synthetic augmentation is increasingly used to mitigate data scarcity in financial machine learning, yet its statistical role remains poorly understood. We formalize synthetic augmentation as a modification of the effective training…

Artificial Intelligence · Computer Science 2026-04-17 Mel Sohm , Charles Dezons , Sami Sellami , Oscar Ninou , Axel Pincon

A major factor in the recent success of large language models is the use of enormous and ever-growing text datasets for unsupervised pre-training. However, naively training a model on all available data may not be optimal (or feasible), as…

Real-time forecasting is important to the society. It uses continuous data streams to update forecasts for sustained accuracy. But the data source is vulnerable to attacks or accidents and the dynamics of forecasting failure and recovery…

Data Analysis, Statistics and Probability · Physics 2022-09-09 Sicheng Wu , Ruo-Qian Wang

The rapid progress of large language models (LLMs) is fueled by the growing reliance on datasets that blend real and synthetic data. While synthetic data offers scalability and cost-efficiency, it often introduces systematic distributional…

We characterize the structure and origins of missingness for 159 cross-sectional return predictors and study missing value handling for portfolios constructed using machine learning. Simply imputing with cross-sectional means performs well…

Methodology · Statistics 2024-01-15 Andrew Y. Chen , Jack McCoy

Evaluating the financial performance of manufacturing firms requires consideration of both the time value of money and the relative importance of multiple decision criteria. Conventional approaches relying solely on deterministic…

Theoretical Economics · Economics 2026-02-05 Duaa Abdullah , Marwa Abdullah

Machine learning models have made significant progress in load forecasting, but their forecast accuracy is limited in cases where historical load data is scarce. Inspired by the outstanding performance of large language models (LLMs) in…

Machine Learning · Computer Science 2024-12-02 Wenlong Liao , Fernando Porte-Agel , Jiannong Fang , Christian Rehtanz , Shouxiang Wang , Dechang Yang , Zhe Yang