English
Related papers

Related papers: Preserving the value of large scale data analytics…

200 papers

Careful preservation of experimental data, simulations, analysis products, and theoretical work maximizes their long-term scientific return on investment by enabling new analyses and reinterpretation of the results in the future. Key…

Computational Physics · Physics 2022-09-20 Stephen Bailey , K. S. Cranmer , Matthew Feickert , Rob Fine , Sabine Kraml , Clemens Lange

Scientific computing workflows generate enormous distributed data that is short-lived, yet critical for job completion time. This class of data is called intermediate data. A common way to achieve high data availability is to replicate…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-14 Zhe Zhang , Brian Bockelman , Derek Weitzel , David Swanson

Data valuation is concerned with determining a fair valuation of data from data sources to compensate them or to identify training examples that are the most or least useful for predictions. With the rising interest in personal data…

Machine Learning · Computer Science 2024-01-23 Xiao Tian , Rachael Hwee Ling Sim , Jue Fan , Bryan Kian Hsiang Low

In recent years there has been widespread concern in the scientific community over a reproducibility crisis. Among the major causes that have been identified is statistical: In many scientific research the statistical analysis (including…

Applications · Statistics 2017-08-17 Norman Matloff , Reed Davis , Laurel Beckett , Paul Thompson

Dataset distillation has emerged as a strategy to overcome the hurdles associated with large datasets by learning a compact set of synthetic data that retains essential information from the original dataset. While distilled data can be used…

Machine Learning · Computer Science 2024-07-23 William Yang , Ye Zhu , Zhiwei Deng , Olga Russakovsky

We provide an overview of tools enabling users to utilize data from open sources for decision-making support in weakly-structured subject domains. Presently, it is impossible to replace expert data with data from open sources in the process…

Databases · Computer Science 2019-11-14 Vitaliy Tsyganok , Sergii Kadenko , Oleh Andriichuk

The Linked Data Paradigm is one of the most promising technologies for publishing, sharing, and connecting data on the Web, and offers a new way for data integration and interoperability. However, the proliferation of distributed,…

Databases · Computer Science 2012-05-11 Yannis Stavrakas , George Papastefanatos , Theodore Dalamagas , Vassilis Christophides

In this work, we improve the generative replay in a continual learning setting to perform well on challenging scenarios. Current generative rehearsal methods are usually benchmarked on small and simple datasets as they are not powerful…

Machine Learning · Computer Science 2023-09-20 Valeriya Khan , Sebastian Cygert , Kamil Deja , Tomasz Trzciński , Bartłomiej Twardowski

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

Computer simulations of complex population genetic models are an essential tool for making sense of the large-scale datasets of multiple genome sequences from a single species that are becoming increasingly available. A widely used approach…

Populations and Evolution · Quantitative Biology 2026-04-23 Parul Johri , Fanny Pouyet , Brian Charlesworth

In any knowledge discovery process the value of extracted knowledge is directly related to the quality of the data used. Big Data problems, generated by massive growth in the scale of data observed in recent years, also follow the same…

Databases · Computer Science 2017-07-31 Diego García-Gil , Julián Luengo , Salvador García , Francisco Herrera

Knowledge is the most precious asset of humankind. People extract the experience from the data that provide for us the reality through the feelings. Generally speaking, it is possible to see the analogy of knowledge elaboration between…

Hardware Architecture · Computer Science 2020-12-22 Viacheslav Dubeyko

In computational reinforcement learning, a growing body of work seeks to express an agent's model of the world through predictions about future sensations. In this manuscript we focus on predictions expressed as General Value Functions:…

Machine Learning · Computer Science 2021-11-23 Alex Kearney , Anna Koop , Johannes Günther , Patrick M. Pilarski

In recent years, artificial intelligence (AI) decision-making and autonomous systems became an integrated part of the economy, industry, and society. The evolving economy of the human-AI ecosystem raising concerns regarding the risks and…

Artificial Intelligence · Computer Science 2018-11-20 Daniel Muller

In recent years, we have witnessed a dramatic data explosion in genomics, thanks to the improvement in sequencing technologies and the drastically decreasing costs. We are entering the era of millions of available genomes. Notably, each…

Other Quantitative Biology · Quantitative Biology 2018-03-28 Ka-Chun Wong

Data-based decisionmaking must account for the manipulation of data by agents who are aware of how decisions are being made and want to affect their allocations. We study a framework in which, due to such manipulation, data becomes less…

Theoretical Economics · Economics 2022-12-29 Alex Frankel , Navin Kartik

The field of data science currently enjoys a broad definition that includes a wide array of activities which borrow from many other established fields of study. Having such a vague characterization of a field in the early stages might be…

Other Statistics · Statistics 2021-05-14 Roger D. Peng , Hilary S. Parker

Data science has employed great research efforts in developing advanced analytics, improving data models and cultivating new algorithms. However, not many authors have come across the organizational and socio-technical challenges that arise…

Machine Learning · Computer Science 2022-01-17 Iñigo Martinez , Elisabeth Viles , Igor G. Olaizola

How should statistical procedures be designed so as to be scalable computationally to the massive datasets that are increasingly the norm? When coupled with the requirement that an answer to an inferential question be delivered within a…

Machine Learning · Statistics 2013-10-01 Michael I. Jordan

The transition towards data-centric AI requires revisiting data notions from mathematical and implementational standpoints to obtain unified data-centric machine learning packages. Towards this end, this work proposes unifying principles…

Machine Learning · Computer Science 2021-12-03 Mustafa Hajij , Ghada Zamzmi , Karthikeyan Natesan Ramamurthy , Aldo Guzman Saenz