English
Related papers

Related papers: Toward Compact Data from Big Data

200 papers

While Large Language Models require more and more data to train and scale, rather than looking for any data to acquire, we should consider what types of tasks are more likely to benefit from data scaling. We should be intentional in our…

Machine Learning · Computer Science 2025-06-04 Tanya Rodchenko , Natasha Noy , Nino Scherrer

Big Data is defined as high volume of variety of data with an exponential data growth rate. Data are amalgamated to generate revenue, which results a large data silo. Data are the oils of modern IT industries. Therefore, the data are…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-15 Ripon Patgiri , Sabuzima Nayak

Deep learning technology has developed unprecedentedly in the last decade and has become the primary choice in many application domains. This progress is mainly attributed to a systematic collaboration in which rapidly growing computing…

Machine Learning · Computer Science 2023-12-27 Shiye Lei , Dacheng Tao

Big data has ushered in a new wave of predictive power using machine learning models. In this work, we assess what {\it big} means in the context of typical materials-science machine-learning problems. This concerns not only data volume,…

The recent trend for acquiring big data assumes that possessing quantitatively more and qualitatively finer data necessarily provides an advantage that may be critical in competitive situations. Using a model complex adaptive system where…

Physics and Society · Physics 2018-08-15 V. Sasidevan , Appilineni Kushal , Sitabhra Sinha

Artificial intelligence experienced a technological breakthrough in science, industry, and everyday life in the recent few decades. The advancements can be credited to the ever-increasing availability and miniaturization of computational…

Machine Learning · Computer Science 2023-11-14 Ivan Kraljevski , Yong Chul Ju , Dmitrij Ivanov , Constanze Tschöpe , Matthias Wolff

Developing new ideas and algorithms in the fields of graph processing and relational learning requires public datasets. While Wikidata is the largest open source knowledge graph, involving more than fifty million entities, it is larger than…

Machine Learning · Computer Science 2019-10-07 Armand Boschin , Thomas Bonald

Advances in technology and computing hardware are enabling scientists from all areas of science to produce massive amounts of data using large-scale simulations or observational facilities. In this era of data deluge, effective coordination…

Databases · Computer Science 2015-03-31 Spyros Blanas , Surendra Byna

A confluence of advances in the computer and mathematical sciences has unleashed unprecedented capabilities for enabling true evidence-based decision making. These capabilities are making possible the large-scale capture of data and the…

Computers and Society · Computer Science 2020-08-04 Eric Horvitz , Tom Mitchell

Organising the relevant literature and by letting statistical convergence play the main role in the theory of compactness, a variant of compactness called statistical compactness has been achieved. As in case of sequential compactness, one…

General Topology · Mathematics 2022-01-21 Manoranjan Singha , Ujjal Kumar Hom

Synthetic datasets have long been thought of as second-rate, to be used only when "real" data collected directly from the real world is unavailable. But this perspective assumes that raw data is clean, unbiased, and trustworthy, which it…

Databases · Computer Science 2019-05-07 Luke Rodriguez , Bill Howe

In the big data era researchers face a series of problems. Even standard approaches/methodologies, like linear regression, can be difficult or problematic with huge volumes of data. Traditional approaches for regression in big datasets may…

Methodology · Statistics 2024-11-13 Vasilis Chasiotis , Dimitris Karlis

Big data are data on a massive scale in terms of volume, intensity, and complexity that exceed the capacity of standard software tools. They present opportunities as well as challenges to statisticians. The role of computational…

Computation · Statistics 2018-06-13 Chun Wang , Ming-Hui Chen , Elizabeth Schifano , Jing Wu , Jun Yan

A method for representing the digest information of each dataset is proposed, oriented to the aid of innovative thoughts and the communication of data users who attempt to create valuable products, services, and business models using or…

Databases · Computer Science 2022-08-09 Yukio Ohsawa , Kaira Sekiguchi , Tomohide Maekawa , Hiroki Yamaguchi , Son Yeon Hyuk , Sae Kondo

The claims that big data holds the key to enterprise successes and that Artificial Intelligence is going to replace humanity have become increasingly more popular over the past few years, both in academia and in the industry. However, while…

Computers and Society · Computer Science 2019-07-25 Ciro Greco , Andrea Polonioli , Jacopo Tagliabue

When large scale training data is available, one can obtain compact and accurate networks to be deployed in resource-constrained environments effectively through quantization and pruning. However, training data are often protected due to…

Machine Learning · Computer Science 2020-10-16 Chen Zhu , Zheng Xu , Ali Shafahi , Manli Shu , Amin Ghiasi , Tom Goldstein

If a person looks at WHITE paper through BLUE glasses, the paper will become BLUE in the eye of the person. Likewise, in the current study of big data which play the same role as the white paper being looked at, various statistical methods…

Data Analysis, Statistics and Probability · Physics 2014-12-23 J. P. Huang

Recent advances in data collection and computational statistics coupled with increases in computer processing power, along with the plunging costs of storage are making technologies to effectively analyze large sets of heterogeneous data…

Cryptography and Security · Computer Science 2015-02-04 Hervais Simo Fhom

This document develops general concepts useful for extracting knowledge embedded in large graphs or datasets that have pair-wise relationships, such as cause-effect-type relations. Almost no underlying assumptions are made, other than that…

Machine Learning · Computer Science 2019-02-22 Linas Vepstas

With the advent of Internet of Things (IoT) and Web 2.0 technologies, there has been a tremendous growth in the amount of data generated. This chapter emphasizes on the need for big data, technological advancements, tools and techniques…

Databases · Computer Science 2017-05-16 Abhay Bhadani , Dhanya Jothimani