English
Related papers

Related papers: Big Data Refinement

200 papers

Widespread use of the Internet and social networks invokes the generation of big data, which is proving to be useful in a number of applications. To deal with explosively growing amounts of data, data analytics has emerged as a critical…

Information Theory · Computer Science 2016-11-17 Kwang-Cheng Chen , Shao-Lun Huang , Lizhong Zheng , H. Vincent Poor

The use of artificial intelligence (AI) in the public sector is best understood as a continuation and intensification of long standing rationalization and bureaucratization processes. Drawing on Weber, we take the core of these processes to…

Artificial Intelligence · Computer Science 2024-07-09 Jakob Mokander , Ralph Schroeder

Our world produces massive data every day; they exist in diverse forms, from pairwise data and matrix to time series and trajectories. Meanwhile, we have access to the versatile toolkit of network analysis. Networks also have different…

Social and Information Networks · Computer Science 2017-12-29 Jian Xu

We are living in the big data age: An ever increasing amount of data is being produced through data acquisition and computer simulations. While large scale analysis and simulations have received significant attention for cloud and…

Graphics · Computer Science 2019-02-26 Stefan Eilemann

Process mining, as a high-level field in data mining, plays a crucial role in enhancing operational efficiency and decision-making across organizations. In this survey paper, we delve into the growing significance and ongoing trends in the…

Artificial Intelligence · Computer Science 2024-07-17 Yiyuan Yang , Zheshun Wu , Yong Chu , Zhenghua Chen , Zenglin Xu , Qingsong Wen

Modern applications require methods that are computationally feasible on large datasets but also preserve statistical efficiency. Frequently, these two concerns are seen as contradictory: approximation methods that enable computation are…

Methodology · Statistics 2021-06-11 Darren Homrighausen , Daniel J. McDonald

Urban safety and security play a crucial role in improving life quality of citizen and the sustainable development of urban. Traditional urban crime research focused on leveraging demographic data, which is insufficient to capture the…

Computers and Society · Computer Science 2018-05-07 Xiangyu Zhao , Jiliang Tang

Background: Big Data is a relatively new field of research and technology, and literature reports a wide variety of concepts labeled with Big Data. The maturity of a research field can be measured in the number of publications containing…

Digital Libraries · Computer Science 2016-10-13 Bjørn Magnus Mathisen , Leendert Wienhofen , Dumitru Roman

The process of exploring and exploiting Oil and Gas (O&G) generates a lot of data that can bring more efficiency to the industry. The opportunities for using data mining techniques in the "digital oil-field" remain largely unexplored or…

Artificial Intelligence · Computer Science 2017-05-29 Alipio Jorge , German Larrazabal , Pablo Guillen , Rui L. Lopes

Data cleaning is often framed as a technical preprocessing step, yet in practice it relies heavily on human judgment. We report results from a controlled survey study in which participants performed error detection, data repair and…

Databases · Computer Science 2026-03-26 Hazim AbdElazim , Shadman Islam , Mostafa Milani

The current flood of information in all areas of machine learning research, from computer vision to reinforcement learning, has made it difficult to make aggregate scientific inferences. It can be challenging to distill a myriad of similar…

Digital Libraries · Computer Science 2018-12-05 Peter Henderson , Emma Brunskill

Big data management is a reality for an increasing number of organizations in many areas and represents a set of challenges involving big data modeling, storage and retrieval, analysis and visualization. However, technological resources,…

Databases · Computer Science 2022-03-15 Rogerio Rossi , Kechi Hirama

Deep learning technology has developed unprecedentedly in the last decade and has become the primary choice in many application domains. This progress is mainly attributed to a systematic collaboration in which rapidly growing computing…

Machine Learning · Computer Science 2023-12-27 Shiye Lei , Dacheng Tao

The Internet of Things, crowdsourcing, social media, public authorities, and other sources generate bigger and bigger data sets. Big and open data offers many benefits for emergency management, but also pose new challenges. This chapter…

Computers and Society · Computer Science 2020-12-17 Andreas L Opdahl , Vimala Nunavath

The aim of dataset distillation is to encode the rich features of an original dataset into a tiny dataset. It is a promising approach to accelerate neural network training and related studies. Different approaches have been proposed to…

Machine Learning · Computer Science 2023-05-30 Zongxiong Chen , Jiahui Geng , Derui Zhu , Herbert Woisetschlaeger , Qing Li , Sonja Schimmler , Ruben Mayer , Chunming Rong

By virtue of its great utility in solving real-world problems, optimization modeling has been widely employed for optimal decision-making across various sectors, but it requires substantial expertise from operations research professionals.…

A cross-disciplinary examination of the user behaviours involved in seeking and evaluating data is surprisingly absent from the research data discussion. This review explores the data retrieval literature to identify commonalities in how…

Digital Libraries · Computer Science 2020-03-13 Kathleen Gregory , Paul Groth , Helena Cousijn , Andrea Scharnhorst , Sally Wyatt

Nowadays there is no field research which is not flooded with data. Among the sciences, Astrophysics has always been driven by the analysis of massive amounts of data. The development of new and more sophisticated observation facilities,…

Instrumentation and Methods for Astrophysics · Physics 2017-06-14 Mauro Garofalo , Alessio Botta , Giorgio Ventre

Data can be collected in scientific studies via a controlled experiment or passive observation. Big data is often collected in a passive way, e.g. from social media. In studies of causation great efforts are made to guard against bias and…

Methodology · Statistics 2018-11-21 Elena Pesce , Eva Riccomagno , Henry P. Wynn

Perhaps one of the mostly hotly debated topics in recent years has been the question of "GIS and Big Data". Much of the discussion has been about the data: huge volumes of 2D and 3D spatial data and spatio-temporal data are now being…

Computers and Society · Computer Science 2019-02-19 Guy Lansley , Michael de Smith , Michael Goodchild , Paul Longley