English
Related papers

Related papers: Identifying Dwarfs Workloads in Big Data Analytics

200 papers

The amount of data in the world is expanding rapidly. Every day, huge amounts of data are created by scientific experiments, companies, and end users' activities. These large data sets have been labeled as "Big Data", and their storage,…

Databases · Computer Science 2020-04-29 Mahdi Bohlouli , Frank Schulz , Lefteris Angelis , David Pahor , Ivona Brandic , David Atlan , Rosemary Tate

Big data is data that exceeds the processing capacity of traditional databases. The data is too big to be processed by a single machine. New and innovative methods are required to process and store such large volumes of data. This paper…

Other Computer Science · Computer Science 2014-04-17 Richa Gupta , Sunny Gupta , Anuradha Singhal

Smart databases are adopting artificial intelligence (AI) technologies to achieve {\em instance optimality}, and in the future, databases will come with prepackaged AI models within their core components. The reason is that every database…

Databases · Computer Science 2021-05-27 Debjyoti Paul , Jie Cao , Feifei Li , Vivek Srikumar

The abundance of available sensor and derived data from large scientific experiments, such as earth observation programs, radio astronomy sky surveys, and high-energy physics already exceeds the storage hardware globally fabricated per…

Databases · Computer Science 2019-04-10 Bunjamin Memishi , Raja Appuswamy , Marcus Paradies

Graphs are fundamental data structures for modeling complex interactions in domains such as social networks, molecular structures, and biological systems. Graph-level tasks, which involve predicting properties or labels for entire graphs,…

Machine Learning · Computer Science 2026-04-10 Haoyang Li , Yuming Xu , Alexander Zhou , Yongqi Zhang , Jason Chen Zhang , Lei Chen , Qing Li

Big Data concern large-volume, growing data sets that are complex and have multiple autonomous sources. Earlier technologies were not able to handle storage and processing of huge data thus Big Data concept comes into existence. This is a…

Machine Learning · Computer Science 2015-03-26 Praful Koturwar , Sheetal Girase , Debajyoti Mukhopadhyay

This survey paper provides a comprehensive analysis of big data algorithms in recommendation systems, addressing the lack of depth and precision in existing literature. It proposes a two-pronged approach: a thorough analysis of current…

Information Retrieval · Computer Science 2024-02-07 Kamal Taha , Paul D. Yoo , Aya Taha

Currently, the world is witnessing a mounting avalanche of data due to the increasing number of mobile network subscribers, Internet websites, and online services. This trend is continuing to develop in a quick and diverse manner in the…

Networking and Internet Architecture · Computer Science 2018-02-12 Mohammed S. Hadi , Ahmed Q. Lawey , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

Big data analytics (BDA) applications use machine learning algorithms to extract valuable insights from large, fast, and heterogeneous data sources. New software engineering challenges for BDA applications include ensuring performance…

Software Engineering · Computer Science 2020-11-18 Camilo Castellanos , Carlos A. Varela , Dario Correal

Analytics corresponds to a relevant and challenging phase of Big Data. The generation of knowledge from extensive data sets (petabyte era) of varying types, occurring at a speed able to serve decision makers, is practiced using multiple…

Software Engineering · Computer Science 2022-03-15 Rogerio Rossi , Kechi Hirama

Autonomous data analysis agents are increasingly expected to conduct exploratory analysis with limited human guidance about data. However, existing benchmarks typically evaluate such agents in prior-guided settings, providing selected data…

Artificial Intelligence · Computer Science 2026-05-28 Qiaohong Zhang , Weihao Ye , Jialong Chen , Yi Luo , BoYuan Li , Bowen Deng , Zibin Zheng , Jianhao Lin , Wei-Shi Zheng , Chuan Chen

While traditional tree-based ensemble methods have long dominated tabular tasks, deep neural networks and emerging foundation models have challenged this primacy, yet no consensus exists on a universally superior paradigm. Existing…

With rapid growth in the amount of unstructured data produced by memory-intensive applications, large scale data analytics has recently attracted increasing interest. Processing, managing and analyzing this huge amount of data poses several…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-29 Farshid Farhat , Diman Zad Tootaghaj , Mohammad Arjomand

Processing large complex networks recently attracted considerable interest. Complex graphs are useful in a wide range of applications from technological networks to biological systems like the human brain. Sometimes these networks are…

Data Structures and Algorithms · Computer Science 2019-12-03 Christian Schulz

This paper presents and characterizes an Open Application Repository for Federated Learning (OARF), a benchmark suite for federated machine learning systems. Previously available benchmarks for federated learning have focused mainly on…

Machine Learning · Computer Science 2022-03-03 Sixu Hu , Yuan Li , Xu Liu , Qinbin Li , Zhaomin Wu , Bingsheng He

Informatics and technological advancements have triggered generation of huge volume of data with varied complexity in its management and analysis. Big Data analytics is the practice of revealing hidden aspects of such data and making…

Databases · Computer Science 2018-03-30 Bikram Karmakar , Indranil Mukhopadhyay

The emergence of cloud computing has made dynamic provisioning of elastic capacity to applications on-demand. Cloud data centers contain thousands of physical servers hosting orders of magnitude more virtual machines that can be allocated…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Rajkumar Buyya , Kotagiri Ramamohanarao , Chris Leckie , Rodrigo N. Calheiros , Amir Vahid Dastjerdi , Steve Versteeg

Workspace learning requires AI agents to identify, reason over, exploit, and update explicit and implicit dependencies among heterogeneous files in a worker's workspace, enabling them to complete both routine and advanced tasks effectively.…

Big Data processing systems handle huge unstructured and structured data to store, process, and analyze through cluster analysis which helps in identifying unseen patterns to find the relationships between them. Clustering analysis over the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-11 Dipesh Gyawali

This paper outlines BenchCouncil's view on the challenges, rules, and vision of benchmarking modern workloads like Big Data, AI or machine learning, and Internet Services. We conclude the challenges of benchmarking modern workloads as FIDSS…

Performance · Computer Science 2019-12-04 Jianfeng Zhan , Lei Wang , Wanling Gao , Rui Ren