中文
相关论文

相关论文: A Taxonomy of Big Data for Optimal Predictive Mach…

200 篇论文

One of the most significant problems of Big Data is to extract knowledge through the huge amount of data. The usefulness of the extracted information depends strongly on data quality. In addition to the importance, data quality has recently…

数据库 · 计算机科学 2020-05-25 Mostafa Mirzaie , Behshid Behkamal , Samad Paydar

A major factor in the recent success of large language models is the use of enormous and ever-growing text datasets for unsupervised pre-training. However, naively training a model on all available data may not be optimal (or feasible), as…

Recent breakthroughs in large language modeling have facilitated rigorous exploration of their application in diverse tasks related to tabular data modeling, such as prediction, tabular data synthesis, question answering, and table…

Quantifying the similarity between datasets has widespread applications in statistics and machine learning. The performance of a predictive model on novel datasets, referred to as generalizability, depends on how similar the training and…

统计方法学 · 统计学 2025-06-18 Marieke Stolte , Franziska Kappenberg , Jörg Rahnenführer , Andrea Bommert

In any knowledge discovery process the value of extracted knowledge is directly related to the quality of the data used. Big Data problems, generated by massive growth in the scale of data observed in recent years, also follow the same…

数据库 · 计算机科学 2017-07-31 Diego García-Gil , Julián Luengo , Salvador García , Francisco Herrera

Data Mining is the process of extracting useful patterns from the huge amount of database and many data mining techniques are used for mining these patterns. Recently, one of the remarkable facts in higher educational institute is the rapid…

人工智能 · 计算机科学 2014-05-16 Priyanka Saini

This study reviews the topic of big data management in the 21st-century. There are various developments that have facilitated the extensive use of that form of data in different organizations. The most prominent beneficiaries are internet…

计算机与社会 · 计算机科学 2015-09-08 Okal Christopher Otieno

In last few years, the volume of the data has grown manyfold. The data storages have been inundated by various disparate potential data outlets, leading by social media such as Facebook, Twitter, etc. The existing data models are largely…

数据库 · 计算机科学 2015-10-08 Sugam Sharma

The No Free Lunch theorems are often used to argue that domain specific knowledge is required to design successful algorithms. We use algorithmic information theory to argue the case for a universal bias allowing an algorithm to succeed in…

机器学习 · 计算机科学 2011-11-17 Tor Lattimore , Marcus Hutter

In the big data era researchers face a series of problems. Even standard approaches/methodologies, like linear regression, can be difficult or problematic with huge volumes of data. Traditional approaches for regression in big datasets may…

统计方法学 · 统计学 2024-11-13 Vasilis Chasiotis , Dimitris Karlis

The healthcare sector is an important pillar of every community, numerous research studies have been carried out in this context to optimize medical processes and improve care quality and facilitate patient management. In this article we…

机器学习 · 计算机科学 2023-04-04 Chaimae Taoussi , Imad Hafidi , Abdelmoutalib Metrane

Big data refers to large and complex data sets that, under existing approaches, exceed the capacity and capability of current compute platforms, systems software, analytical tools and human understanding. Numerous lessons on the scalability…

Data augmentation, the artificial creation of training data for machine learning by transformations, is a widely studied research field across machine learning disciplines. While it is useful for increasing a model's generalization…

计算与语言 · 计算机科学 2022-09-09 Markus Bayer , Marc-André Kaufhold , Christian Reuter

Data is crucial for machine learning (ML) applications, yet acquiring large datasets can be costly and time-consuming, especially in complex, resource-intensive fields like biopharmaceuticals. A key process in this industry is upstream…

机器学习 · 计算机科学 2025-06-23 Johnny Peng , Thanh Tung Khuat , Katarzyna Musial , Bogdan Gabrys

When can reliable inference be drawn in the "Big Data" context? This paper presents a framework for answering this fundamental question in the context of correlation mining, with implications for general large scale inference. In large…

统计理论 · 数学 2015-05-19 Alfred O. Hero , Bala Rajaratnam

The ability to collect and analyze large amounts of data is a growing problem within the scientific community. The growing gap between data and users calls for innovative tools that address the challenges faced by big data volume, velocity…

数据库 · 计算机科学 2016-08-01 Vijay Gadepally , Jeremy Kepner

Instruction tuning plays a critical role in aligning large language models (LLMs) with human preference. Despite the vast amount of open instruction datasets, naively training a LLM on all existing instructions may not be optimal and…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Yulei Qin , Yuncheng Yang , Pengcheng Guo , Gang Li , Hang Shao , Yuchen Shi , Zihan Xu , Yun Gu , Ke Li , Xing Sun

The complexity and diversity of big data and AI workloads make understanding them difficult and challenging. This paper proposes a new approach to characterizing big data and AI workloads. We consider each big data and AI workload as a…

分布式、并行与集群计算 · 计算机科学 2018-05-07 Wanling Gao , Jianfeng Zhan , Lei Wang , Chunjie Luo , Daoyi Zheng , Fei Tang , Biwei Xie , Chen Zheng , Qiang Yang

Digital world is growing very fast and become more complex in the volume (terabyte to petabyte), variety (structured and un-structured and hybrid), velocity (high speed in growth) in nature. This refers to as Big Data that is a global…

数据库 · 计算机科学 2013-07-02 A B M Moniruzzaman , Syed Akhter Hossain

Modern deep neural networks, particularly recent large language models, come with massive model sizes that require significant computational and storage resources. To enable the deployment of modern models on resource-constrained…

机器学习 · 计算机科学 2024-08-12 Hongrong Cheng , Miao Zhang , Javen Qinfeng Shi