中文
相关论文

相关论文: Quality Assessment of Linked Datasets using Probab…

200 篇论文

Dataset Distillation aims to compress a large dataset into a significantly more compact, synthetic one without compromising the performance of the trained models. To achieve this, existing methods use the agent model to extract information…

Large language models (LLMs) exhibit probabilistic output characteristics, yet conventional evaluation frameworks rely on deterministic scalar metrics. This study introduces a Bayesian approach for LLM capability assessment that integrates…

计算与语言 · 计算机科学 2025-05-01 Xiao Xiao , Yu Su , Sijing Zhang , Zhang Chen , Yadong Chen , Tian Liu

This chapter presents a comprehensive taxonomy for assessing data quality in the context of data monetisation, developed through a systematic literature review. Organising over one hundred metrics and Key Performance Indicators (KPIs) into…

数据库 · 计算机科学 2025-10-02 Eduardo Vyhmeister , Bastien Pietropoli , Andrea Visentin

Data-oriented applications, their users, and even the law require data of high quality. Research has divided the rather vague notion of data quality into various dimensions, such as accuracy, consistency, and reputation. To achieve the goal…

数据库 · 计算机科学 2024-12-09 Sedir Mohammed , Lisa Ehrlinger , Hazar Harmouch , Felix Naumann , Divesh Srivastava

The selection, development, or comparison of machine learning methods in data mining can be a difficult task based on the target problem and goals of a particular study. Numerous publicly available real-world and simulated benchmark…

机器学习 · 计算机科学 2017-03-03 Randal S. Olson , William La Cava , Patryk Orzechowski , Ryan J. Urbanowicz , Jason H. Moore

Experimental evaluation is a major research methodology for investigating clustering algorithms and many other machine learning algorithms. For this purpose, a number of benchmark datasets have been widely used in the literature and their…

机器学习 · 计算机科学 2019-10-21 Tiantian Zhang , Li Zhong , Bo Yuan

Clustering is an important part of many modern data analysis pipelines, including network analysis and data retrieval. There are many different clustering algorithms developed by various communities, and it is often not clear which…

机器学习 · 计算机科学 2019-10-04 Maria-Florina Balcan , Travis Dick , Manuel Lang

Subjective assessment tests are often employed to evaluate image processing systems, notably image and video compression, super-resolution among others and have been used as an indisputable way to provide evidence of the performance of an…

多媒体 · 计算机科学 2023-11-13 Shima Mohammadi , Joao Ascenso

Low-quality data can cause downstream problems in high-stakes applications. Data-centric approach emphasizes on improving dataset quality to enhance model performance. High-quality datasets are needed for general-purpose Large Language…

计算与语言 · 计算机科学 2023-10-13 Iva Bojic , Josef Halim , Verena Suharman , Sreeja Tar , Qi Chwen Ong , Duy Phung , Mathieu Ravaut , Shafiq Joty , Josip Car

Feature selection has been proven a powerful preprocessing step for high-dimensional data analysis. However, most state-of-the-art methods tend to overlook the structural correlation information between pairwise samples, which may…

机器学习 · 计算机科学 2019-07-02 Lu Bai , Lixin Cui , Yue Wang , Philip S. Yu , Edwin R. Hancock

One of the most significant problems of Big Data is to extract knowledge through the huge amount of data. The usefulness of the extracted information depends strongly on data quality. In addition to the importance, data quality has recently…

数据库 · 计算机科学 2020-05-25 Mostafa Mirzaie , Behshid Behkamal , Samad Paydar

Visual quality evaluation is one of the challenging basic problems in image processing. It also plays a central role in the shaping, implementation, optimization, and testing of many methods. The existing image quality assessment methods…

图像与视频处理 · 电气工程与系统科学 2021-10-12 Giuliana Ramella

We present a machine learning based approach for real-time monitoring of particle detectors. The proposed strategy evaluates the compatibility between incoming batches of experimental data and a reference sample representing the data…

高能物理 - 实验 · 物理学 2023-03-13 Gaia Grosso , Nicolò Lai , Marco Letizia , Jacopo Pazzini , Marco Rando , Andrea Wulzer , Marco Zanetti

Quality and diversity are two critical metrics for the training data of large language models (LLMs), positively impacting performance. Existing studies often optimize these metrics separately, typically by first applying quality filtering…

计算与语言 · 计算机科学 2025-04-29 Fengze Liu , Weidong Zhou , Binbin Liu , Zhimiao Yu , Yifan Zhang , Haobin Lin , Yifeng Yu , Bingni Zhang , Xiaohuan Zhou , Taifeng Wang , Yong Cao

Although large multi-modality models (LMMs) have seen extensive exploration and application in various quality assessment studies, their integration into Point Cloud Quality Assessment (PCQA) remains unexplored. Given LMMs' exceptional…

计算机视觉与模式识别 · 计算机科学 2024-08-07 Zicheng Zhang , Haoning Wu , Yingjie Zhou , Chunyi Li , Wei Sun , Chaofeng Chen , Xiongkuo Min , Xiaohong Liu , Weisi Lin , Guangtao Zhai

Probabilistic mixture models have been widely used for different machine learning and pattern recognition tasks such as clustering, dimensionality reduction, and classification. In this paper, we focus on trying to solve the most common…

机器学习 · 计算机科学 2020-04-08 Gustavo A Valencia-Zapata , Daniel Mejia , Gerhard Klimeck , Michael Zentner , Okan Ersoy

Two indicators are classically used to evaluate the quality of rule-based classification systems: predictive accuracy, i.e. the system's ability to successfully reproduce learning data and coverage, i.e. the proportion of possible cases for…

人工智能 · 计算机科学 2020-04-07 Nassim Dehouche

Traditional data quality control methods are based on users experience or previously established business rules, and this limits performance in addition to being a very time consuming process with lower than desirable accuracy. Utilizing…

人工智能 · 计算机科学 2018-10-17 Wei Dai , Kenji Yoshigoe , William Parsley

As language models increase in size by the day, methods for efficient inference are critical to leveraging their capabilities for various applications. Prior work has investigated techniques like model pruning, knowledge distillation, and…

机器学习 · 计算机科学 2023-08-25 Yushan Su , Vishvak Murahari , Karthik Narasimhan , Kai Li

The selection of the best classification algorithm for a given dataset is a very widespread problem. It is also a complex one, in the sense it requires to make several important methodological choices. Among them, in this work we focus on…

机器学习 · 计算机科学 2012-07-18 Vincent Labatut , Hocine Cherifi