中文
相关论文

相关论文: Quality Assessment of Linked Datasets using Probab…

200 篇论文

Data is one of the most important assets of the information age, and its societal impact is undisputed. Yet, rigorous methods of assessing the quality of data are lacking. In this paper, we propose a formal definition for the quality of a…

机器学习 · 计算机科学 2020-05-13 Netanel Raviv , Siddharth Jain , Jehoshua Bruck

Large Language Models (LLMs) have demonstrated exceptional code generation capabilities, yet their token-level mechanisms remain underexplored, particularly in compressed models. Through systematic analysis of programming language token…

软件工程 · 计算机科学 2026-02-10 Viacheslav Siniaev , Iaroslav Chelombitko , Aleksey Komissarov

Generating unbiased summaries in real-world settings such as political perspective summarization remains a crucial application of Large Language Models (LLMs). Yet, existing evaluation frameworks rely on traditional metrics for measuring…

计算与语言 · 计算机科学 2025-06-23 Narutatsu Ri , Nicholas Deas , Kathleen McKeown

The importance of high data quality is increasing with the growing impact and distribution of ML systems and big data. Also the planned AI Act from the European commission defines challenging legal requirements for data quality especially…

计算机与社会 · 计算机科学 2023-07-12 Simon Geerkens , Christian Sieberichs , Alexander Braun , Thomas Waschulzik

In-situ monitoring incorporating data from visual and other sensor technologies, allows the collection of extensive datasets during the Additive Manufacturing (AM) process. These datasets have potential for determining the quality of the…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Xiao Liu , Alessandra Mileo , Alan F. Smeaton

Machine learning (ML) has emerged as a powerful tool for tackling complex regression and classification tasks, yet its success often hinges on the quality of training data. This study introduces an ML paradigm inspired by domain knowledge…

机器学习 · 计算机科学 2025-01-10 Mohsen Rashki

Cluster analysis is widely used in the areas of machine learning and data mining. Fuzzy clustering is a particular method that considers that a data point can belong to more than one cluster. Fuzzy clustering helps obtain flexible clusters,…

机器学习 · 计算机科学 2018-06-06 Aybükë Oztürk , Stéphane Lallich , Jérôme Darmont

The process of quantifying image quality consists of engineering the quality features and pooling these features to obtain a value or a map. There has been a significant research interest in designing the quality features but pooling is…

图像与视频处理 · 电气工程与系统科学 2018-11-26 Dogancan Temel , Ghassan AlRegib

As large language models (LLMs) converge towards similar capabilities, the key to advancing their performance lies in identifying and incorporating valuable new information sources. However, evaluating which text collections are worth the…

计算与语言 · 计算机科学 2026-01-09 Tristan Karch , Luca Engel , Philippe Schwaller , Frédéric Kaplan

Building high-quality datasets and labeling query-document relevance are essential yet resource-intensive tasks, requiring detailed guidelines and substantial effort from human annotators. This paper explores the use of small, fine-tuned…

信息检索 · 计算机科学 2025-04-15 Quentin Fitte-Rey , Matyas Amrouche , Romain Deveaud

The increasing prevalence of marine pollution during the past few decades motivated recent research to help ease the situation. Typical water quality assessment requires continuous monitoring of water and sediments at remote locations with…

机器学习 · 计算机科学 2022-03-08 Xiaoting Xu , Tin Lai , Sayka Jahan , Farnaz Farid

Indexing massive data sets is extremely expensive for large scale problems. In many fields, huge amounts of data are currently generated, however extracting meaningful information from voluminous data sets, such as computing similarity…

数据结构与算法 · 计算机科学 2017-03-27 Camille Marchet , Lolita Lecompte , Antoine Limasset , Lucie Bittner , Pierre Peterlongo

The quality of data is context dependent. Starting from this intuition and experience, we propose and develop a conceptual framework that captures in formal terms the notion of "context-dependent data quality". We start by proposing a…

数据库 · 计算机科学 2016-08-16 Leopoldo Bertossi , Flavio Rizzolo

Whether Large Language Models (LLMs) can outperform crowdsourcing on the data annotation task is attracting interest recently. Some works verified this issue with the average performance of individual crowd workers and LLM workers on some…

计算与语言 · 计算机科学 2024-01-19 Jiyi Li

Synthetic data generation is a promising technique to facilitate the use of sensitive data while mitigating the risk of privacy breaches. However, for synthetic data to be useful in downstream analysis tasks, it needs to be of sufficient…

机器学习 · 统计学 2024-08-26 Thom Benjamin Volker , Peter-Paul de Wolf , Erik-Jan van Kesteren

We study the problem of discovering joinable datasets at scale. We approach the problem from a learning perspective relying on profiles. These are succinct representations that capture the underlying characteristics of the schemata and data…

数据库 · 计算机科学 2023-06-01 Sergi Nadal , Raquel Panadero , Javier Flores , Oscar Romero

For researchers leveraging Large-Language Models (LLMs) in the generation of training datasets, especially for conversational recommender systems - the absence of robust evaluation frameworks has been a long-standing problem. The efficiency…

计算与语言 · 计算机科学 2022-12-19 Harsh Lara , Manoj Tiwari

The amount of data coming from different sources such as IoT-sensors, social networks, cellular networks, has increased exponentially during the last few years. Probabilistic Data Structures (PDS) are efficient alternatives to deterministic…

数据结构与算法 · 计算机科学 2022-11-02 Remy Scholler , Jean-Francois Couchot , Oumaima Alaoui-Ismaili , Denis Renaud , Eric Ballot

This article presents the top-level of an ontology categorizing and generalizing best practices and quality criteria or measures for Linked Data. It permits to compare these techniques and have a synthetic organized view of what can or…

数字图书馆 · 计算机科学 2013-05-31 Philippe A. Martin

In order to achieve state-of-the-art performance, modern machine learning techniques require careful data pre-processing and hyperparameter tuning. Moreover, given the ever increasing number of machine learning models being developed, model…

机器学习 · 统计学 2018-05-03 Nicolo Fusi , Rishit Sheth , Huseyn Melih Elibol