中文
相关论文

相关论文: A Hybrid Data Cleaning Framework using Markov Logi…

200 篇论文

Learning with noisy labels (LNL) is essential for training deep neural networks with imperfect data. Meta-learning approaches have achieved success by using a clean unbiased labeled set to train a robust model. However, this approach…

机器学习 · 计算机科学 2025-07-17 Ruofan Hu , Dongyu Zhang , Huayi Zhang , Elke Rundensteiner

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

机器学习 · 统计学 2024-05-21 Sohail Reddy , Hillary Fairbanks

The quality of the dataset is crucial for ensuring optimal performance and reliability of downstream task models. However, datasets often contain noisy data inadvertently included during the construction process. Numerous attempts have been…

计算与语言 · 计算机科学 2024-09-25 Juhwan Choi , Jungmin Yun , Kyohoon Jin , YoungBin Kim

In this paper, we propose a generalizable knowledge framework for data abstraction, i.e. finding compact abstract model for input data using predefined abstract terms. Based on these abstract terms, intelligent autonomous systems, such as a…

计算机视觉与模式识别 · 计算机科学 2020-02-21 Ziyuan Liu , Georg von Wichert

High-quality, error-free datasets are a key ingredient in building reliable, accurate, and unbiased machine learning (ML) models. However, real world datasets often suffer from errors due to sensor malfunctions, data entry mistakes, or…

机器学习 · 计算机科学 2025-03-11 Tommaso Bendinelli , Artur Dox , Christian Holz

The variety of data in data lakes presents significant challenges for data analytics, as data scientists must simultaneously analyze multi-modal data, including structured, semi-structured, and unstructured data. While Large Language Models…

数据库 · 计算机科学 2025-05-19 Chao Zhang , Shaolei Zhang , Quehuan Liu , Sibei Chen , Tong Li , Ju Fan

The opacity in developing large language models (LLMs) is raising growing concerns about the potential contamination of public benchmarks in the pre-training data. Existing contamination detection methods are typically based on the text…

计算与语言 · 计算机科学 2024-10-31 Feng Yao , Yufan Zhuang , Zihao Sun , Sunan Xu , Animesh Kumar , Jingbo Shang

The problem of data contamination is now almost inevitable during the development of large language models (LLMs), with the training data commonly integrating those evaluation benchmarks even unintentionally. This problem subsequently makes…

计算与语言 · 计算机科学 2025-09-19 Ruijie Hou , Yueyang Jiao , Hanxu Hu , Yingming Li , Wai Lam , Huajian Zhang , Hongyuan Lu

We are currently in an era of fierce competition among various large language models (LLMs) continuously pushing the boundaries of benchmark performance. However, genuinely assessing the capabilities of these LLMs has become a challenging…

计算与语言 · 计算机科学 2024-06-04 Wenhong Zhu , Hongkun Hao , Zhiwei He , Yunze Song , Yumeng Zhang , Hanxu Hu , Yiran Wei , Rui Wang , Hongyuan Lu

The availability of both structured and unstructured databases, such as electronic health data, social media data, patent data, and surveys that are often updated in real time, among others, has grown rapidly over the past decade. With this…

数据库 · 计算机科学 2023-07-26 Rebecca C. Steorts

Designing effective data manipulation methods is a long standing problem in data lakes. Traditional methods, which rely on rules or machine learning models, require extensive human efforts on training data collection and tuning models.…

人工智能 · 计算机科学 2024-05-13 Yichen Qian , Yongyi He , Rong Zhu , Jintao Huang , Zhijian Ma , Haibin Wang , Yaohua Wang , Xiuyu Sun , Defu Lian , Bolin Ding , Jingren Zhou

Large Language Models (LLMs) have become foundational in modern artificial intelligence, powering a wide range of applications from code generation and virtual assistants to scientific research and enterprise automation. However, concerns…

机器学习 · 计算机科学 2025-05-20 Le Vu Anh , Dinh Duc Nha Nguyen , Phi Long Nguyen

Machine learning (ML) is revolutionizing the world, affecting almost every field of science and industry. Recent algorithms (in particular, deep networks) are increasingly data-hungry, requiring large datasets for training. Thus, the…

机器学习 · 计算机科学 2022-11-16 Chen Shani , Jonathan Zarecki , Dafna Shahaf

How to evaluate large language models (LLMs) cleanly has been established as an important research era to genuinely report the performance of possibly contaminated LLMs. Yet, how to cleanly evaluate the visual language models (VLMs) is an…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Hongyuan Lu , Shujie Miao , Wai Lam

Synthetic data has become essential for training foundation models, yet benchmark contamination threatens evaluation integrity. Although existing detection methods identify token-level overlap, they fail to detect semantic-level…

机器学习 · 计算机科学 2025-11-25 Sushant Mehta

The rapid advancement of multimodal large language models (MLLMs) has significantly enhanced performance across benchmarks. However, data contamination-unintentional memorization of benchmark data during model training-poses critical…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Dingjie Song , Sicheng Lai , Mingxuan Wang , Shunian Chen , Lichao Sun , Benyou Wang

Data contamination hinders fair LLM evaluation by introducing test data into newer models' training sets. Existing studies solve this challenge by updating benchmarks with newly collected data. However, they fail to guarantee…

计算与语言 · 计算机科学 2025-05-30 Xiaobao Wu , Liangming Pan , Yuxi Xie , Ruiwen Zhou , Shuai Zhao , Yubo Ma , Mingzhe Du , Rui Mao , Anh Tuan Luu , William Yang Wang

Despite the great advance of Multimodal Large Language Models (MLLMs) in both instruction dataset building and benchmarking, the independence of training and evaluation makes current MLLMs hard to further improve their capability under the…

机器学习 · 计算机科学 2023-09-12 Zhiyuan Zhao , Linke Ouyang , Bin Wang , Siyuan Huang , Pan Zhang , Xiaoyi Dong , Jiaqi Wang , Conghui He

Multi-feature data analysis (e.g., on Facebook, LinkedIn) is challenging especially if one wants to do it efficiently and retain the flexibility by choosing features of interest for analysis. Features (e.g., age, gender, relationship,…

计算与语言 · 计算机科学 2019-05-22 Xuan-Son Vu , Abhishek Santra , Sharma Chakravarthy , Lili Jiang

Automated image-based garbage classification is a critical component of global waste management; however, systematic benchmarks that integrate Machine Learning (ML), Deep Learning (DL), and efficient hybrid solutions remain underdeveloped.…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Ngoc-Bao-Quang Nguyen , Tuan-Minh Do , Cong-Tam Phan , Thi-Thu-Hong Phan