中文
相关论文

相关论文: Streaming algorithms for evaluating noisy judges o…

200 篇论文

Training a classifier exploiting a huge amount of supervised data is expensive or even prohibited in a situation, where the labeling cost is high. The remarkable progress in working with weaker forms of supervision is binary classification…

机器学习 · 计算机科学 2023-06-13 Yuhao Wu , Xiaobo Xia , Jun Yu , Bo Han , Gang Niu , Masashi Sugiyama , Tongliang Liu

Image classification systems recently made a giant leap with the advancement of deep neural networks. However, these systems require an excessive amount of labeled data to be adequately trained. Gathering a correctly annotated dataset is…

机器学习 · 计算机科学 2021-01-19 Görkem Algan , Ilkay Ulusoy

This work presents a fraud and abuse detection framework for streaming services by modeling user streaming behavior. The goal is to discover anomalous and suspicious incidents and scale the investigation efforts by creating models that…

机器学习 · 计算机科学 2022-03-07 Soheil Esmaeilzadeh , Negin Salajegheh , Amir Ziai , Jeff Boote

Ensemble methods are generally regarded to be better than a single model if the base learners are deemed to be "accurate" and "diverse." Here we investigate a semi-supervised ensemble learning strategy to produce generalizable blind image…

计算机视觉与模式识别 · 计算机科学 2021-07-01 Zhihua Wang , Dingquan Li , Kede Ma

Streaming interactive proofs (SIPs) are a framework to reason about outsourced computation, where a data owner (the verifier) outsources a computation to the cloud (the prover), but wishes to verify the correctness of the solution provided…

数据结构与算法 · 计算机科学 2015-09-21 Samira Daruki , Justin Thaler , Suresh Venkatasubramanian

In this work we consider a problem of multi-label classification, where each instance is associated with some binary vector. Our focus is to find a classifier which minimizes false negative discoveries under constraints. Depending on the…

统计理论 · 数学 2019-03-29 Evgenii Chzhen

Reliable certification of Large Language Models (LLMs)-verifying that failure rates are below a safety threshold-is critical yet challenging. While "LLM-as-a-Judge" offers scalability, judge imperfections, noise, and bias can invalidate…

机器学习 · 计算机科学 2026-01-30 Chen Feng , Minghe Shen , Ananth Balashankar , Carsten Gerner-Beuerle , Miguel R. D. Rodrigues

In the context of some machine learning applications, obtaining data instances is a relatively easy process but labeling them could become quite expensive or tedious. Such scenarios lead to datasets with few labeled instances and a larger…

机器学习 · 计算机科学 2020-07-21 Isel Grau , Dipankar Sengupta , Maria M. Garcia Lorenzo , Ann Nowe

Positive-unlabeled (PU) learning is a weakly supervised binary classification problem, in which the goal is to learn a binary classifier from only positive and unlabeled data, without access to negative data. In recent years, many PU…

机器学习 · 计算机科学 2026-02-24 Wei Wang , Dong-Dong Wu , Ming Li , Jingxiong Zhang , Gang Niu , Masashi Sugiyama

Aggregating signals from a collection of noisy sources is a fundamental problem in many domains including crowd-sourcing, multi-agent planning, sensor networks, signal processing, voting, ensemble learning, and federated learning. The core…

机器学习 · 计算机科学 2022-06-07 Ben Abramowitz , Nicholas Mattei

We present streaming self-training (SST) that aims to democratize the process of learning visual recognition models such that a non-expert user can define a new task depending on their needs via a few labeled examples and minimal domain…

计算机视觉与模式识别 · 计算机科学 2021-04-08 Zhiqiu Lin , Deva Ramanan , Aayush Bansal

In critical applications of anomaly detection including computer security and fraud prevention, the anomaly detector must be configurable by the analyst to minimize the effort on false positives. One important way to configure the anomaly…

机器学习 · 计算机科学 2018-09-19 Shubhomoy Das , Md Rakibul Islam , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa

Self-supervised learning (SSL) is an effective method for exploiting unlabelled data to learn a high-level embedding space that can be used for various downstream tasks. However, existing methods to monitor the quality of the encoder --…

机器学习 · 计算机科学 2024-09-11 Isaac Xu , Scott Lowe , Thomas Trappenberg

Learning under a continuously changing data distribution with incorrect labels is a desirable real-world problem yet challenging. A large body of continual learning (CL) methods, however, assumes data streams with clean labels, and online…

计算机视觉与模式识别 · 计算机科学 2022-03-31 Jihwan Bang , Hyunseo Koh , Seulki Park , Hwanjun Song , Jung-Woo Ha , Jonghyun Choi

Ensembles, which employ a set of classifiers to enhance classification accuracy collectively, are crucial in the era of big data. However, although there is general agreement that the relation between ensemble size and its prediction…

机器学习 · 计算机科学 2023-08-29 Enes Bektas , Fazli Can

Most current clustering based anomaly detection methods use scoring schema and thresholds to classify anomalies. These methods are often tailored to target specific data sets with "known" number of clusters. The paper provides a streaming…

机器学习 · 统计学 2019-11-04 Sreelekha Guggilam , Syed M. A. Zaidi , Varun Chandola , Abani K. Patra

It is challenging to handle a large volume of labels in multi-label learning. However, existing approaches explicitly or implicitly assume that all the labels in the learning process are given, which could be easily violated in changing…

机器学习 · 统计学 2016-04-20 Shan You , Chang Xu , Yunhe Wang , Chao Xu , Dacheng Tao

Medical researchers have solved the problem of estimating the sensitivity and specificity of binary medical diagnostic tests without gold standard tests for comparison. That problem is the same as estimating confusion matrices for…

机器学习 · 统计学 2022-12-29 Richard Evans

Classification algorithms aim to predict an unknown label (e.g., a quality class) for a new instance (e.g., a product). Therefore, training samples (instances and labels) are used to deduct classification hypotheses. Often, it is relatively…

机器学习 · 计算机科学 2019-01-30 Daniel Kottke , Jim Schellinger , Denis Huseljic , Bernhard Sick

We propose and analyze a family of information processing systems, where a finite set of experts or servers are employed to extract information about a stream of incoming jobs. Each job is associated with a hidden label drawn from some…

概率论 · 数学 2016-05-31 Laurent Massoulie , Kuang Xu