English
Related papers

Related papers: Active Testing: An Unbiased Evaluation Method for …

200 papers

Sensor-based activity recognition seeks the profound high-level knowledge about human activities from multitudes of low-level sensor readings. Conventional pattern recognition approaches have made tremendous progress in the past years.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Jindong Wang , Yiqiang Chen , Shuji Hao , Xiaohui Peng , Lisha Hu

Although deep learning has demonstrated astonishing performance in many applications, there are still concerns about its dependability. One desirable property of deep learning applications with societal impact is fairness (i.e.,…

Machine Learning · Computer Science 2021-07-30 Peixin Zhang , Jingyi Wang , Jun Sun , Xinyu Wang , Guoliang Dong , Xingen Wang , Ting Dai , Jin Song Dong

Active learning shows promise to decrease test bench time for model-based drivability calibration. This paper presents a new strategy for active output selection, which suits the needs of calibration tasks. The strategy is actively learning…

Machine Learning · Computer Science 2021-02-24 Adrian Prochaska , Julien Pillas , Bernard Bäker

Unsupervised relation extraction (URE) aims to extract relations between named entities from raw text without requiring manual annotations or pre-existing knowledge bases. In recent studies of URE, researchers put a notable emphasis on…

Computation and Language · Computer Science 2023-12-04 Qing Wang , Kang Zhou , Qiao Qiao , Yuepei Li , Qi Li

The tasks of aspect identification and term extraction remain challenging in natural language processing. While supervised methods achieve high scores, it is hard to use them in real-world applications due to the lack of labelled datasets.…

Computation and Language · Computer Science 2020-05-07 Timur Sokhin , Maria Khodorchenko , Nikolay Butakov

Do we need active learning? The rise of strong deep semi-supervised methods raises doubt about the usability of active learning in limited labeled data settings. This is caused by results showing that combining semi-supervised learning…

Machine Learning · Computer Science 2023-08-17 Sandra Gilhuber , Rasmus Hvingelby , Mang Ling Ada Fok , Thomas Seidl

Large language models (LLMs) require reliable evaluation from pre-training to test-time scaling, making evaluation a recurring rather than one-off cost. As model scales grow and target tasks increasingly demand expert annotators, both the…

Artificial Intelligence · Computer Science 2026-05-20 Zeli Liu , Jiancheng Zhang , Cong Liu , Yinglun Zhu

Active learning is a promising paradigm to reduce the labeling cost by strategically requesting labels to improve model performance. However, existing active learning methods often rely on expensive acquisition function to compute,…

Machine Learning · Computer Science 2023-10-27 Zixin Ding , Si Chen , Ruoxi Jia , Yuxin Chen

Existing research studies on cross-sentence relation extraction in long-form multi-party conversations aim to improve relation extraction without considering the explainability of such methods. This work addresses that gap by focusing on…

Computation and Language · Computer Science 2022-10-20 Alon Albalak , Varun Embar , Yi-Lin Tuan , Lise Getoor , William Yang Wang

Supervised machine learning relies on the availability of good labelled data for model training. Labelled data is acquired by human annotation, which is a cumbersome and costly process, often requiring subject matter experts. Active…

Machine Learning · Computer Science 2023-10-31 Sharath M Shankaranarayana

In this paper we address a task of relation mention extraction from noisy data: extracting representative phrases for a particular relation from noisy sentences that are collected via distant supervision. Despite its significance and value…

Computation and Language · Computer Science 2018-11-06 Jun Feng , Minlie Huang , Yijie Zhang , Yang Yang , Xiaoyan Zhu

With the explosion of massive, widely available unlabeled data in the past years, finding label and time efficient, robust learning algorithms has become ever more important in theory and in practice. We study the paradigm of active…

Machine Learning · Computer Science 2020-01-17 Max Hopkins , Daniel Kane , Shachar Lovett , Gaurav Mahajan

Distant supervision assumes that any sentence containing the same entity pairs reflects identical relationships. Previous works of distantly supervised relation extraction (DSRE) task generally focus on sentence-level or bag-level…

Computation and Language · Computer Science 2022-03-03 Dongyang Li , Taolin Zhang , Nan Hu , Chengyu Wang , Xiaofeng He

Deep Neural Networks trained in a fully supervised fashion are the dominant technology in perception-based autonomous driving systems. While collecting large amounts of unlabeled data is already a major undertaking, only a subset of it can…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Elmar Haussmann , Michele Fenzi , Kashyap Chitta , Jan Ivanecky , Hanson Xu , Donna Roy , Akshita Mittel , Nicolas Koumchatzky , Clement Farabet , Jose M. Alvarez

Although deep learning models perform remarkably well across a range of tasks such as language translation and object recognition, it remains unclear what high-level logic, if any, they follow. Understanding this logic may lead to more…

Databases · Computer Science 2019-01-08 Thibault Sellam , Kevin Lin , Ian Yiran Huang , Yiru Chen , Michelle Yang , Carl Vondrick , Eugene Wu

Distant supervision for relation extraction heavily suffers from the wrong labeling problem. To alleviate this issue in news data with the timestamp, we take a new factor time into consideration and propose a novel time-aware distant…

Computation and Language · Computer Science 2019-03-11 Tianwen Jiang , Sendong Zhao , Jing Liu , Jin-Ge Yao , Ming Liu , Bing Qin , Ting Liu , Chin-Yew Lin

Relation extraction is a Natural Language Processing task that aims to extract relationships from textual data. It is a critical step for information extraction. Due to its wide-scale applicability, research in relation extraction has…

Computation and Language · Computer Science 2024-11-27 Anushka Swarup , Avanti Bhandarkar , Olivia P. Dizon-Paradis , Ronald Wilson , Damon L. Woodard

In supervised learning, acquiring labeled training data for a predictive model can be very costly, but acquiring a large amount of unlabeled data is often quite easy. Active learning is a method of obtaining predictive models with high…

Machine Learning · Computer Science 2020-12-17 Hideitsu Hino

In many practical applications of learning algorithms, unlabeled data is cheap and abundant whereas labeled data is expensive. Active learning algorithms developed to achieve better performance with lower cost. Usually Representativeness…

Machine Learning · Computer Science 2016-08-26 Hossein Ghafarian , Hadi Sadoghi Yazdi

Distantly supervised relation extraction is widely used to extract relational facts from text, but suffers from noisy labels. Current relation extraction methods try to alleviate the noise by multi-instance learning and by providing…

Computation and Language · Computer Science 2019-06-21 Christoph Alt , Marc Hübner , Leonhard Hennig