English
Related papers

Related papers: Improving User Behavior Prediction: Leveraging Ann…

200 papers

Machine learning techniques applied to the Natural Language Processing (NLP) component of conversational agent development show promising results for improved accuracy and quality of feedback that a conversational agent can provide. The…

Computation and Language · Computer Science 2020-10-27 Debajyoti Datta , Maria Phillips , Jennifer Chiu , Ginger S. Watson , James P. Bywater , Laura Barnes , Donald Brown

Annually, research teams spend large amounts of money to evaluate the quality of machine translation systems (WMT, inter alia). This is expensive because it requires a lot of expert human labor. In the recently adopted annotation protocol,…

Computation and Language · Computer Science 2025-01-30 Vilém Zouhar , Tom Kocmi , Mrinmaya Sachan

Suicide remains one of the leading causes of death worldwide, particularly among young people, and psychological stressors are consistently identified as proximal drivers of suicidal ideation and behavior. In recent years, social media…

Social and Information Networks · Computer Science 2026-03-30 Ali Sahandi , Mahsa Pahlavan Yousefkhani , Mehrshad Eisaei , Hossein Momeni , Ramin Mousa

In supervised machine learning (SML) research, large training datasets are essential for valid results. However, obtaining primary data in learning analytics (LA) is challenging. Data augmentation can address this by expanding and…

Machine Learning · Computer Science 2024-12-04 Valdemar Švábenský , Conrad Borchers , Elizabeth B. Cloude , Atsushi Shimada

Labeling visual data is expensive and time-consuming. Crowdsourcing systems promise to enable highly parallelizable annotations through the participation of monetarily or otherwise motivated workers, but even this approach has its limits.…

Human-Computer Interaction · Computer Science 2024-09-04 Christopher Klugmann , Rafid Mahmood , Guruprasad Hegde , Amit Kale , Daniel Kondermann

Recent advancements in Deep and Self-Supervised Learning (SSL) have led to substantial improvements in Speech Emotion Recognition (SER) performance, reaching unprecedented levels. However, obtaining sufficient amounts of accurately labeled…

Computation and Language · Computer Science 2025-02-25 Bulat Khaertdinov , Pedro Jeuris , Annanda Sousa , Enrique Hortal

Deep active learning in the presence of outlier examples poses a realistic yet challenging scenario. Acquiring unlabeled data for annotation requires a delicate balance between avoiding outliers to conserve the annotation budget and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Vladan Stojnić , Zakaria Laskar , Giorgos Tolias

Machine learning models have shown increased accuracy in classification tasks when the training process incorporates human perceptual information. However, a challenge in training human-guided models is the cost associated with collecting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Colton R. Crum , Aidan Boyd , Kevin Bowyer , Adam Czajka

Human-annotated data plays a vital role in training large language models (LLMs), such as supervised fine-tuning and human preference alignment. However, it is not guaranteed that paid human annotators produce high-quality data. In this…

Computer Science and Game Theory · Computer Science 2026-04-15 Shang Liu , Zhongze Cai , Hanzhao Wang , Zhongyao Ma , Xiaocheng Li

A well-designed strong-weak augmentation strategy and the stable teacher to generate reliable pseudo labels are essential in the teacher-student framework of semi-supervised learning (SSL). Considering these in mind, to suit the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 JongMok Kim , Hwijun Lee , Jaeseung Lim , Jongkeun Na , Nojun Kwak , Jin Young Choi

We present the results of our system for the CoMeDi Shared Task, which predicts majority votes (Subtask 1) and annotator disagreements (Subtask 2). Our approach combines model ensemble strategies with MLP-based and threshold-based methods…

Computation and Language · Computer Science 2024-12-31 Zhu Liu , Zhen Hu , Ying Liu

Wake word (WW) spotting is challenging in far-field not only because of the interference in signal transmission but also the complexity in acoustic environments. Traditional WW model training requires large amount of in-domain WW-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-15 Yixin Gao , Yuriy Mishchenko , Anish Shah , Spyros Matsoukas , Shiv Vitaladevuni

In this work, we introduce a novel framework that employs cluster annotation to boost active learning by reducing the number of human interactions required to train deep neural networks. Instead of annotating single samples individually,…

Machine Learning · Computer Science 2019-01-28 Fábio Perez , Rémi Lebret , Karl Aberer

Multi-annotator learning (MAL) aims to model annotator-specific labeling patterns. However, existing methods face a critical challenge: they simply skip updating annotator-specific model parameters when encountering missing labels, i.e., a…

Multimedia · Computer Science 2025-08-08 Liyun Zhang , Zheng Lian , Hong Liu , Takanori Takebe , Yuta Nakashima

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

Most machine learning classifiers give predictions for new examples accurately, yet without indicating how trustworthy predictions are. In the medical domain, this hampers their integration in decision support systems, which could be useful…

Machine Learning · Computer Science 2018-07-06 Telma Pereira , Sandra Cardoso , Dina Silva , Manuela Guerreiro , Alexandre de Mendonça , Sara C. Madeira

Emotion labels in emotion recognition corpora are highly noisy and ambiguous, due to the annotators' subjective perception of emotions. Such ambiguity may introduce errors in automatic classification and affect the overall performance. We…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-11 Takuya Fujioka , Dario Bertero , Takeshi Homma , Kenji Nagamatsu

Machine question answering is an essential yet challenging task in natural language processing. Recently, Pre-trained Contextual Embeddings (PCE) models like Bidirectional Encoder Representations from Transformers (BERT) and A Lite BERT…

Computation and Language · Computer Science 2021-10-20 Shilun Li , Renee Li , Veronica Peng

The lack of labeled data is a major obstacle to learning high-quality sentence embeddings. Recently, self-supervised contrastive learning (SCL) is regarded as a promising way to address this problem. However, the existing works mainly rely…

Computation and Language · Computer Science 2022-03-01 Junhan Yang , Zheng Liu , Shitao Xiao , Jianxun Lian , Lijun Wu , Defu Lian , Guangzhong Sun , Xing Xie

Structured prediction is often approached by training a locally normalized model with maximum likelihood and decoding approximately with beam search. This approach leads to mismatches as, during training, the model is not exposed to its…

Computation and Language · Computer Science 2020-10-13 Renato Negrinho , Matthew R. Gormley , Geoffrey J. Gordon