中文
相关论文

相关论文: Modeling Annotator Disagreement with Demographic-A…

200 篇论文

Large Language Models (LLMs) exhibit remarkable text classification capabilities, excelling in zero- and few-shot learning (ZSL and FSL) scenarios. However, since they are trained on different datasets, performance varies widely across…

计算与语言 · 计算机科学 2024-04-16 Flor Miriam Plaza-del-Arco , Debora Nozza , Dirk Hovy

Macro-aligned micro-records are crucial for credible simulations in social science and urban studies. For example, epidemic models are only reliable when individual-level mobility and contacts mirror real behavior, while aggregates match…

机器学习 · 计算机科学 2025-10-14 Yihong Tang , Menglin Kong , Junlin He , Tong Nie , Lijun Sun

Fine-grained opinion analysis of text provides a detailed understanding of expressed sentiments, including the addressed entity. Although this level of detail is valuable, annotating opinions in datasets for model training requires…

计算与语言 · 计算机科学 2026-05-28 Gaurav Negi , MA Waskow , John McCrae , Omnia Zayed , Paul Buitelaar

Graph neural networks (GNNs) have achieved significant progress in graph-based learning tasks, yet their performance often deteriorates when facing heterophilous structures where connected nodes differ substantially in features and labels.…

机器学习 · 计算机科学 2025-11-13 Xuanze Chen , Jiajun Zhou , Yadong Li , Jinsong Chen , Shanqing Yu , Qi Xuan

Label aggregation such as majority voting is commonly used to resolve annotator disagreement in dataset creation. However, this may disregard minority values and opinions. Recent studies indicate that learning from individual annotations…

计算与语言 · 计算机科学 2023-10-24 Xinpeng Wang , Barbara Plank

Previous research on EMA data of mental disorders was mainly focused on multivariate regression-based approaches modeling each individual separately. This paper goes a step further towards exploring the use of non-linear interpretable…

机器学习 · 计算机科学 2022-04-05 Mandani Ntekouli , Gerasimos Spanakis , Lourens Waldorp , Anne Roefs

Graph neural networks (GNNs) are gaining popularity for processing graph-structured data. In real-world scenarios, graph data within the same dataset can vary significantly in scale. This variability leads to depth-sensitivity, where the…

机器学习 · 计算机科学 2024-11-06 Zelin Yao , Chuang Liu , Xianke Meng , Yibing Zhan , Jia Wu , Shirui Pan , Wenbin Hu

Mixture of Experts (MoE) is a popular framework for modeling heterogeneity in data for regression, classification and clustering. For continuous data which we consider here in the context of regression and cluster analysis, MoE usually use…

统计方法学 · 统计学 2015-06-30 Faicel Chamroukhi

With the rapid adoption of multimodal large language models (MLLMs) across diverse applications, there is a pressing need for task-centered, high-quality training data. A key limitation of current training datasets is their reliance on…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Xiaoyu Lin , Aniket Ghorpade , Hansheng Zhu , Justin Qiu , Dea Rrozhani , Monica Lama , Mick Yang , Zixuan Bian , Ruohan Ren , Alan B. Hong , Jiatao Gu , Chris Callison-Burch

Language models are often evaluated with scalar metrics like accuracy, but such measures fail to capture how models internally represent ambiguity, especially when human annotators disagree. We propose a topological perspective to analyze…

计算与语言 · 计算机科学 2026-04-30 Nisrine Rair , Alban Goupil , Valeriu Vrabie , Emmanuel Chochoy

When developing new large language models (LLMs), a key step is evaluating their final performance, often by computing the win-rate against a reference model based on external feedback. Human feedback is the gold standard, particularly for…

机器学习 · 计算机科学 2025-02-26 Zhaoyi Zhou , Yuda Song , Andrea Zanette

Cross-scene generalizable NeRF models, which can directly synthesize novel views of unseen scenes, have become a new spotlight of the NeRF field. Several existing attempts rely on increasingly end-to-end "neuralized" architectures, i.e.,…

计算机视觉与模式识别 · 计算机科学 2023-08-24 Wenyan Cong , Hanxue Liang , Peihao Wang , Zhiwen Fan , Tianlong Chen , Mukund Varma , Yi Wang , Zhangyang Wang

Although language models (LMs) have boosted the performance of Question Answering, they still need plenty of data. Data annotation, in contrast, is a time-consuming process. This especially applies to Question Answering, where possibly…

计算与语言 · 计算机科学 2024-05-16 Maximilian Schmidt , Andrea Bartezzaghi , Ngoc Thang Vu

The use of LLM-based applications as a means to accelerate and/or substitute human labor in the creation of language resources and dataset is a reality. Nonetheless, despite the potential of such tools for linguistic research, comprehensive…

Large language models (LLMs) often struggle in specialized domains such as legal reasoning due to limited expert knowledge, resulting in factually incorrect outputs or hallucinations. This paper presents an effective method for adapting…

Large Language Models (LLMs) such as GPT & Llama have demonstrated significant achievements in summarization tasks but struggle with factual inaccuracies, a critical issue in clinical NLP applications where errors could lead to serious…

计算与语言 · 计算机科学 2024-10-04 Prakamya Mishra , Zonghai Yao , Parth Vashisht , Feiyun Ouyang , Beining Wang , Vidhi Dhaval Mody , Hong Yu

Data scarcity and class imbalance are persistent challenges in training robust NLP models, especially in specialized domains or low-resource settings. We propose a novel technique, SMOTExT, that adapts the idea of Synthetic Minority…

计算与语言 · 计算机科学 2025-05-20 Mateusz Bystroński , Mikołaj Hołysz , Grzegorz Piotrowski , Nitesh V. Chawla , Tomasz Kajdanowicz

Supervised fine-tuning (SFT) is widely used to align large language models (LLMs) with information extraction (IE) tasks, such as named entity recognition (NER). However, annotating such fine-grained labels and training domain-specific…

计算与语言 · 计算机科学 2025-07-01 Zhuojun Ding , Wei Wei , Chenghao Fan

Many natural language processing (NLP) tasks rely on labeled data to train machine learning models with high performance. However, data annotation is time-consuming and expensive, especially when the task involves a large amount of data or…

计算与语言 · 计算机科学 2024-04-08 Xingwei He , Zhenghao Lin , Yeyun Gong , A-Long Jin , Hang Zhang , Chen Lin , Jian Jiao , Siu Ming Yiu , Nan Duan , Weizhu Chen

Annotating large datasets can be challenging. However, crowd-sourcing is often expensive and can lack quality, especially for non-trivial tasks. We propose a method of using LLMs as few-shot learners for annotating data in a complex natural…