English
Related papers

Related papers: Multi-News+: Cost-efficient Dataset Cleansing via …

200 papers

Real-world domain experts (e.g., doctors) rarely annotate only a decision label in their day-to-day workflow without providing explanations. Yet, existing low-resource learning techniques, such as Active Learning (AL), that aim to support…

Computation and Language · Computer Science 2023-10-24 Bingsheng Yao , Ishan Jindal , Lucian Popa , Yannis Katsis , Sayan Ghosh , Lihong He , Yuxuan Lu , Shashank Srivastava , Yunyao Li , James Hendler , Dakuo Wang

Leveraging Large Language Models (LLMs) for recommendation has recently garnered considerable attention, where fine-tuning plays a key role in LLMs' adaptation. However, the cost of fine-tuning LLMs on rapidly expanding recommendation data…

Information Retrieval · Computer Science 2024-06-05 Xinyu Lin , Wenjie Wang , Yongqi Li , Shuo Yang , Fuli Feng , Yinwei Wei , Tat-Seng Chua

Supervised learning relies on data annotation which usually is time-consuming and therefore expensive. A longstanding strategy to reduce annotation costs is active learning, an iterative process, in which a human annotates only data…

Computation and Language · Computer Science 2026-02-03 Julia Romberg , Christopher Schröder , Julius Gonsior , Katrin Tomanek , Fredrik Olsson

Annotated images are required for both supervised model training and evaluation in image classification. Manually annotating images is arduous and expensive, especially for multi-labeled images. A recent trend for conducting such laboursome…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Jianzhe Lin , Tianze Yu , Z. Jane Wang

Climate misinformation is a problem that has the potential to be substantially aggravated by the development of Large Language Models (LLMs). In this study we evaluate the potential for LLMs to be part of the solution for mitigating online…

Computers and Society · Computer Science 2025-03-11 Mowafak Allaham , Ayse D. Lokmanoglu , P. Sol Hart , Erik C. Nisbet

In this work, we develop a specialized dataset aimed at enhancing the evaluation and fine-tuning of large language models (LLMs) specifically for wireless communication applications. The dataset includes a diverse set of multi-hop…

Machine Learning · Computer Science 2025-01-17 Yushen Lin , Ruichen Zhang , Wenqi Huang , Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Dusit Niyato

This study explores a novel approach to enhance the performance of Large Language Models (LLMs) through the optimization of input data within prompts. While previous research has primarily focused on refining instruction components and…

Machine Learning · Computer Science 2025-02-18 Sam Lin , Wenyue Hua , Lingyao Li , Zhenting Wang , Yongfeng Zhang

Recent advances in large language models (LLMs) like GPT-3.5 and GPT-4 promise automation with better results and less programming, opening up new opportunities for text analysis in political science. In this study, we evaluate LLMs on…

Computation and Language · Computer Science 2024-08-29 Lorenzo Lupo , Oscar Magnusson , Dirk Hovy , Elin Naurin , Lena Wängnerud

Large Language Models (LLMs) have demonstrated considerable advances, and several claims have been made about their exceeding human performance. However, in real-world tasks, domain knowledge is often required. Low-resource learning methods…

Computation and Language · Computer Science 2023-11-17 Yuxuan Lu , Bingsheng Yao , Shao Zhang , Yun Wang , Peng Zhang , Tun Lu , Toby Jia-Jun Li , Dakuo Wang

The spread of election misinformation and harmful political content conveys misleading narratives and poses a serious threat to democratic integrity. Detecting harmful content at early stages is essential for understanding and potentially…

Human-Computer Interaction · Computer Science 2026-02-24 Qile Wang , Prerana Khatiwada , Carolina Coimbra Vieira , Benjamin E. Bagozzi , Kenneth E. Barner , Matthew Louis Mauriello

Despite the growing interest in leveraging Large Language Models (LLMs) for content analysis, current studies have primarily focused on text-based content. In the present work, we explored the potential of LLMs in assisting video content…

Human-Computer Interaction · Computer Science 2024-07-31 Jiaying Lizzy Liu , Yunlong Wang , Yao Lyu , Yiheng Su , Shuo Niu , Xuhai Orson Xu , Yan Zhang

Data augmentation is an essential technique in natural language processing (NLP) for enriching training datasets by generating diverse samples. This process is crucial for improving the robustness and generalization capabilities of NLP…

Computation and Language · Computer Science 2025-10-16 Zaitian Wang , Jinghan Zhang , Xinhao Zhang , Kunpeng Liu , Pengfei Wang , Yuanchun Zhou

The growing complexity and diversity of news coverage have made framing analysis a crucial yet challenging task in computational social science. Traditional approaches, including manual annotation and fine-tuned models, remain limited by…

Computation and Language · Computer Science 2026-05-22 Valeria Pastorino , Jasivan A. Sivakumar , Nafise Sadat Moosavi

In code review, generating structured and relevant comments is crucial for identifying code issues and facilitating accurate code changes that ensure an efficient code review process. Well-crafted comments not only streamline the code…

Software Engineering · Computer Science 2025-02-06 Oussama Ben Sghaier , Martin Weyssow , Houari Sahraoui

Instruction tuning is crucial for aligning Large Language Models (LLMs), yet the quality of instruction-following data varies significantly. While high-quality data is paramount, it is often scarce; conversely, abundant low-quality data is…

Computation and Language · Computer Science 2025-10-24 Zhijie Deng , Zhouan Shen , Ling Li , Yao Zhou , Zhaowei Zhu , Yanji He , Wei Wang , Jiaheng Wei

Accurate query-product relevance labeling is indispensable to generate ground truth dataset for search ranking in e-commerce. Traditional approaches for annotating query-product pairs rely on human-based labeling services, which is…

Information Retrieval · Computer Science 2025-02-27 Jayant Sachdev , Sean D Rosario , Abhijeet Phatak , He Wen , Swati Kirti , Chittaranjan Tripathy

To achieve state-of-the-art performance, one still needs to train NER models on large-scale, high-quality annotated data, an asset that is both costly and time-intensive to accumulate. In contrast, real-world applications often resort to…

Computation and Language · Computer Science 2023-10-26 Zhendong Chu , Ruiyi Zhang , Tong Yu , Rajiv Jain , Vlad I Morariu , Jiuxiang Gu , Ani Nenkova

Most existing large language models (LLMs) are expensive to adapt after deployment, especially when a task requires newly produced information or niche domain knowledge. Recent work has shown that, by manipulating and optimizing their…

Computation and Language · Computer Science 2026-05-15 Zeyu Huang , Adhiguna Kuncoro , Qixuan Feng , Jiajun Shen , Lucio Dery , Arthur Szlam , Marc'Aurelio Ranzato

The efficacy of large language models (LLMs) on downstream tasks usually hinges on instruction tuning, which relies critically on the quality of training data. Unfortunately, collecting high-quality and diverse data is both expensive and…

Computation and Language · Computer Science 2024-11-25 Hang Zhou , Yehui Tang , Haochen Qin , Yujie Yang , Renren Jin , Deyi Xiong , Kai Han , Yunhe Wang

Annotated data is an essential ingredient in natural language processing for training and evaluating machine learning models. It is therefore very desirable for the annotations to be of high quality. Recent work, however, has shown that…

Computation and Language · Computer Science 2022-09-27 Jan-Christoph Klie , Bonnie Webber , Iryna Gurevych