中文
相关论文

相关论文: Evaluating Large Language Models as Virtual Annota…

200 篇论文

Large Language Models (LLMs) have fundamentally transformed approaches to Natural Language Processing (NLP) tasks across diverse domains. In healthcare, accurate and cost-efficient text classification is crucial, whether for clinical notes…

计算与语言 · 计算机科学 2026-02-16 Hajar Sakai , Sarah S. Lam

The number and dynamic nature of web and mobile applications presents significant challenges for assessing their compliance with data protection laws. In this context, symbolic and statistical Natural Language Processing (NLP) techniques…

计算与语言 · 计算机科学 2025-12-22 David Rodriguez , Ian Yang , Jose M. Del Alamo , Norman Sadeh

Work done to uncover the knowledge encoded within pre-trained language models rely on annotated corpora or human-in-the-loop methods. However, these approaches are limited in terms of scalability and the scope of interpretation. We propose…

计算与语言 · 计算机科学 2023-10-23 Basel Mousi , Nadir Durrani , Fahim Dalvi

Large language models are being rapidly deployed across many fields such as healthcare, finance, transportation, and energy, where time-series data are fundamental components. The current works are still limited in their ability to perform…

人工智能 · 计算机科学 2026-01-23 Paul Quinlan , Qingguo Li , Xiaodan Zhu

Despite achieving remarkable success in complex tasks, Deep Reinforcement Learning (DRL) is still suffering from critical issues in practical applications, such as low data efficiency, lack of interpretability, and limited cross-environment…

人工智能 · 计算机科学 2026-03-10 Chang Yao , Jinghui Qin , Kebing Jin , Hankz Hankui Zhuo

The quality of the dataset is crucial for ensuring optimal performance and reliability of downstream task models. However, datasets often contain noisy data inadvertently included during the construction process. Numerous attempts have been…

计算与语言 · 计算机科学 2024-09-25 Juhwan Choi , Jungmin Yun , Kyohoon Jin , YoungBin Kim

Spatio-temporal forecasting plays a crucial role in various sectors such as transportation systems, logistics, and supply chain management. However, existing methods are limited by their ability to handle large, complex datasets. To…

机器学习 · 计算机科学 2024-08-27 Sakhinana Sagar Srinivas , Chidaksh Ravuru , Geethan Sannidhi , Venkataramana Runkana

By encoding time series as a string of numerical digits, we can frame time series forecasting as next-token prediction in text. Developing this approach, we find that large language models (LLMs) such as GPT-3 and LLaMA-2 can surprisingly…

机器学习 · 计算机科学 2024-08-13 Nate Gruver , Marc Finzi , Shikai Qiu , Andrew Gordon Wilson

Finding preferences expressed in natural language is an important but challenging task. State-of-the-art(SotA) methods leverage transformer-based models such as BERT, RoBERTa, etc. and graph neural architectures such as graph attention…

计算与语言 · 计算机科学 2023-10-13 Inwon Kang , Sikai Ruan , Tyler Ho , Jui-Chien Lin , Farhad Mohsin , Oshani Seneviratne , Lirong Xia

Certain forms of linguistic annotation, like part of speech and semantic tagging, can be automated with high accuracy. However, manual annotation is still necessary for complex pragmatic and discursive features that lack a direct mapping to…

计算与语言 · 计算机科学 2024-12-10 Danni Yu , Luyang Li , Hang Su , Matteo Fuoli

Data annotation refers to the labeling or tagging of textual data with relevant information. A large body of works have reported positive results on leveraging LLMs as an alternative to human annotators. However, existing studies focus on…

计算与语言 · 计算机科学 2024-10-07 Yu-Min Tseng , Wei-Lin Chen , Chung-Chi Chen , Hsin-Hsi Chen

High-quality human annotations are necessary for creating effective machine learning-driven stream processing systems. We study hybrid stream processing systems based on a Human-In-The-Loop Machine Learning (HITL-ML) paradigm, in which one…

人机交互 · 计算机科学 2022-01-19 Rahul Pandey , Hemant Purohit , Carlos Castillo , Valerie L. Shalin

This work delves into the expanding role of large language models (LLMs) in generating artificial data. LLMs are increasingly employed to create a variety of outputs, including annotations, preferences, instruction prompts, simulated…

Large language models (LLMs) have revolutionised many fields, with LLM-as-a-service (LLMSaaS) offering accessible, general-purpose solutions without costly task-specific training. In contrast to the widely studied prompt engineering for…

计算与语言 · 计算机科学 2026-03-17 Md Rakibul Hasan , Yue Yao , Md Zakir Hossain , Aneesh Krishna , Imre Rudas , Shafin Rahman , Tom Gedeon

Storytelling is an integral part of human experience and plays a crucial role in social interactions. Thus, Automatic Story Evaluation (ASE) and Generation (ASG) could benefit society in multiple ways, but they are challenging tasks which…

计算与语言 · 计算机科学 2024-05-24 Cyril Chhun , Fabian M. Suchanek , Chloé Clavel

Large language models (LLMs) have revolutionized applications such as code completion, chatbots, and online classification. To elevate user experiences, service level objectives (SLOs) serve as crucial benchmarks for assessing inference…

分布式、并行与集群计算 · 计算机科学 2025-06-13 Jinqi Huang , Yi Xiong , Xuebing Yu , Wenjie Huang , Entong Li , Li Zeng , Xin Chen

Access to high-quality labeled data remains a limiting factor in applied supervised learning. While label variation (LV), i.e., differing labels for the same instance, is common, especially in natural language processing, annotation…

计算与语言 · 计算机科学 2025-07-04 Cornelia Gruber , Helen Alber , Bernd Bischl , Göran Kauermann , Barbara Plank , Matthias Aßenmacher

Evaluating the quality of arguments is a crucial aspect of any system leveraging argument mining. However, it is a challenge to obtain reliable and consistent annotations regarding argument quality, as this usually requires domain-specific…

计算与语言 · 计算机科学 2024-04-16 Nailia Mirzakhmedova , Marcel Gohsen , Chia Hao Chang , Benno Stein

The increasing capacities of large language models (LLMs) have been shown to present an unprecedented opportunity to scale up data analytics in the humanities and social sciences, by automating complex qualitative tasks otherwise typically…

计算与语言 · 计算机科学 2024-10-22 Andres Karjus

Time series data plays a critical role across diverse domains such as healthcare, energy, and finance, where tasks like classification, anomaly detection, and forecasting are essential for informed decision-making. Recently, large language…

机器学习 · 计算机科学 2024-12-18 Francis Tang , Ying Ding