English
Related papers

Related papers: Evaluating Large Language Models as Virtual Annota…

200 papers

Recognizing overlapping speech from multiple speakers in conversational scenarios is one of the most challenging problem for automatic speech recognition (ASR). Serialized output training (SOT) is a classic method to address multi-talker…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-02 Mohan Shi , Zengrui Jin , Yaoxun Xu , Yong Xu , Shi-Xiong Zhang , Kun Wei , Yiwen Shao , Chunlei Zhang , Dong Yu

Spoken Language Models (SLMs) are increasingly central to modern speech-driven applications, but performance degrades under acoustic shift - real-world noise, reverberation, and microphone variation. Prior solutions rely on offline domain…

Experimental evaluations of software engineering innovations, e.g., tools and processes, often include human-subject studies as a component of a multi-pronged strategy to obtain greater generalizability of the findings. However,…

Software Engineering · Computer Science 2025-02-06 Toufique Ahmed , Premkumar Devanbu , Christoph Treude , Michael Pradel

Recent advancements in large language models (LLMs) have revolutionized various domains, bringing significant progress and new opportunities. Despite progress in speech-related tasks, LLMs have not been sufficiently explored in multi-talker…

Computation and Language · Computer Science 2025-04-03 Lingwei Meng , Shujie Hu , Jiawen Kang , Zhaoqing Li , Yuejiao Wang , Wenxuan Wu , Xixin Wu , Xunying Liu , Helen Meng

We propose a scalable method for constructing a temporal opinion knowledge base with large language models (LLMs) as automated annotators. Despite the demonstrated utility of time-series opinion analysis of text for downstream applications…

Computation and Language · Computer Science 2025-09-03 Gaurav Negi , Atul Kr. Ojha , Omnia Zayed , Paul Buitelaar

Test collections are information-retrieval tools that allow researchers to quickly and easily evaluate ranking algorithms. While test collections have become an integral part of IR research, the process of data creation involves significant…

Information Retrieval · Computer Science 2025-07-15 Rikiya Takehi , Ellen M. Voorhees , Tetsuya Sakai , Ian Soboroff

Active learning algorithms automatically identify the most informative samples from large amounts of unlabeled data and tremendously reduce human annotation effort in inducing a machine learning model. In a conventional active learning…

Machine Learning · Computer Science 2026-04-28 Varun Totakura , Ankita Singh , Yushun Dong , Shayok Chakraborty

While most generative models show achievements in image data generation, few are developed for tabular data generation. Recently, due to success of large language models (LLM) in diverse tasks, they have also been used for tabular data…

Machine Learning · Computer Science 2024-10-30 Dang Nguyen , Sunil Gupta , Kien Do , Thin Nguyen , Svetha Venkatesh

This paper assesses the potential for the large language models (LLMs) GPT-4 and GPT-3.5 to aid in deriving insight from education feedback surveys. Exploration of LLM use cases in education has focused on teaching and learning, with less…

Computation and Language · Computer Science 2024-06-28 Michael J. Parker , Caitlin Anderson , Claire Stone , YeaRim Oh

Large language models are rapidly transforming social science research by enabling the automation of labor-intensive tasks like data annotation and text analysis. However, LLM outputs vary significantly depending on the implementation…

Computation and Language · Computer Science 2025-10-07 Joachim Baumann , Paul Röttger , Aleksandra Urman , Albert Wendsjö , Flor Miriam Plaza-del-Arco , Johannes B. Gruber , Dirk Hovy

Due to the lack of a large collection of high-quality labeled sentence pairs with textual similarity scores, existing approaches for Semantic Textual Similarity (STS) mostly rely on unsupervised techniques or training signals that are only…

Computation and Language · Computer Science 2023-12-13 Shuhe Wang , Beiming Cao , Shengyu Zhang , Xiaoya Li , Jiwei Li , Fei Wu , Guoyin Wang , Eduard Hovy

Large Language Models (LLMs) exhibit remarkable text classification capabilities, excelling in zero- and few-shot learning (ZSL and FSL) scenarios. However, since they are trained on different datasets, performance varies widely across…

Computation and Language · Computer Science 2024-04-16 Flor Miriam Plaza-del-Arco , Debora Nozza , Dirk Hovy

Recent advancement in large language models (LLMs) has offered a strong potential for natural language systems to process informal language. A representative form of informal language is slang, used commonly in daily conversations and…

Computation and Language · Computer Science 2024-04-16 Zhewei Sun , Qian Hu , Rahul Gupta , Richard Zemel , Yang Xu

In recent years, pre-trained large language models (LLMs) have demonstrated remarkable efficiency in achieving an inference-time few-shot learning capability known as in-context learning. However, existing literature has highlighted the…

Computation and Language · Computer Science 2024-02-14 Xinyi Wang , Wanrong Zhu , Michael Saxon , Mark Steyvers , William Yang Wang

There has been tremendous progress in multimodal Large Language Models (LLMs). Recent works have extended these models to video input with promising instruction following capabilities. However, an important missing piece is temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 De-An Huang , Shijia Liao , Subhashree Radhakrishnan , Hongxu Yin , Pavlo Molchanov , Zhiding Yu , Jan Kautz

Prevailing large language models (LLMs) are capable of human responses simulation through its unprecedented content generation and reasoning abilities. However, it is not clear whether and how to leverage LLMs to simulate field experiments.…

Artificial Intelligence · Computer Science 2024-08-20 Yaoyu Chen , Yuheng Hu , Yingda Lu

Over the past decade, the revolution in single-cell sequencing has enabled the simultaneous molecular profiling of various modalities across thousands of individual cells, allowing scientists to investigate the diverse functions of complex…

Computation and Language · Computer Science 2024-12-05 Junhao Liu , Siwei Xu , Lei Zhang , Jing Zhang

Sentiment analysis (SA) has been a long-standing research area in natural language processing. It can offer rich insights into human sentiments and opinions and has thus seen considerable interest from both academia and industry. With the…

Computation and Language · Computer Science 2023-05-25 Wenxuan Zhang , Yue Deng , Bing Liu , Sinno Jialin Pan , Lidong Bing

Stance classification, the task of predicting the viewpoint of an author on a subject of interest, has long been a focal point of research in domains ranging from social science to machine learning. Current stance detection methods rely…

Computation and Language · Computer Science 2024-03-07 Iain J. Cruickshank , Lynnette Hui Xian Ng

Most existing sign language translation (SLT) datasets are limited in scale, lack multilingual coverage, and are costly to curate due to their reliance on expert annotation and controlled recording setup. Recently, Vision Language Models…

Computation and Language · Computer Science 2025-10-30 Shakib Yazdani , Yasser Hamidullah , Cristina España-Bonet , Josef van Genabith