English
Related papers

Related papers: Sim-GPT: Text Similarity via GPT Annotated Data

200 papers

Annotating large datasets can be challenging. However, crowd-sourcing is often expensive and can lack quality, especially for non-trivial tasks. We propose a method of using LLMs as few-shot learners for annotating data in a complex natural…

The rapid development of language-based artificial intelligence (AI) offers new possibilities for psychotherapy and assistive systems, particularly benefitting autistic individuals who often respond well to technology. Parents of autistic…

The increasing volume of research paper submissions poses a significant challenge to the traditional academic peer-review system, leading to an overwhelming workload for reviewers. This study explores the potential of integrating Large…

Artificial Intelligence · Computer Science 2024-12-03 Oscar Díaz , Xabier Garmendia , Juanan Pereira

This paper contributes a new State Of The Art (SOTA) for Semantic Textual Similarity (STS). We compare and combine a number of recently proposed sentence embedding methods for STS, and propose a novel and simple ensemble knowledge…

Computation and Language · Computer Science 2021-04-15 Fredrik Carlsson Magnus Sahlgren

User acceptance of artificial intelligence agents might depend on their ability to explain their reasoning, which requires adding an interpretability layer that fa- cilitates users to understand their behavior. This paper focuses on adding…

Computation and Language · Computer Science 2016-12-16 I. Lopez-Gazpio , M. Maritxalar , A. Gonzalez-Agirre , G. Rigau , L. Uria , E. Agirre

Simultaneous speech translation (SST) outputs translations in parallel with streaming speech input, balancing translation quality and latency. While large language models (LLMs) have been extended to handle the speech modality, streaming…

Computation and Language · Computer Science 2025-04-23 Keqi Deng , Wenxi Chen , Xie Chen , Philip C. Woodland

Large Language Models (LLMs) have demonstrated significant improvements in reasoning capabilities through supervised fine-tuning and reinforcement learning. However, when training reasoning models, these approaches are primarily applicable…

Computation and Language · Computer Science 2025-05-16 Yoichi Ishibashi , Taro Yano , Masafumi Oyamada

Assessing learners in ill-defined domains, such as scenario-based human tutoring training, is an area of limited research. Equity training requires a nuanced understanding of context, but do contemporary large language models (LLMs) have a…

Human-Computer Interaction · Computer Science 2025-01-14 Sanjit Kakarla , Conrad Borchers , Danielle Thomas , Shambhavi Bhushan , Kenneth R. Koedinger

Automatic text summarization (ATS) is an emerging technology to assist clinicians in providing continuous and coordinated care. This study presents an approach to summarize doctor-patient dialogues using generative large language models…

Computation and Language · Computer Science 2024-03-21 Mengxian Lyu , Cheng Peng , Xiaohan Li , Patrick Balian , Jiang Bian , Yonghui Wu

Machine learning-based classifiers have been used for text classification, such as sentiment analysis, news classification, and toxic comment classification. However, supervised machine learning models often require large amounts of labeled…

Computation and Language · Computer Science 2025-05-06 Yejian Zhang , Shingo Takada

Simultaneous speech translation (SimulST) translates partial speech inputs incrementally. Although the monotonic correspondence between input and output is preferable for smaller latency, it is not the case for distant language pairs such…

Computation and Language · Computer Science 2023-06-16 Yuka Ko , Ryo Fukuda , Yuta Nishikawa , Yasumasa Kano , Katsuhito Sudoh , Satoshi Nakamura

We test whether NLP datasets created with Large Language Models (LLMs) contain annotation artifacts and social biases like NLP datasets elicited from crowd-source workers. We recreate a portion of the Stanford Natural Language Inference…

Computation and Language · Computer Science 2025-03-10 Grace Proebsting , Adam Poliak

Data scarcity and class imbalance are persistent challenges in training robust NLP models, especially in specialized domains or low-resource settings. We propose a novel technique, SMOTExT, that adapts the idea of Synthetic Minority…

Computation and Language · Computer Science 2025-05-20 Mateusz Bystroński , Mikołaj Hołysz , Grzegorz Piotrowski , Nitesh V. Chawla , Tomasz Kajdanowicz

Machine learning-based automatic scoring faces challenges with unbalanced student responses across scoring categories. To address this, we introduce a novel text data augmentation framework leveraging GPT-4, a generative large language…

Computation and Language · Computer Science 2024-09-09 Luyang Fang , Gyeong-Geon Lee , Xiaoming Zhai

This study investigates the prevalence of violent language on incels.is. It evaluates GPT models (GPT-3.5 and GPT-4) for content analysis in social sciences, focusing on the impact of varying prompts and batch sizes on coding quality for…

Social and Information Networks · Computer Science 2024-01-05 Daniel Matter , Miriam Schirmer , Nir Grinberg , Jürgen Pfeffer

We address the task of unsupervised Semantic Textual Similarity (STS) by ensembling diverse pre-trained sentence encoders into sentence meta-embeddings. We apply, extend and evaluate different meta-embedding methods from the word embedding…

Computation and Language · Computer Science 2020-06-25 Nina Poerner , Ulli Waltinger , Hinrich Schütze

Pretrained language models (PLMs) have demonstrated remarkable performance in various natural language processing tasks: Unidirectional PLMs (e.g., GPT) are well known for their superior text generation capabilities; bidirectional PLMs…

Computation and Language · Computer Science 2022-10-13 Yu Meng , Jiaxin Huang , Yu Zhang , Jiawei Han

Task-adaptive pre-training (TAPT) and Self-training (ST) have emerged as the major semi-supervised approaches to improve natural language understanding (NLU) tasks with massive amount of unlabeled data. However, it's unclear whether they…

Computation and Language · Computer Science 2023-02-21 Shiyang Li , Semih Yavuz , Wenhu Chen , Xifeng Yan

Signed Graph Neural Networks (SGNNs) are effective in learning expressive representations for signed graphs but typically require substantial task-specific labels, limiting their applicability in label-scarce industrial scenarios. In…

Machine Learning · Computer Science 2025-08-19 Zian Zhai , Sima Qing , Xiaoyang Wang , Wenjie Zhang

Machine learning (ML) models for code clone detection determine whether two pieces of code are semantically equivalent, which in turn is a key building block for software-engineering tasks like refactoring and security tasks like…

Software Engineering · Computer Science 2025-12-09 Ashish Hooda , Mihai Christodorescu , Chuangang Ren , Aaron Wilson , Kassem Fawaz , Somesh Jha