中文
相关论文

相关论文: SarcasmBench: Towards Evaluating Large Language Mo…

200 篇论文

Large Language Models (LLMs), such as \texttt{ChatGPT}, greatly empower dialogue systems with strong language understanding and generation capabilities. However, most of the previous works prompt the LLMs to directly generate a response…

计算与语言 · 计算机科学 2023-10-17 Hongru Wang , Rui Wang , Fei Mi , Yang Deng , Zezhong Wang , Bin Liang , Ruifeng Xu , Kam-Fai Wong

Large Language Models, such as Generative Pre-trained Transformer 3 (aka. GPT-3), have been developed to understand language through the analysis of extensive text data, allowing them to identify patterns and connections between words.…

计算与语言 · 计算机科学 2023-10-03 Baphumelele Masikisiki , Vukosi Marivate , Yvette Hlope

Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. To tackle multi-step reasoning tasks, few-shot chain-of-thought (CoT) prompting includes a few manually crafted step-by-step…

计算与语言 · 计算机科学 2023-05-29 Lei Wang , Wanyu Xu , Yihuai Lan , Zhiqiang Hu , Yunshi Lan , Roy Ka-Wei Lee , Ee-Peng Lim

Prompt engineering is an essential technique for enhancing the abilities of large language models (LLMs) by providing explicit and specific instructions. It enables LLMs to excel in various tasks, such as arithmetic reasoning, question…

计算与语言 · 计算机科学 2024-03-29 Fobo Shi , Peijun Qing , Dong Yang , Nan Wang , Youbo Lei , Haonan Lu , Xiaodong Lin , Duantengchuan Li

Sarcasm detection in multilingual and code-mixed environments remains a challenging task for natural language processing models due to structural variations, informal expressions, and low-resource linguistic availability. This study…

计算与语言 · 计算机科学 2026-02-26 Bitan Majumder , Anirban Sen

Large language models (LLMs) have achieved remarkable performance in generating human-like text and solving reasoning tasks of moderate complexity, such as question-answering and mathematical problem-solving. However, their capabilities in…

计算与语言 · 计算机科学 2025-02-21 Cole Gawin , Yidan Sun , Mayank Kejriwal

Sarcasm is a challenge to sentiment analysis because of the incongruity between stated and implied sentiment. The challenge is exacerbated when the implication may be relevant to a specific country or geographical region. Pragmatic…

计算与语言 · 计算机科学 2025-10-31 Ishmanbir Singh , Dipankar Srirag , Aditya Joshi

Recent advances in Large Language Models (LLMs) have introduced Reasoning Large Language Models (RLLMs), which employ extended thinking processes with reflection and self-correction capabilities, demonstrating the effectiveness of test-time…

人工智能 · 计算机科学 2025-03-26 Yuyao Ge , Shenghua Liu , Yiwei Wang , Lingrui Mei , Lizhe Chen , Baolong Bi , Xueqi Cheng

This study quantifies how prompting strategies interact with large language models (LLMs) to automate the screening stage of systematic literature reviews (SLRs). We evaluate six LLMs (GPT-4o, GPT-4o-mini, DeepSeek-Chat-V3,…

计算与语言 · 计算机科学 2025-10-21 Binglan Han , Anuradha Mathrani , Teo Susnjak

The emergence of Small Language Models (SLMs) as privacy-preserving alternatives for sensitive applications raises a fundamental question about their inherent understanding capabilities compared to Large Language Models (LLMs). This paper…

计算与语言 · 计算机科学 2025-07-15 Hong Jia , Shiya Fu , Feng Xia , Vassilis Kostakos , Ting Dang

The latest large language models (LLMs) such as ChatGPT, exhibit strong capabilities in automated mental health analysis. However, existing relevant studies bear several limitations, including inadequate evaluations, lack of prompting…

计算与语言 · 计算机科学 2024-10-03 Kailai Yang , Shaoxiong Ji , Tianlin Zhang , Qianqian Xie , Ziyan Kuang , Sophia Ananiadou

People have long hoped for a conversational system that can assist in real-life situations, and recent progress on large language models (LLMs) is bringing this idea closer to reality. While LLMs are often impressive in performance, their…

计算与语言 · 计算机科学 2025-02-06 Linkai Peng , Baorian Nuchged , Yingming Gao

Large Language Models prompting, such as using in-context demonstrations, is a mainstream technique for invoking LLMs to perform high-performance and solid complex reasoning (e.g., mathematical reasoning, commonsense reasoning), and has the…

人工智能 · 计算机科学 2024-10-08 Zhicheng Yang , Yinya Huang , Jing Xiong , Liang Feng , Xiaodan Liang , Yiwei Wang , Jing Tang

Chain-of-thought (CoT) prompting is a popular in-context learning (ICL) approach for large language models (LLMs), especially when tackling complex reasoning tasks. Traditional ICL approaches construct prompts using examples that contain…

计算与语言 · 计算机科学 2025-06-23 Zifan Xu , Haozhu Wang , Dmitriy Bespalov , Xian Wu , Peter Stone , Yanjun Qi

Most existing prompting methods suffer from the issues of generalizability and consistency, as they often rely on instance-specific solutions that may not be applicable to other instances and lack task-level consistency across the selected…

计算与语言 · 计算机科学 2024-11-12 Chang Gao , Haiyun Jiang , Deng Cai , Shuming Shi , Wai Lam

Large language models generate judgments that resemble those of humans. Yet the extent to which these models align with human judgments in interpreting figurative and socially grounded language remains uncertain. To investigate this, human…

计算与语言 · 计算机科学 2026-01-15 Samhita Bollepally , Aurora Sloman-Moll , Takashi Yamauchi

In task-oriented conversational AI evaluation, unsupervised methods poorly correlate with human judgments, and supervised approaches lack generalization. Recent advances in large language models (LLMs) show robust zeroshot and few-shot…

计算与语言 · 计算机科学 2024-06-26 Jinghan Jia , Abi Komma , Timothy Leffel , Xujun Peng , Ajay Nagesh , Tamer Soliman , Aram Galstyan , Anoop Kumar

Stance Detection (SD) has become a critical area of interest due to its applications in various contexts leading to increased research within NLP. Yet the subtlety and complexity of texts sourced from online platforms often containing…

计算与语言 · 计算机科学 2025-03-07 Gibson Nkhata Shi Yin Hong , Susan Gauch

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks and exhibited impressive reasoning abilities by applying zero-shot Chain-of-Thought (CoT) prompting. However, due to the evolving nature of sentence…

计算与语言 · 计算机科学 2024-02-09 Feihu Jin , Yifan Liu , Ying Tan

With the help of Chain-of-Thought (CoT) prompting, Large Language Models (LLMs) have achieved remarkable performance on various reasoning tasks. However, most of them have been evaluated under noise-free context and the dilemma for LLMs to…

计算与语言 · 计算机科学 2023-10-26 Qingyuan Tian , Hanlun Zhu , Lei Wang , Yang Li , Yunshi Lan