中文
相关论文

相关论文: Evaluating Large language models on Understanding …

200 篇论文

Generating rational and generally accurate responses to tasks, often accompanied by example demonstrations, highlights Large Language Model's (LLM's) remarkable In-Context Learning (ICL) capabilities without requiring updates to the model's…

机器学习 · 计算机科学 2025-06-17 Debanjan Dutta , Faizanuddin Ansari , Swagatam Das

Conversational explainable artificial intelligence (ConvXAI) systems based on large language models (LLMs) have garnered significant interest from the research community in natural language processing (NLP) and human-computer interaction…

计算与语言 · 计算机科学 2024-09-23 Qianli Wang , Tatiana Anikina , Nils Feldhus , Simon Ostermann , Sebastian Möller

Intention identification is a core issue in dialog management. However, due to the non-canonicality of the spoken language, it is difficult to extract the content automatically from the conversation-style utterances. This is much more…

计算与语言 · 计算机科学 2019-07-10 Won Ik Cho , Young Ki Moon , Woo Hyun Kang , Nam Soo Kim

In this study, we investigate the capabilities and inherent biases of advanced large language models (LLMs) such as GPT-3.5 and GPT-4 in the context of debate evaluation. We discover that LLM's performance exceeds humans and surpasses the…

计算与语言 · 计算机科学 2024-06-05 Xinyi Liu , Pinxin Liu , Hangfeng He

Evaluating reasoning ability in Large Language Models (LLMs) is important for advancing artificial intelligence, as it transcends mere linguistic task performance. It involves understanding whether these models truly understand information,…

人工智能 · 计算机科学 2025-10-29 Benjamin Grando Moreira

Large Language Models (LLMs), such as \texttt{ChatGPT}, greatly empower dialogue systems with strong language understanding and generation capabilities. However, most of the previous works prompt the LLMs to directly generate a response…

计算与语言 · 计算机科学 2023-10-17 Hongru Wang , Rui Wang , Fei Mi , Yang Deng , Zezhong Wang , Bin Liang , Ruifeng Xu , Kam-Fai Wong

With the emergence of advanced reasoning models like OpenAI o3 and DeepSeek-R1, large language models (LLMs) have demonstrated remarkable reasoning capabilities. However, their ability to perform rigorous logical reasoning remains an open…

人工智能 · 计算机科学 2025-02-14 Hanmeng Liu , Zhizhang Fu , Mengru Ding , Ruoxi Ning , Chaoli Zhang , Xiaozhang Liu , Yue Zhang

Large Language Models (LLMs) achieve remarkable performance through pretraining on extensive data. This enables efficient adaptation to diverse downstream tasks. However, the lack of interpretability in their underlying mechanisms limits…

计算与语言 · 计算机科学 2025-06-03 Xintong Wang , Jingheng Pan , Liang Ding , Longyue Wang , Longqin Jiang , Xingshan Li , Chris Biemann

Human-LLM conversations are increasingly becoming more pervasive in peoples' professional and personal lives, yet many users still struggle to elicit helpful responses from LLM Chatbots. One of the reasons for this issue is users' lack of…

Spoken Language Understanding (SLU), which aims to extract user semantics to execute downstream tasks, is a crucial component of task-oriented dialog systems. Existing SLU datasets generally lack sufficient diversity and complexity, and…

计算与语言 · 计算机科学 2025-12-02 Yuezhang Peng , Chonghao Cai , Ziang Liu , Shuai Fan , Sheng Jiang , Hua Xu , Yuxin Liu , Qiguang Chen , Kele Xu , Yao Li , Sheng Wang , Libo Qin , Xie Chen

When we integrate factual knowledge from knowledge graphs (KGs) into large language models (LLMs) to enhance their performance, the cost of injection through training increases with the scale of the models. Consequently, there is…

计算与语言 · 计算机科学 2025-01-24 Xinbang Dai , Yuncheng Hua , Tongtong Wu , Yang Sheng , Qiu Ji , Guilin Qi

A common problem for agents operating in real-world environments is that the response of an environment to their actions may be non-deterministic and observed through noise. This renders environmental state and progress towards completing a…

人工智能 · 计算机科学 2024-05-21 William E Bishop , Alice Li , Christopher Rawles , Oriana Riva

Large language models (LLMs) excel on many NLP benchmarks, but their behavior on real-world, semi-structured prediction remains underexplored. We present LlaMADRS, a benchmark for structured clinical assessment from dialogue built on the…

Large language models (LLMs) have demonstrated remarkable potential across numerous applications and have shown an emergent ability to tackle complex reasoning tasks, such as mathematical computations. However, even for the simplest…

计算与语言 · 计算机科学 2024-09-04 Wei Zhang , Chaoqun Wan , Yonggang Zhang , Yiu-ming Cheung , Xinmei Tian , Xu Shen , Jieping Ye

Speech Language Models (SLMs) exhibit strong semantic understanding, yet their generated speech often sounds flat and fails to convey expressive intent, undermining user engagement. We term this mismatch the semantic understanding-acoustic…

计算与语言 · 计算机科学 2026-04-14 Kuang Wang , Lai Wei , Qibing Bai , Ping Lin , Wenkai Fang , Feng Jiang , Zhongjie Jiang , Jun Huang , Yannan Wang , Haizhou Li

Language models (LMs) can perform complex reasoning either end-to-end, with hidden latent state, or compositionally, with transparent intermediate state. Composition offers benefits for interpretability and safety, but may need workflow…

Large Language Models (LLMs) are recruited in applications that span from clinical assistance and legal support to question answering and education. Their success in specialized tasks has led to the claim that they possess human-like…

计算与语言 · 计算机科学 2024-07-10 Vittoria Dentella , Fritz Guenther , Elliot Murphy , Gary Marcus , Evelina Leivada

Large Language Models (LLMs), such as ChatGPT, have recently been applied to various NLP tasks due to its open-domain generation capabilities. However, there are two issues with applying LLMs to dialogue tasks. 1. During the dialogue…

计算与语言 · 计算机科学 2023-10-06 Siwei Wu , Xiangqing Shen , Rui Xia

Large language models (LLMs) possess strong persuasive capabilities that outperform humans in head-to-head comparisons. Users report consulting LLMs to inform major life decisions in relationships, medical settings, and when seeking…

人机交互 · 计算机科学 2026-04-28 Nalin Poungpeth , Nicholas Clark , Tanu Mitra

Polite speech poses a fundamental alignment challenge for large language models (LLMs). Humans deploy a rich repertoire of linguistic strategies to balance informational and social goals -- from positive approaches that build rapport…

计算与语言 · 计算机科学 2025-10-31 Haoran Zhao , Robert D. Hawkins