中文
相关论文

相关论文: A Closer Look at System Prompt Robustness

200 篇论文

This study presents an innovative approach to the application of large language models (LLMs) in clinical decision-making, focusing on OpenAI's ChatGPT. Our approach introduces the use of contextual prompts-strategically designed to include…

人工智能 · 计算机科学 2023-08-22 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia

Prompt design plays a crucial role in shaping the efficacy of ChatGPT, influencing the model's ability to extract contextually accurate responses. Thus, optimal prompt construction is essential for maximizing the utility and performance of…

软件工程 · 计算机科学 2024-02-08 Saikat Mondal , Suborno Deb Bappon , Chanchal K. Roy

The dream of achieving a student-teacher ratio of 1:1 is closer than ever thanks to the emergence of large language models (LLMs). One potential application of these models in the educational field would be to provide feedback to students…

计算机与社会 · 计算机科学 2025-05-06 Marc Ballestero-Ribó , Daniel Ortiz-Martínez

Large Language Models (LLMs) have emerged as a promising cornerstone for the development of natural language processing (NLP) and artificial intelligence (AI). However, ensuring the robustness of LLMs remains a critical challenge. To…

计算与语言 · 计算机科学 2025-11-07 Pankaj Kumar , Subhankar Mishra

Large language models (LLMs) can be used as accessible and intelligent chatbots by constructing natural language queries and directly inputting the prompt into the large language model. However, different prompt' constructions often lead to…

计算与语言 · 计算机科学 2023-12-14 Jinta Weng , Jiarui Zhang , Yue Hu , Daidong Fa , Xiaofeng Xuand , Heyan Huang

Recent advances in reasoning with large language models (LLMs) have demonstrated strong performance on complex mathematical tasks, including combinatorial optimization. Techniques such as Chain-of-Thought and In-Context Learning have…

人工智能 · 计算机科学 2025-09-17 Marylou Fauchard , Florian Carichon , Margarida Carvalho , Golnoosh Farnadi

Generative AI models are increasingly being integrated into human task workflows, enabling the production of expressive content across a wide range of contexts. Unlike traditional human-AI design methods, the new approach to designing…

人机交互 · 计算机科学 2025-04-01 Hari Subramonyam , Divy Thakkar , Andrew Ku , Jürgen Dieber , Anoop Sinha

Psychological consultation is essential for improving mental health and well-being, yet challenges such as the shortage of qualified professionals and scalability issues limit its accessibility. To address these challenges, we explore the…

计算与语言 · 计算机科学 2024-08-30 Rafael Souza , Jia-Hao Lim , Alexander Davis

Generative, explainable, and flexible recommender systems, derived using Large Language Models (LLM) are promising and poorly adapted to the cold-start user situation, where there is little to no history of interaction. The current…

机器学习 · 计算机科学 2025-07-23 Yushang Zhao , Huijie Shen , Dannier Li , Lu Chang , Chengrui Zhou , Yinuo Yang

Large language models (LLMs) have played a pivotal role in building communicative AI, yet they encounter the challenge of efficient updates. Model editing enables the manipulation of specific knowledge memories and the behavior of language…

计算与语言 · 计算机科学 2024-10-28 Xinbei Ma , Tianjie Ju , Jiyang Qiu , Zhuosheng Zhang , Hai Zhao , Lifeng Liu , Yulong Wang

Large language models (LLMs) are designed to align with human values in their responses. This study exploits LLMs with an iterative prompting technique where each prompt is systematically modified and refined across multiple iterations to…

计算与语言 · 计算机科学 2025-03-27 Shih-Wen Ke , Guan-Yu Lai , Guo-Lin Fang , Hsi-Yuan Kao

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

计算与语言 · 计算机科学 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

Large language models (LLMs) have achieved remarkable breakthroughs in new dialogue capabilities by leveraging instruction tuning, which refreshes human impressions of dialogue systems. The long-standing goal of dialogue systems is to be…

计算与语言 · 计算机科学 2024-04-01 Jiao Ou , Junda Lu , Che Liu , Yihong Tang , Fuzheng Zhang , Di Zhang , Kun Gai

Large language models (LLMs) have achieved remarkable success in a wide range of natural language processing tasks and can be adapted through prompting. However, they remain suboptimal in multi-turn interactions, often relying on incorrect…

Current large language model (LLM) applications often employ multi-component prompts, comprising both system and user prompts, to guide model behaviors. While recent advancements have demonstrated the efficacy of automatically optimizing…

计算与语言 · 计算机科学 2025-07-22 Xinyu Zhang , Yuanquan Hu , Fangchao Liu , Zhicheng Dou

Human beings often experience stress, which can significantly influence their performance. This study explores whether Large Language Models (LLMs) exhibit stress responses similar to those of humans and whether their performance fluctuates…

人机交互 · 计算机科学 2025-01-29 Guobin Shen , Dongcheng Zhao , Aorigele Bao , Xiang He , Yiting Dong , Yi Zeng

Large Language Models (LLMs), like ChatGPT, have demonstrated vast potential but also introduce challenges related to content constraints and potential misuse. Our study investigates three key research questions: (1) the number of different…

软件工程 · 计算机科学 2024-03-12 Yi Liu , Gelei Deng , Zhengzi Xu , Yuekang Li , Yaowen Zheng , Ying Zhang , Lida Zhao , Tianwei Zhang , Kailong Wang , Yang Liu

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

计算与语言 · 计算机科学 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li

Large language models are highly sensitive to prompts, but this sensitivity is usually studied through task-relevant instructions, demonstrations, or reasoning cues. In this paper, we study a different form of prompt sensitivity: whether…

计算与语言 · 计算机科学 2026-05-29 Pawel Batorski , Abtin Pourhadi , Jerzy Sarosiek , Przemyslaw Spurek , Paul Swoboda

Prompt optimization improves the reasoning abilities of large language models (LLMs) without requiring parameter updates to the target model. Following heuristic-based "Think step by step" approaches, the field has evolved in two main…

计算与语言 · 计算机科学 2025-07-25 Andreea Nica , Ivan Zakazov , Nicolas Mario Baldwin , Saibo Geng , Robert West