中文
相关论文

相关论文: Detecting Proxy Gaming in RL and LLM Alignment via…

200 篇论文

Reinforcement learning (RL) is a machine learning approach that trains agents to maximize cumulative rewards through interactions with environments. The integration of RL with deep learning has recently resulted in impressive achievements…

神经与进化计算 · 计算机科学 2023-08-31 Hui Bai , Ran Cheng , Yaochu Jin

Human beings often experience stress, which can significantly influence their performance. This study explores whether Large Language Models (LLMs) exhibit stress responses similar to those of humans and whether their performance fluctuates…

人机交互 · 计算机科学 2025-01-29 Guobin Shen , Dongcheng Zhao , Aorigele Bao , Xiang He , Yiting Dong , Yi Zeng

Although Large Audio-Language Models (LALMs) have exhibited outstanding performance in auditory understanding, their performance in affective computing scenarios, particularly in emotion recognition, reasoning, and subtle sentiment…

声音 · 计算机科学 2025-09-23 Pengcheng Li , Botao Zhao , Zuheng Kang , Junqing Peng , Xiaoyang Qu , Yayun He , Jianzong Wang

In many scientific domains, including experimentation, researchers rely on measurements of proxy outcomes to achieve faster and more frequent reads, especially when the primary outcome of interest is challenging to measure directly. While…

统计方法学 · 统计学 2026-05-08 Steven Wilkins-Reeves , Alexandra N. M. Darmon , Deeksha Sinha

Safety-aligned LLMs go through refusal training to reject harmful requests, but whether these mechanisms remain effective under emotionally charged stimuli is unexplored. We introduce FreakOut-LLM, a framework investigating whether…

密码学与安全 · 计算机科学 2026-04-08 Daniel Kuznetsov , Ofir Cohen , Karin Shistik , Rami Puzis , Asaf Shabtai

Prompt-based attack techniques are one of the primary challenges in securely deploying and protecting LLM-based AI systems. LLM inputs are an unbounded, unstructured space. Consequently, effectively defending against these attacks requires…

密码学与安全 · 计算机科学 2026-01-28 Henry Chen , Victor Aranda , Samarth Keshari , Ryan Heartfield , Nicole Nichols

Strategic decision-making involves interactive reasoning where agents adapt their choices in response to others, yet existing evaluations of large language models (LLMs) often emphasize Nash Equilibrium (NE) approximation, overlooking the…

人工智能 · 计算机科学 2025-11-04 Jingru Jia , Zehua Yuan , Junhao Pan , Paul E. McNamara , Deming Chen

Large Language Models (LLMs) have demonstrated an alarming ability to impersonate humans in conversation, raising concerns about their potential misuse in scams and deception. Humans have a right to know if they are conversing to an LLM. We…

计算与语言 · 计算机科学 2024-12-23 Gilad Gressel , Rahul Pankajakshan , Yisroel Mirsky

New Large Language Models (LLMs) become available every few weeks, and modern application developers confronted with the unenviable task of having to decide if they should switch to a new model. While human evaluation remains the gold…

人工智能 · 计算机科学 2025-12-25 Suryaansh Jain , Umair Z. Ahmed , Shubham Sahai , Ben Leong

Large language models (LLMs) are increasingly deployed as economic agents in marketplaces, auctions, and bidding settings. Anticipating their behavior in any specific deployment is hard. Existing strategic-reasoning benchmarks evaluate…

人工智能 · 计算机科学 2026-05-25 Vartan Shadarevian , Kia Ghods , Alex Kenich , Anany Kotawala

Reinforcement Learning (RL) is one of the most dynamic research areas in Game AI and AI as a whole, and a wide variety of games are used as its prominent test problems. However, it is subject to the replicability crisis that currently…

机器学习 · 计算机科学 2022-03-03 Matthias Müller-Brockhausen , Aske Plaat , Mike Preuss

High-Level Synthesis (HLS) compiles algorithmic C/C++ descriptions into hardware, with Quality of Results (QoR) -- latency and resource utilization -- critically governed by pragma configurations and code structure. Existing LLM-based HLS…

机器学习 · 计算机科学 2026-05-14 Qingyun Zou , Feng Yu , Hongshi Tan , Yao Chen , Bingsheng He , WengFai Wong

Large Reasoning Models (LRMs) represent a breakthrough in AI problem-solving capabilities, but their effectiveness in interactive environments can be limited. This paper introduces and analyzes overthinking in LRMs. A phenomenon where…

Event argument extraction identifies arguments for predefined event roles in text. Existing work evaluates this task with exact match (EM), where predicted arguments must align exactly with annotated spans. While suitable for span-based…

计算与语言 · 计算机科学 2025-09-11 Omar Sharif , Joseph Gatto , Madhusudan Basak , Sarah M. Preum

Reinforcement learning (RL) has become essential to the post-training of large language models (LLMs) for reasoning, agentic capabilities and alignment. Successful RL relies on sufficient exploration of diverse actions by the model during…

While Large Language Models (LLMs) excel in certain reasoning tasks, they struggle in multi-agent games where the final outcome depends on the joint strategies of all agents. In multi-agent games, the non-stationarity of other agents brings…

人工智能 · 计算机科学 2026-05-26 Yidong He , Yutao Lai , Pengxu Yang , Jiarui Gan , Jiexin Wang , Yi Cai , Mengchen Zhao

We introduce Emergent Trust Learning (ETL), a lightweight, trust-based control algorithm that can be plugged into existing AI agents. It enables these to reach cooperation in competitive game environments under shared resources. Each agent…

多智能体系统 · 计算机科学 2026-03-19 Qianpu Chen , Giulio Barbero , Mike Preuss , Derya Soydaner

Reinforcement learning from verifiable emotion rewards RLVER has produced language models with strong empathetic performance, evaluated on benchmarks that assume cooperative, honest users. Yet real emotional interactions systematically…

人工智能 · 计算机科学 2026-05-11 Deeraj S K , Sadhana Devarajan , Krishna Mehra , Sudhakar Mishra

Evaluating the robustness of LLMs to adversarial attacks is crucial for safe deployment, yet current red-teaming methods are often prohibitively expensive. We compare the ability of fast proxy metrics to predict the real-world robustness of…

密码学与安全 · 计算机科学 2025-02-18 Tim Beyer , Jan Schuchardt , Leo Schwinn , Stephan Günnemann

The rapid proliferation of large language models (LLMs) has created an urgent need for robust and generalizable detectors of machine-generated text. Existing benchmarks typically evaluate a single detector on a single dataset under ideal…

计算与语言 · 计算机科学 2026-03-19 Madhav S. Baidya , S. S. Baidya , Chirag Chawla