English
Related papers

Related papers: When Does Critique Improve AI-Assisted Theoretical…

200 papers

Large Language Models (LLMs) are playing an increasingly important role in physics research by assisting with symbolic manipulation, numerical computation, and scientific reasoning. However, ensuring the reliability, transparency, and…

Artificial Intelligence · Computer Science 2025-08-19 Yinggan Xu , Hana Kimlee , Yijia Xiao , Di Luo

The exponential growth of machine learning submissions has strained the traditional peer review process, resulting in slow feedback loops for authors and an immense burden on reviewers to rigorously audit technical soundness and verify…

Multiagent Systems · Computer Science 2026-05-12 Palash Goyal , Mihir Parmar , Yiwen Song , Hamid Palangi , Tomas Pfister , Jinsung Yoon

Large Language Models (LLMs) have shown remarkable capabilities in general natural language processing tasks but often fall short in complex reasoning tasks. Recent studies have explored human-like problem-solving strategies, such as…

Computation and Language · Computer Science 2023-12-19 Zhenran Xu , Senbao Shi , Baotian Hu , Jindi Yu , Dongfang Li , Min Zhang , Yuxiang Wu

As large language models (LLMs) become increasingly capable of autonomous decision-making, they introduce new challenges and opportunities for human-AI cooperation in mixed-motive contexts. While prior research has primarily examined AI in…

Human-Computer Interaction · Computer Science 2025-05-29 Guanxuan Jiang , Shirao Yang , Yuyang Wang , Pan Hui

Ethics review is a foundational mechanism of modern research governance, yet contemporary systems face increasing strain as ethical risks arise as structural consequences of large-scale, interdisciplinary scientific practice. The demand for…

Artificial Intelligence · Computer Science 2026-02-17 Yifan Ding , Yuhui Shi , Zhiyan Li , Zilong Wang , Yifeng Gao , Yajun Yang , Mengjie Yang , Yixiu Liang , Xipeng Qiu , Xuanjing Huang , Xingjun Ma , Yu-Gang Jiang , Guoyu Wang

To overcome the limitations of automated metrics (e.g. BLEU, METEOR) for evaluating dialogue systems, researchers typically use human judgments to provide convergent evidence. While it has been demonstrated that human judgments can suffer…

Computation and Language · Computer Science 2019-09-24 Sashank Santhanam , Samira Shaikh

Understanding the world through models is a fundamental goal of scientific research. While large language model (LLM) based approaches show promise in automating scientific discovery, they often overlook the importance of criticizing…

Machine Learning · Computer Science 2024-11-12 Michael Y. Li , Vivek Vajipey , Noah D. Goodman , Emily B. Fox

Reinforcement learning, mathematically described by Markov Decision Problems, may be approached either through dynamic programming or policy search. Actor-critic algorithms combine the merits of both approaches by alternating between steps…

Machine Learning · Computer Science 2023-01-31 Harshat Kumar , Alec Koppel , Alejandro Ribeiro

Critique ability, a meta-cognitive capability of humans, presents significant challenges for LLMs to improve. Recent works primarily rely on supervised fine-tuning (SFT) using critiques generated by a single LLM like GPT-4. However, these…

Computation and Language · Computer Science 2024-10-22 Tian Lan , Wenwei Zhang , Chengqi Lyu , Shuaibin Li , Chen Xu , Heyan Huang , Dahua Lin , Xian-Ling Mao , Kai Chen

While AI agents show potential in scientific ideation, most existing frameworks rely on single-agent refinement, limiting creativity due to bounded knowledge and perspective. Inspired by real-world research dynamics, this paper investigates…

Computation and Language · Computer Science 2025-08-07 Nuo Chen , Yicheng Tong , Jiaying Wu , Minh Duc Duong , Qian Wang , Qingyun Zou , Bryan Hooi , Bingsheng He

Generative artificial intelligence (AI) agents are increasingly embedded in collaborative learning environments, yet their impact on the processes of argumentative knowledge construction remains insufficiently understood. Emerging…

Human-Computer Interaction · Computer Science 2025-12-11 Lixiang Yan , Yueqiao Jin , Linxuan Zhao , Roberto Martinez-Maldonado , Xinyu Li , Xiu Guan , Wenxin Guo , Xibin Han , Dragan Gašević

Group decision-making processes frequently suffer when social influence and power dynamics suppress minority viewpoints, leading to compliance and groupthink. Conversational agents can counteract these harmful dynamics by encouraging…

Human-Computer Interaction · Computer Science 2025-03-19 Soohwan Lee , Seoyeong Hwang , Dajung Kim , Kyungho Lee

Quantum computing offers efficient encapsulation of high-dimensional states. In this work, we propose a novel quantum reinforcement learning approach that combines the Advantage Actor-Critic algorithm with variational quantum circuits by…

Reinforcement learning with AI feedback (RLAIF) is a popular paradigm for improving the instruction-following abilities of powerful pre-trained language models. RLAIF first performs supervised fine-tuning (SFT) using demonstrations from a…

Machine Learning · Computer Science 2024-02-20 Archit Sharma , Sedrick Keh , Eric Mitchell , Chelsea Finn , Kushal Arora , Thomas Kollar

Feedback is a critical component of the learning process, particularly in computer science education. This study investigates the quality of feedback generated by Large Language Models (LLMs), Small Language Models (SLMs), compared with…

Human-Computer Interaction · Computer Science 2026-01-21 Suqing Liu , Bogdan Simion , Christopher Eaton , Michael Liut

The two-time scale nature of SAC, which is an actor-critic algorithm, is characterised by the fact that the critic estimate has not converged for the actor at any given time, but since the critic learns faster than the actor, it ensures…

This paper contributes a first study into how different human users deliver simultaneous control and feedback signals during human-robot interaction. As part of this work, we formalize and present a general interactive learning framework…

Artificial Intelligence · Computer Science 2017-03-16 Kory W. Mathewson , Patrick M. Pilarski

Large language models (LLMs), while promising, face criticisms for biases, hallucinations, and a lack of reasoning capability. This paper introduces SocraSynth, a multi-LLM agent reasoning platform developed to mitigate these issues.…

Artificial Intelligence · Computer Science 2024-02-13 Edward Y. Chang

Large language models (LLMs) have shown impressive capabilities on numerous natural language processing tasks. However, LLMs still struggle with numerical question answering for financial documents that include tabular and textual data.…

Computation and Language · Computer Science 2026-01-08 Nelvin Tan , Zian Seng , Liang Zhang , Yu-Ching Shih , Dong Yang , Amol Salunkhe

We fine-tune large language models to write natural language critiques (natural language critical comments) using behavioral cloning. On a topic-based summarization task, critiques written by our models help humans find flaws in summaries…

Computation and Language · Computer Science 2022-06-15 William Saunders , Catherine Yeh , Jeff Wu , Steven Bills , Long Ouyang , Jonathan Ward , Jan Leike