English
Related papers

Related papers: Solving NLP Problems through Human-System Collabor…

200 papers

Law codes and regulations help organise societies for centuries, and as AI systems gain more autonomy, we question how human-agent systems can operate as peers under the same norms, especially when resources are contended. We posit that…

Multiagent Systems · Computer Science 2022-02-24 Alex Raymond , Hatice Gunes , Amanda Prorok

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Machine Learning · Computer Science 2019-08-30 Isaac Lage , Emily Chen , Jeffrey He , Menaka Narayanan , Been Kim , Sam Gershman , Finale Doshi-Velez

We describe a class of tasks called decision-oriented dialogues, in which AI assistants such as large language models (LMs) must collaborate with one or more humans via natural language to help them make complex decisions. We formalize…

Computation and Language · Computer Science 2024-05-07 Jessy Lin , Nicholas Tomlin , Jacob Andreas , Jason Eisner

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly…

Computation and Language · Computer Science 2025-11-11 Ningyu Xu , Qi Zhang , Chao Du , Qiang Luo , Xipeng Qiu , Xuanjing Huang , Menghan Zhang

Machine common sense remains a broad, potentially unbounded problem in artificial intelligence (AI). There is a wide range of strategies that can be employed to make progress on this challenge. This article deals with the aspects of…

Artificial Intelligence · Computer Science 2020-06-16 Alexander Gavrilenko , Katerina Morozova

Many approaches to Natural Language Processing (NLP) tasks often treat them as single-step problems, where an agent receives an instruction, executes it, and is evaluated based on the final outcome. However, human language is inherently…

Computation and Language · Computer Science 2024-02-07 Nikhil Mehta , Milagro Teruel , Patricio Figueroa Sanz , Xin Deng , Ahmed Hassan Awadallah , Julia Kiseleva

Coherence is an essential property of well-written texts, that refers to the way textual units relate to one another. In the era of generative AI, coherence assessment is essential for many NLP tasks; summarization, generation, long-form…

Computation and Language · Computer Science 2024-08-14 Aviya Maimon , Reut Tsarfaty

Uncertainty estimation is a significant issue for current large language models (LLMs) that are generally poorly calibrated and over-confident, especially with reinforcement learning from human feedback (RLHF). Unlike humans, whose…

Computation and Language · Computer Science 2024-05-13 Ruixin Yang , Dheeraj Rajagopal , Shirley Anugrah Hayati , Bin Hu , Dongyeop Kang

A rapidly increasing amount of human conversation occurs online. But divisiveness and conflict can fester in text-based interactions on social media platforms, in messaging apps, and on other digital forums. Such toxicity increases…

Human-Computer Interaction · Computer Science 2023-10-24 Lisa P. Argyle , Ethan Busby , Joshua Gubler , Chris Bail , Thomas Howe , Christopher Rytting , David Wingate

While theories of discourse and cognitive science have long recognized the value of unhurried pacing, recent dialogue research tends to minimize friction in conversational systems. Yet, frictionless dialogue risks fostering uncritical…

Existing conversational systems are mostly agent-centric, which assumes the user utterances would closely follow the system ontology (for NLU or dialogue state tracking). However, in real-world scenarios, it is highly desirable that the…

Computation and Language · Computer Science 2021-09-10 Zhiyu Chen , Honglei Liu , Hu Xu , Seungwhan Moon , Hao Zhou , Bing Liu

We propose a large language model explainability technique for obtaining faithful natural language explanations by grounding the explanations in a reasoning process. When converted to a sequence of tokens, the outputs of the reasoning…

Machine Learning · Computer Science 2026-03-17 Vojtech Cahlik , Rodrigo Alves , Pavel Kordik

What makes large language models (LLMs) impressive is also what makes them hard to evaluate: their diversity of uses. To evaluate these models, we must understand the purposes they will be used for. We consider a setting where these…

Computation and Language · Computer Science 2024-06-04 Keyon Vafa , Ashesh Rambachan , Sendhil Mullainathan

In the recent advances of natural language processing, the scale of the state-of-the-art models and datasets is usually extensive, which challenges the application of sample-based explanation methods in many aspects, such as explanation…

Computation and Language · Computer Science 2021-06-10 Wei Zhang , Ziming Huang , Yada Zhu , Guangnan Ye , Xiaodong Cui , Fan Zhang

In order to build dialogue systems to tackle the ambitious task of holding social conversations, we argue that we need a data driven approach that includes insight into human conversational chit chat, and which incorporates different…

Computation and Language · Computer Science 2017-09-12 Kevin K. Bowden , Shereen Oraby , Amita Misra , Jiaqi Wu , Stephanie Lukin

Large Language Models (LLMs) have increasingly demonstrated the ability to facilitate the development of multi-agent systems that allow the interpretation of thoughts and actions generated by each individual. Promising advancements have…

Multiagent Systems · Computer Science 2024-09-24 Asher Sprigler , Alexander Drobek , Keagan Weinstock , Wendpanga Tapsoba , Gavin Childress , Andy Dao , Lucas Gral

A discourse strategy is a strategy for communicating with another agent. Designing effective dialogue systems requires designing agents that can choose among discourse strategies. We claim that the design of effective strategies must take…

cmp-lg · Computer Science 2016-08-31 Marilyn A. Walker

Table reasoning, which aims to generate the corresponding answer to the question following the user requirement according to the provided table, and optionally a text description of the table, effectively improving the efficiency of…

Computation and Language · Computer Science 2024-02-14 Xuanliang Zhang , Dingzirui Wang , Longxu Dou , Qingfu Zhu , Wanxiang Che

As research in human-centered NLP advances, there is a growing recognition of the importance of incorporating human and social factors into NLP models. At the same time, our NLP systems have become heavily reliant on LLMs, most of which do…

Computation and Language · Computer Science 2025-07-21 Nikita Soni , H. Andrew Schwartz , João Sedoc , Niranjan Balasubramanian

An overarching goal of natural language processing is to enable machines to communicate seamlessly with humans. However, natural language can be ambiguous or unclear. In cases of uncertainty, humans engage in an interactive process known as…

Computation and Language · Computer Science 2021-10-20 Julia White , Gabriel Poesia , Robert Hawkins , Dorsa Sadigh , Noah Goodman