English
Related papers

Related papers: The Value of Context: Human versus Black Box Evalu…

200 papers

Recent years have seen a surge of interest in the field of explainable AI (XAI), with a plethora of algorithms proposed in the literature. However, a lack of consensus on how to evaluate XAI hinders the advancement of the field. We…

Artificial Intelligence · Computer Science 2022-09-22 Q. Vera Liao , Yunfeng Zhang , Ronny Luss , Finale Doshi-Velez , Amit Dhurandhar

Choosing the optimizer is considered to be among the most crucial design decisions in deep learning, and it is not an easy one. The growing literature now lists hundreds of optimization methods. In the absence of clear theoretical guidance…

Machine Learning · Computer Science 2021-08-12 Robin M. Schmidt , Frank Schneider , Philipp Hennig

Off-policy evaluation can leverage logged data to estimate the effectiveness of new policies in e-commerce, search engines, media streaming services, or automatic diagnostic tools in healthcare. However, the performance of baseline…

Machine Learning · Computer Science 2025-03-03 Daniel Guzman-Olivares , Philipp Schmidt , Jacek Golebiowski , Artur Bekasov

Automated prediction of valence, one key feature of a person's emotional state, from individuals' personal narratives may provide crucial information for mental healthcare (e.g. early diagnosis of mental diseases, supervision of disease…

Computation and Language · Computer Science 2019-12-03 Aniruddha Tammewar , Alessandra Cervone , Eva-Maria Messner , Giuseppe Riccardi

People have the ability to make sensible assumptions about other people's emotional states by being sympathetic, and because of our common sense of knowledge and the ability to think visually. Over the years, much research has been done on…

Human-Computer Interaction · Computer Science 2021-06-30 Stuti Sehgal , Harsh Sharma , Akshat Anand

Modern machine learning models typically represent inputs as fixed points in a high-dimensional embedding space. While this approach has been proven powerful for a wide range of downstream tasks, it fundamentally differs from the way humans…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Frieda Born , Tom Neuhäuser , Lukas Muttenthaler , Brett D. Roads , Bernhard Spitzer , Andrew K. Lampinen , Matt Jones , Klaus-Robert Müller , Michael C. Mozer

AIVisor, an agentic retrieval-augmented LLM for student advising, was used to examine how personalization affects system performance across multiple evaluation dimensions. Using twelve authentic advising questions intentionally designed to…

Information Retrieval · Computer Science 2026-05-19 Satyajit Movidi , Stephen Russell

The advent of AI driven large language models (LLMs) have stirred discussions about their role in qualitative research. Some view these as tools to enrich human understanding, while others perceive them as threats to the core values of the…

Software Engineering · Computer Science 2023-06-26 Muneera Bano , Didar Zowghi , Jon Whittle

We study how people trade off accuracy when using AI-powered tools in professional versus personal contexts for adoption purposes, the determinants of those trade-offs, and how users cope when AI/apps are unavailable. Because modern AI…

Artificial Intelligence · Computer Science 2026-02-17 Gaston Besanson , Federico Todeschini

As we increasingly delegate decision-making to algorithms, whether directly or indirectly, important questions emerge in circumstances where those decisions have direct consequences for individual rights and personal opportunities, as well…

Computers and Society · Computer Science 2019-05-01 Teresa Scantamburlo , Andrew Charlesworth , Nello Cristianini

The human mind is known to be sensitive to complexity. For instance, the visual system reconstructs hidden parts of objects following a principle of maximum simplicity. We suggest here that higher cognitive processes, such as the selection…

Artificial Intelligence · Computer Science 2012-08-10 Jean-Louis Dessalles

Consider a binary decision making process where a single machine learning classifier replaces a multitude of humans. We raise questions about the resulting loss of diversity in the decision making process. We study the potential benefits of…

Machine Learning · Statistics 2017-07-03 Nina Grgić-Hlača , Muhammad Bilal Zafar , Krishna P. Gummadi , Adrian Weller

When a policy prioritizes one person over another, is it because they benefit more, or because they are preferred? This paper develops a method to uncover the values consistent with observed allocation decisions. We use machine learning…

General Economics · Economics 2022-06-03 Daniel Björkegren , Joshua E. Blumenstock , Samsun Knight

The lack of contextual information in text data can make the annotation process of text-based emotion classification datasets challenging. As a result, such datasets often contain labels that fail to consider all the relevant emotions in…

Computation and Language · Computer Science 2023-11-08 Daniel Yang , Aditya Kommineni , Mohammad Alshehri , Nilamadhab Mohanty , Vedant Modi , Jonathan Gratch , Shrikanth Narayanan

Language model users often issue queries that lack specification, where the context under which a query was issued -- such as the user's identity, the query's intent, and the criteria for a response to be useful -- is not explicit. For…

Computation and Language · Computer Science 2025-05-27 Chaitanya Malaviya , Joseph Chee Chang , Dan Roth , Mohit Iyyer , Mark Yatskar , Kyle Lo

Reliable human-machine discrimination is becoming increasingly important as large language models and autonomous agents are deployed in online settings. Existing approaches evaluate whether a system can produce behavior or responses…

Artificial Intelligence · Computer Science 2026-05-12 Milena Rmus , Mathew D. Hardy , Thomas L. Griffiths , Mayank Agrawal

Data integration has been recently challenged by the need to handle large volumes of data, arriving at high velocity from a variety of sources, which demonstrate varying levels of veracity. This challenging setting, often referred to as big…

Databases · Computer Science 2022-05-02 Avigdor Gal , Roee Shraga

The human brain has inspired novel concepts complementary to classical and quantum computing architectures, such as artificial neural networks and neuromorphic computers, but it is not clear how their performances compare. Here we report a…

Neurons and Cognition · Quantitative Biology 2023-05-25 Céline van Valkenhoef , Catherine Schuman , Philip Walther

Humans organize knowledge into compact conceptual categories that balance compression with semantic richness. Large Language Models (LLMs) exhibit impressive linguistic abilities, but whether they navigate this same compression-meaning…

Computation and Language · Computer Science 2025-12-03 Chen Shani , Liron Soffer , Dan Jurafsky , Yann LeCun , Ravid Shwartz-Ziv

The rapid advancements in large language models (LLMs) have significantly improved their ability to generate natural language, making texts generated by LLMs increasingly indistinguishable from human-written texts. Recent research has…

Computation and Language · Computer Science 2024-12-05 Sergio E. Zanotto , Segun Aroyehun