English
Related papers

Related papers: Making a Bird AI Expert Work for You and Me

200 papers

Despite the proliferation of explainable AI (XAI) methods, little is understood about end-users' explainability needs and behaviors around XAI explanations. To address this gap and contribute to understanding how explainability can support…

Human-Computer Interaction · Computer Science 2023-02-20 Sunnie S. Y. Kim , Elizabeth Anne Watkins , Olga Russakovsky , Ruth Fong , Andrés Monroy-Hernández

This study uses supervised machine learning (SML) and explainable artificial intelligence (AI) to model, predict and understand human decision-making during skillful joint-action. Long short-term memory networks were trained to predict the…

Machine Learning · Computer Science 2022-06-07 Fabrizia Auletta , Rachel W. Kallen , Mario di Bernardo , Micheal J. Richardson

The ability to estimate the perceptual error between images is an important problem in computer vision with many applications. Although it has been studied extensively, however, no method currently exists that can robustly predict visual…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Ekta Prashnani , Hong Cai , Yasamin Mostofi , Pradeep Sen

We present a simple approach to make pre-trained Vision Transformers (ViTs) interpretable for fine-grained analysis, aiming to identify and localize the traits that distinguish visually similar categories, such as bird species. Pre-trained…

Generative AI has the potential to enhance education by providing personalized feedback to students at scale. Recent work has proposed techniques to improve AI-generated programming hints and has evaluated their performance based on…

Computers and Society · Computer Science 2025-09-04 Tung Phung , Mengyan Wu , Heeryung Choi , Gustavo Soares , Sumit Gulwani , Adish Singla , Christopher Brooks

With Artificial Intelligence (AI) influencing the decision-making process of sensitive applications such as Face Verification, it is fundamental to ensure the transparency, fairness, and accountability of decisions. Although Explainable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Miriam Doh , Caroline Mazini Rodrigues , Nicolas Boutry , Laurent Najman , Matei Mancas , Hugues Bersini

People's decision-making abilities often fail to improve or may even erode when they rely on AI for decision-support, even when the AI provides informative explanations. We argue this is partly because people intuitively seek contrastive…

Human-Computer Interaction · Computer Science 2025-03-20 Zana Buçinca , Siddharth Swaroop , Amanda E. Paluch , Finale Doshi-Velez , Krzysztof Z. Gajos

Animal sounds can be recognised automatically by machine learning, and this has an important role to play in biodiversity monitoring. Yet despite increasingly impressive capabilities, bioacoustic species classifiers still exhibit imbalanced…

Generative AI, particularly Language Models (LMs), has the potential to transform real-world domains with societal impact, particularly where access to experts is limited. For example, in education, training novice educators with expert…

Computation and Language · Computer Science 2025-01-28 Rose E. Wang , Ana T. Ribeiro , Carly D. Robinson , Susanna Loeb , Dora Demszky

Generative models have shown a giant leap in synthesizing photo-realistic images with minimal expertise, sparking concerns about the authenticity of online information. This study aims to develop a universal AI-generated image detector…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zihan Liu , Hanyi Wang , Yaoyu Kang , Shilin Wang

Fine-grained visual categorization (FGVC) is challenging due in part to the fact that it is often difficult to acquire an enough number of training samples. To employ large models for FGVC without suffering from overfitting, existing…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Yabin Zhang , Hui Tang , Kui Jia

Different from the general visual classification, some classification tasks are more challenging as they need the professional categories of the images. In the paper, we call them expert-level classification. Previous fine-grained vision…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Junde Wu , Huihui Fang , Yehui Yang , Yu Zhang , Haoyi Xiong , Huazhu Fu , Yanwu Xu

Federated learning (FL) is a commonly distributed algorithm for mobile users (MUs) training artificial intelligence (AI) models, however, several challenges arise when applying FL to real-world scenarios, such as label scarcity, non-IID…

Machine Learning · Computer Science 2024-10-14 Yubo Peng , Feibo Jiang , Li Dong , Kezhi Wang , Kun Yang

As AI technology continues to advance, the importance of human-AI collaboration becomes increasingly evident, with numerous studies exploring its potential in various fields. One vital field is data science, including feature engineering…

Human-Computer Interaction · Computer Science 2024-05-24 Qian Zhu , Dakuo Wang , Shuai Ma , April Yi Wang , Zixin Chen , Udayan Khurana , Xiaojuan Ma

Interpretability of machine learning models has gained more and more attention among researchers in the artificial intelligence (AI) and human-computer interaction (HCI) communities. Most existing work focuses on decision making, whereas we…

Human-Computer Interaction · Computer Science 2020-04-16 Haizi Yu , Heinrich Taube , James A. Evans , Lav R. Varshney

ChatGPT has enabled access to AI-generated writing for the masses, and within just a few months, this product has disrupted the knowledge economy, initiating a culture shift in the way people work, learn, and write. The need to discriminate…

Machine Learning · Computer Science 2023-03-30 Heather Desaire , Aleesa E. Chua , Madeline Isom , Romana Jarosova , David Hua

Artificial intelligence (AI) systems accelerate medical workflows and improve diagnostic accuracy in healthcare, serving as second-opinion systems. However, the unpredictability of AI errors poses a significant challenge, particularly in…

We propose Preferential MoE, a novel human-ML mixture-of-experts model that augments human expertise in decision making with a data-based classifier only when necessary for predictive performance. Our model exhibits an interpretable gating…

Machine Learning · Computer Science 2021-01-15 Melanie F. Pradier , Javier Zazo , Sonali Parbhoo , Roy H. Perlis , Maurizio Zazzi , Finale Doshi-Velez

Visual explanation is an approach for visualizing the grounds of judgment by deep learning, and it is possible to visually interpret the grounds of a judgment for a certain input by visualizing an attention map. As for deep-learning models…

Artificial Intelligence · Computer Science 2023-06-06 Kohei Hattori , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi

The integration of human and artificial intelligence offers a powerful avenue for advancing our understanding of information processing, as each system provides unique computational insights. However, despite the promise of human-AI…

Neurons and Cognition · Quantitative Biology 2025-04-22 Stephen Chong Zhao , Yang Hu , Jason Lee , Andrew Bender , Trisha Mazumdar , Mark Wallace , David A. Tovar