English

The Science of Rejection: A Research Area for Human Computation

Machine Learning 2021-11-15 v1
Authors: Burcu Sayin , Jie Yang , Andrea Passerini , Fabio Casati
View on arXiv ↗ PDF ↗

Abstract

We motivate why the science of learning to reject model predictions is central to ML, and why human computation has a lead role in this effort.

Keywords

learning to reject model predictions machine learning human computation rejection

Cite

@article{arxiv.2111.06736,
  title  = {The Science of Rejection: A Research Area for Human Computation},
  author = {Burcu Sayin and Jie Yang and Andrea Passerini and Fabio Casati},
  journal= {arXiv preprint arXiv:2111.06736},
  year   = {2021}
}

Comments

To appear in the Proceedings of The 9th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2021)

Related papers

View all related →
Machine Learning · Computer Science
Machine Learning with a Reject Option: A survey
Kilian Hendrickx, Lorenzo Perini, Dries Van der Plas, Wannes Meert +1
2024-02-22
Artificial Intelligence · Computer Science
Model Agnostic Local Explanations of Reject
André Artelt, Roel Visser, Barbara Hammer
2022-05-17
Machine Learning · Computer Science
A Case for Rejection in Low Resource ML Deployment
Jerome White, Pulkit Madaan, Nikhil Shenoy, Apoorv Agnihotri +2
2022-12-12
Machine Learning · Computer Science
Explaining Reject Options of Learning Vector Quantization Classifiers
André Artelt, Johannes Brinkrolf, Roel Visser, Barbara Hammer
2022-02-16
Machine Learning · Computer Science
Machine Learning Towards Intelligent Systems: Applications, Challenges, and Opportunities
MohammadNoor Injadat, Abdallah Moubayed, Ali Bou Nassif, Abdallah Shami
2021-01-12
Machine Learning · Computer Science
Survey on Leveraging Uncertainty Estimation Towards Trustworthy Deep Neural Networks: The Case of Reject Option and Post-training Processing
Mehedi Hasan, Moloud Abdar, Abbas Khosravi, Uwe Aickelin +4
2023-04-12
Machine Learning · Computer Science
Knowing What You Cannot Explain: Learning to Reject Low-Quality Explanations
Luca Stradiotti, Dario Pesenti, Stefano Teso, Jesse Davis
2026-03-19
Computers and Society · Computer Science
Maintaining The Humanity of Our Models
Umang Bhatt
2017-12-12
Artificial Intelligence · Computer Science
Cognitive science as a source of forward and inverse models of human decisions for robotics and control
Mark K. Ho, Thomas L. Griffiths
2021-09-02
Machine Learning · Computer Science
Selective Prediction via Training Dynamics
Stephan Rabanser, Anvith Thudi, Kimia Hamidieh, Adam Dziedzic +4
2025-07-08
Machine Learning · Computer Science
The Rhetoric of Machine Learning
Robert C. Williamson
2026-04-09
Machine Learning · Computer Science
When No-Rejection Learning is Consistent for Regression with Rejection
Xiaocheng Li, Shang Liu, Chunlin Sun, Hanzhao Wang
2024-04-23
Machine Learning · Statistics
Classification with Reject Option: Distribution-free Error Guarantees via Conformal Prediction
Johan Hallberg Szabadváry, Tuwe Löfström, Ulf Johansson, Cecilia Sönströd +2
2025-06-30
Machine Learning · Computer Science
"Even if ..." -- Diverse Semifactual Explanations of Reject
André Artelt, Barbara Hammer
2022-07-06
Machine Learning · Computer Science
Learning by Design: Structuring and Documenting the Human Choices in Machine Learning Development
Simon Enni, Ira Assent
2021-05-04
Statistics Theory · Mathematics
Active learning algorithm through the lens of rejection arguments
Christophe Denis, Mohamed Hebiri, Boris Ndjia Njike, Xavier Siebert
2022-09-01
Machine Learning · Computer Science
Generalized Learning with Rejection for Classification and Regression Problems
Amina Asif, Fayyaz ul Amir Afsar Minhas
2019-11-05
Artificial Intelligence · Computer Science
On Trustworthy Rule-Based Models and Explanations
Mohamed Siala, Jordi Planes, Joao Marques-Silva
2025-07-11
Artificial Intelligence · Computer Science
Dissonance Between Human and Machine Understanding
Zijian Zhang, Jaspreet Singh, Ujwal Gadiraju, Avishek Anand
2021-01-20
Machine Learning · Computer Science
Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Sahil Verma, Varich Boonsanong, Minh Hoang, Keegan E. Hines +2
2022-11-17
Machine Learning · Computer Science
Accounting for Human Learning when Inferring Human Preferences
Harry Giles, Lawrence Chan
2020-12-02
Mathematical Software · Computer Science
Big Math and the One-Brain Barrier A Position Paper and Architecture Proposal
Jacques Carette, William M. Farmer, Michael Kohlhase, Florian Rabe
2019-10-23
Machine Learning · Computer Science
Filtering instances and rejecting predictions to obtain reliable models in healthcare
Maria Gabriela Valeriano, David Kohan Marzagão, Alfredo Montelongo, Carlos Roberto Veiga Kiffer +2
2025-10-29
Data Structures and Algorithms · Computer Science
Optimally revealing bits for rejection sampling
Louis-Roy Langevin, Alex Waese-Perlman
2025-09-30
Machine Learning · Computer Science
Machine Learning Challenges and Opportunities in the African Agricultural Sector -- A General Perspective
Racine Ly
2021-07-13