English
Related papers

Related papers: Measuring and Improving Model-Moderator Collaborat…

200 papers

The inaccuracy of neural network models on inputs that do not stem from the training data distribution is both problematic and at times unrecognized. Model uncertainty estimation can address this issue, where uncertainty estimates are often…

Machine Learning · Computer Science 2020-02-14 Siddhartha Jain , Ge Liu , Jonas Mueller , David Gifford

Modelling uncertainty in Machine Learning models is essential for achieving safe and reliable predictions. Most research on uncertainty focuses on output uncertainty (predictions), but minimal attention is paid to uncertainty at inputs. We…

Machine Learning · Computer Science 2024-06-28 Matias Valdenegro-Toro , Ivo Pascal de Jong , Marco Zullich

Development of robust dynamical systems and networks such as autonomous aircraft systems capable of accomplishing complex missions faces challenges due to the dynamically evolving uncertainties coming from model uncertainties, necessity to…

In multi-modal multi-agent trajectory forecasting, two major challenges have not been fully tackled: 1) how to measure the uncertainty brought by the interaction module that causes correlations among the predicted trajectories of multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Bohan Tang , Yiqi Zhong , Chenxin Xu , Wei-Tao Wu , Ulrich Neumann , Yanfeng Wang , Ya Zhang , Siheng Chen

Purpose of Review: To effectively synthesise and analyse multi-robot behaviour, we require formal task-level models which accurately capture multi-robot execution. In this paper, we review modelling formalisms for multi-robot systems under…

Robotics · Computer Science 2023-08-16 Charlie Street , Masoumeh Mansouri , Bruno Lacerda

Effective human-robot collaboration in open-world environments requires joint planning under uncertain conditions. However, existing approaches often treat humans as passive supervisors, preventing autonomous agents from becoming human-like…

Robotics · Computer Science 2026-03-10 Zeyu Fang , Yuxin Lin , Cheng Liu , Beomyeol Yu , Zeyuan Yang , Rongqian Chen , Taeyoung Lee , Mahdi Imani , Tian Lan

Shared-autonomy imitation learning lets a human correct a robot in real time, mitigating covariate-shift errors. Yet existing approaches ignore two critical factors: (i) the operator's cognitive load and (ii) the risk created by delayed or…

Robotics · Computer Science 2025-06-18 Taewoo Kim , Donghyung Kim , Minsu Jang , Jaehong Kim

AI and ML models have already found many applications in critical domains, such as healthcare and criminal justice. However, fully automating such high-stakes applications can raise ethical or fairness concerns. Instead, in such cases,…

Artificial Intelligence · Computer Science 2023-04-28 Ioannis Papantonis , Vaishak Belle

Effective human-machine collaboration requires machine learning models to externalize uncertainty, so users can reflect and intervene when necessary. For language models, these representations of uncertainty may be impacted by sycophancy…

Computation and Language · Computer Science 2024-10-22 Anthony Sicilia , Mert Inan , Malihe Alikhani

Technological and computational advances continuously drive forward the broad field of deep learning. In recent years, the derivation of quantities describing theuncertainty in the prediction - which naturally accompanies the modeling…

Machine Learning · Computer Science 2022-05-31 Christoph Koller , Göran Kauermann , Xiao Xiang Zhu

In video recommendation, a critical component that determines the system's recommendation accuracy is the watch-time prediction module, since how long a user watches a video directly reflects personalized preferences. One of the key…

Information Retrieval · Computer Science 2025-04-11 Shanshan Wu , Shuchang Liu , Shuai Zhang , Xiaoyu Yang , Xiang Li , Lantao Hu , Han Li

We study the impact of content moderation policies in online communities. In our theoretical model, a platform chooses a content moderation policy and individuals choose whether or not to participate in the community according to the…

Data Structures and Algorithms · Computer Science 2023-10-17 Cynthia Dwork , Chris Hays , Jon Kleinberg , Manish Raghavan

Despite impressive performance in many benchmark datasets, AI models can still make mistakes, especially among out-of-distribution examples. It remains an open question how such imperfect models can be used effectively in collaboration with…

Artificial Intelligence · Computer Science 2022-04-26 Vivian Lai , Samuel Carton , Rajat Bhatnagar , Q. Vera Liao , Yunfeng Zhang , Chenhao Tan

Video activity anticipation aims to predict what will happen in the future, embracing a broad application prospect ranging from robot vision and autonomous driving. Despite the recent progress, the data uncertainty issue, reflected as the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Zhaobo Qi , Shuhui Wang , Weigang Zhang , Qingming Huang

In many real world contexts, successful human-AI collaboration requires humans to productively integrate complementary sources of information into AI-informed decisions. However, in practice human decision-makers often lack understanding of…

Human-Computer Interaction · Computer Science 2023-01-30 Kenneth Holstein , Maria De-Arteaga , Lakshmi Tumati , Yanghuidi Cheng

Existing procedures for model validation have been deemed inadequate for many engineering systems. The reason of this inadequacy is due to the high degree of complexity of the mechanisms that govern these systems. It is proposed in this…

Artificial Intelligence · Computer Science 2007-05-23 A. Guergachi

The inability to correctly resolve rumours circulating online can have harmful real-world consequences. We present a method for incorporating model and data uncertainty estimates into natural language processing models for automatic rumour…

Computation and Language · Computer Science 2020-05-15 Elena Kochkina , Maria Liakata

Robots operating alongside humans often encounter unfamiliar environments that make autonomous task completion challenging. Though improving models and increasing dataset size can enhance a robot's performance in unseen environments, data…

Robotics · Computer Science 2024-06-10 Ifueko Igbinedion , Sertac Karaman

Latest research revealed a considerable lack of reliability within user feedback and discussed striking impacts for the assessment of adaptive web systems and content personalisation approaches, e.g. ranking errors, systematic biases to…

Human-Computer Interaction · Computer Science 2018-02-19 Kevin Jasberg , Sergej Sizov

Trust between team members is an essential requirement for any successful cooperation. Thus, engendering and maintaining the fellow team members' trust becomes a central responsibility for any member trying to not only successfully…

Artificial Intelligence · Computer Science 2023-03-07 Zahra Zahedi , Mudit Verma , Sarath Sreedharan , Subbarao Kambhampati