中文
相关论文

相关论文: Learning to Trust Experience: A Monitor-Trust-Regu…

200 篇论文

It is a well-known challenge to learn an unbiased ranker with biased feedback. Unbiased learning-to-rank(LTR) algorithms, which are verified to model the relative relevance accurately based on noisy feedback, are appealing candidates and…

信息检索 · 计算机科学 2023-03-09 Yi Ren , Hongyan Tang , Siwen Zhu

This paper studies the learning-to-control problem under process and sensing uncertainties for dynamical systems. In our previous work, we developed a data-based generalization of the iterative linear quadratic regulator (iLQR) to design…

机器人学 · 计算机科学 2023-11-09 Ran Wang , Raman Goyal , Suman Chakravorty

As artificial intelligence systems increasingly operate in Real-world environments, the integration of multi-modal data sources such as vision, language, and audio presents both unprecedented opportunities and critical challenges for…

机器学习 · 计算机科学 2025-07-01 Sree Bhargavi Balija

A trustworthy reinforcement learning algorithm should be competent in solving challenging real-world problems, including {robustly} handling uncertainties, satisfying {safety} constraints to avoid catastrophic failures, and {generalizing}…

机器学习 · 计算机科学 2022-09-19 Mengdi Xu , Zuxin Liu , Peide Huang , Wenhao Ding , Zhepeng Cen , Bo Li , Ding Zhao

Ensuring the safety of Large Language Models (LLMs) is critical for real-world deployment. However, current safety measures often fail to address implicit, domain-specific risks. To investigate this gap, we introduce a dataset of 3,000…

人工智能 · 计算机科学 2026-01-09 Liang Shan , Kaicheng Shen , Wen Wu , Zhenyu Ying , Chaochao Lu , Yan Teng , Jingqi Huang , Guangze Ye , Guoqing Wang , Liang He

Large language models (LLMs) are trained on massive datasets that may include private or copyrighted content. Due to growing privacy and ownership concerns, data owners may request the removal of their data from trained models. Machine…

机器学习 · 计算机科学 2026-01-13 Zhihao Liu , Jian Lou , Yuke Hu , Xiaochen Li , Yitian Chen , Tailun Chen , Zhizhen Qin , Kui Ren , Zhan Qin

Large reasoning models (LRMs) have emerged as a powerful paradigm for solving complex real-world tasks. In practice, these models are predominantly trained via Reinforcement Learning with Verifiable Rewards (RLVR), yet most existing…

人工智能 · 计算机科学 2026-02-27 Qiannian Zhao , Chen Yang , Jinhao Jing , Yunke Zhang , Xuhui Ren , Lu Yu , Shijie Zhang , Hongzhi Yin

We find that models report highest confidence precisely when they are fabricating. Across four model families (OLMo-3, Llama-3.1, Qwen3, Mistral), self-reported confidence inversely correlates with accuracy, with AUC ranging from 0.28 to…

分布式、并行与集群计算 · 计算机科学 2026-05-08 Tony Mason , Vaastav Anand

Intelligent learning diagnosis is a critical engine of intelligent tutoring systems, which aims to estimate learners' current knowledge mastery status and predict their future learning performance. The significant challenge with traditional…

人工智能 · 计算机科学 2023-06-14 Zhifeng Wang , Wenxing Yan , Chunyan Zeng , Shi Dong

Due to changes in model dynamics or unexpected disturbances, an autonomous robotic system may experience unforeseen challenges during real-world operations which may affect its safety and intended behavior: in particular actuator and system…

机器人学 · 计算机科学 2023-05-31 Esen Yel , Nicola Bezzo

Preference-based reinforcement learning (PBRL) offers a promising alternative to explicit reward engineering by learning from pairwise trajectory comparisons. However, real-world preference data often comes from heterogeneous annotators…

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an important paradigm for unlocking reasoning capabilities in large language models, exemplified by the success of OpenAI o1 and DeepSeek-R1. Currently, Group Relative…

机器学习 · 计算机科学 2026-01-08 Shijie Zhang , Kevin Zhang , Zheyuan Gu , Xiang Guo , Rujun Guo , Shaoyu Liu , Guanjun Jiang , Xiaozhao Wang

Monte Carlo simulations are the primary methodology for evaluating Item Response Theory (IRT) methods, yet marginal reliability - the fundamental metric of data informativeness - is rarely treated as an explicit design factor. Unlike in…

统计方法学 · 统计学 2026-01-14 JoonHo Lee

Verifying whether the machine unlearning process has been properly executed is critical but remains underexplored. Some existing approaches propose unlearning verification methods based on backdooring techniques. However, these methods…

机器学习 · 计算机科学 2026-02-04 Weiqi Wang , Zhiyi Tian , Chenhan Zhang , Luoyu Chen , Shui Yu

Monitoring is a runtime verification technique that allows one to check whether an ongoing computation of a system (partial trace) satisfies a given formula. It does not need a complete model of the system, but it typically requires the…

人工智能 · 计算机科学 2025-08-26 Andrea Brunello , Luca Geatti , Angelo Montanari , Nicola Saccomanno

Recent development in data-driven decision science has seen great advances in individualized decision making. Given data with individual covariates, treatment assignments and outcomes, researchers can search for the optimal individualized…

统计方法学 · 统计学 2021-12-16 Weibin Mo , Yufeng Liu

The core challenge in learning has shifted from knowledge acquisition to effective Self-Regulated Learning (SRL): planning, monitoring, and reflecting on one's learning. Existing digital tools, however, inadequately support metacognitive…

人机交互 · 计算机科学 2025-06-26 Xuefei Hou , Xizhao Tan

Uncertainty estimation in machine learning has traditionally focused on the prediction stage, aiming to quantify confidence in model outputs while treating learned representations as deterministic and reliable by default. In this work, we…

机器学习 · 统计学 2026-02-20 Yiyao Yang

Thanks to the rapid growth in wearable technologies and recent advancement in machine learning and signal processing, monitoring complex human contexts becomes feasible, paving the way to develop human-in-the-loop IoT systems that naturally…

人机交互 · 计算机科学 2023-11-21 Mojtaba Taherisadr , Mohammad Abdullah Al Faruque , Salma Elmalaki

Large language models trained on web-scale corpora can memorize undesirable data containing misinformation, copyrighted material, or private or sensitive information. Recently, several machine unlearning algorithms have been proposed to…

计算与语言 · 计算机科学 2025-05-27 Keivan Rezaei , Khyathi Chandu , Soheil Feizi , Yejin Choi , Faeze Brahman , Abhilasha Ravichander