中文
相关论文

相关论文: Uncertainty-aware Low-Rank Q-Matrix Estimation for…

200 篇论文

Reinforcement learning (RL) aims to estimate the action to take given a (time-varying) state, with the goal of maximizing a cumulative reward function. Predominantly, there are two families of algorithms to solve RL problems: value-based…

机器学习 · 计算机科学 2025-01-10 Sergio Rozada , Hoi-To Wai , Antonio G. Marques

Large language models (LLMs) can learn vast amounts of knowledge from diverse domains during pre-training. However, long-tail knowledge from specialized domains is often scarce and underrepresented, rarely appearing in the models'…

计算与语言 · 计算机科学 2025-02-11 Shuyang Yu , Runxue Bao , Parminder Bhatia , Taha Kass-Hout , Jiayu Zhou , Cao Xiao

Reinforcement learning methods typically use Deep Neural Networks to approximate the value functions and policies underlying a Markov Decision Process. Unfortunately, DNN-based RL suffers from a lack of explainability of the resulting…

系统与控制 · 电气工程与系统科学 2022-05-19 Shambhuraj Sawant , Sebastien Gros

Deep Q-Learning is an important reinforcement learning algorithm, which involves training a deep neural network, called Deep Q-Network (DQN), to approximate the well-known Q-function. Although wildly successful under laboratory conditions,…

机器学习 · 计算机科学 2021-04-13 Arunselvan Ramaswamy , Eyke Hüllermeier

Low-rank adaptation (LoRA) has become the dominant method for parameter-efficient LLM fine-tuning, with LoRA-based quantization error compensation (LQEC) emerging as a powerful tool for recovering accuracy in compressed LLMs. However, LQEC…

机器学习 · 计算机科学 2025-03-31 Geonho Lee , Janghwan Lee , Sukjin Hong , Minsoo Kim , Euijai Ahn , Du-Seong Chang , Jungwook Choi

Ensuring strict safety guarantees is the paramount challenge for emerging 5G/6G wireless systems, particularly as they increasingly govern mission-critical applications ranging from autonomous UAV swarms to industrial automation. While deep…

信号处理 · 电气工程与系统科学 2026-04-21 Haoran Peng , Tong Wu , Hang Liu , Weijia Zheng , Ying-Jun Angela Zhang , Anna Scaglione

Low-rank matrices play a fundamental role in modeling and computational methods for signal processing and machine learning. In many applications where low-rank matrices arise, these matrices cannot be fully sampled or directly observed, and…

信息论 · 计算机科学 2016-05-25 Mark A. Davenport , Justin Romberg

Multi-agent reinforcement learning (MARL) has become a significant research topic due to its ability to facilitate learning in complex environments. In multi-agent tasks, the state-action value, commonly referred to as the Q-value, can vary…

人工智能 · 计算机科学 2024-06-13 Zhenglong Luo , Zhiyong Chen , James Welsh

Deep reinforcement learning (DRL) has revolutionized quantitative trading (Q-trading) by achieving decent performance without significant human expert knowledge. Despite its achievements, we observe that the current state-of-the-art DRL…

计算工程、金融与科学 · 计算机科学 2025-02-07 Zhiming Li , Junzhe Jiang , Yushi Cao , Aixin Cui , Bozhi Wu , Bo Li , Yang Liu , Danny Dongning Sun

In the multivariate regression, also referred to as multi-task learning in machine learning, the goal is to recover a vector-valued function based on noisy observations. The vector-valued function is often assumed to be of low rank.…

统计理论 · 数学 2020-05-05 Wenjia Wang , Yi-Hui Zhou

This review addresses the problem of learning abstract representations of the measurement data in the context of Deep Reinforcement Learning (DRL). While the data are often ambiguous, high-dimensional, and complex to interpret, many…

机器学习 · 计算机科学 2024-05-31 Nicolò Botteghi , Mannes Poel , Christoph Brune

LLM have achieved success in many fields but still troubled by problematic content in the training corpora. LLM unlearning aims at reducing their influence and avoid undesirable behaviours. However, existing unlearning methods remain…

计算与语言 · 计算机科学 2024-08-21 Hongbang Yuan , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Uncertainty quantification (UQ) in deep learning regression is of wide interest, as it supports critical applications including sequential decision making and risk-sensitive tasks. In heteroskedastic regression, where the uncertainty of the…

Deep neuroevolution is a highly scalable alternative to reinforcement learning due to its unique ability to encode network updates in a small number of bytes. Recent insights from traditional deep learning indicate high-dimensional models…

神经与进化计算 · 计算机科学 2025-04-07 Jack Garbus , Jordan Pollack

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

机器学习 · 计算机科学 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Deep reinforcement learning (DRL) has achieved significant breakthroughs in various tasks. However, most DRL algorithms suffer a problem of generalizing the learned policy which makes the learning performance largely affected even by minor…

机器学习 · 计算机科学 2019-07-11 Zhengyao Jiang , Shan Luo

As representation learning becomes a powerful technique to reduce sample complexity in reinforcement learning (RL) in practice, theoretical understanding of its advantage is still limited. In this paper, we theoretically characterize the…

机器学习 · 计算机科学 2022-06-14 Yuan Cheng , Songtao Feng , Jing Yang , Hong Zhang , Yingbin Liang

This paper explores uncertainty quantification (UQ) as an indicator of the trustworthiness of automated deep-learning (DL) tools in the context of white matter lesion (WML) segmentation from magnetic resonance imaging (MRI) scans of…

Learning-to-Rank (LTR) is a supervised machine learning approach that constructs models specifically designed to order a set of items or documents based on their relevance or importance to a given query or context. Despite significant…

信息检索 · 计算机科学 2026-04-17 Camilo Gomez , Pengyang Wang , Yanjie Fu

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks due to large training datasets and powerful transformer architecture. However, the reliability of responses from LLMs remains a question.…

计算与语言 · 计算机科学 2025-02-26 Tiejin Chen , Xiaoou Liu , Longchao Da , Jia Chen , Vagelis Papalexakis , Hua Wei