English
Related papers

Related papers: Preview Reference Governors: A Constraint Manageme…

200 papers

This paper addresses the issues of insufficient coverage, unstable results, and limited reliability in retrieval-augmented generation under complex knowledge environments, and proposes a confidence control method that integrates…

Computation and Language · Computer Science 2025-11-03 Xiaofan Guo , Yaxuan Luan , Yue Kang , Xiangchen Song , Jinxu Guo

Learning from rewards (i.e., reinforcement learning or RL) and learning to imitate a teacher (i.e., teacher-student learning) are two established approaches for solving sequential decision-making problems. To combine the benefits of these…

Machine Learning · Computer Science 2024-02-21 Idan Shenfeld , Zhang-Wei Hong , Aviv Tamar , Pulkit Agrawal

Sequential Recommender Systems (SRSs) are a popular type of recommender system that learns from a user's history to predict the next item they are likely to interact with. However, user interactions can be affected by noise stemming from…

Information Retrieval · Computer Science 2024-04-18 Andrea Bacciu , Federico Siciliano , Nicola Tonellotto , Fabrizio Silvestri

Sequential Recommendation System~(SRS) has become pivotal in modern society, which predicts subsequent actions based on the user's historical behavior. However, traditional collaborative filtering-based sequential recommendation models…

Information Retrieval · Computer Science 2025-11-26 Tianjie Dai , Xu Chen , Yunmeng Shu , Jinsong Lan , Xiaoyong Zhu , Jiangchao Yao , Bo Zheng

A Pseudo-Random Number Generator (PRNG) is any algorithm generating a sequence of numbers approximating properties of random numbers. These numbers are widely employed in mid-level cryptography and in software applications. Test suites are…

Cryptography and Security · Computer Science 2020-11-20 Luca Pasqualini , Maurizio Parton

While Group Relative Policy Optimization (GRPO) has emerged as a scalable framework for critic-free policy learning, extending it to settings with explicit behavioral constraints remains underexplored. We introduce Constrained GRPO, a…

Machine Learning · Computer Science 2026-02-09 Roger Girgis , Rodrigue de Schaetzen , Luke Rowe , Azalée Robitaille , Christopher Pal , Liam Paull

While RAG has greatly enhanced LLMs, extending this paradigm to Time-Series Foundation Models (TSFMs) remains a challenge. This is exemplified in the Predictive Maintenance of the Pressure Regulating and Shut-Off Valve (PRSOV), a…

Artificial Intelligence · Computer Science 2026-03-25 Kenny Ye Liang , Zhongyi Pei , Huan Zhang , Yuhui Liu , Shaoxu Song , Jianmin Wang

Stochastic first-order methods for empirical risk minimization employ gradient approximations based on sampled data in lieu of exact gradients. Such constructions introduce noise into the learning dynamics, which can be corrected through…

Machine Learning · Computer Science 2025-03-18 Sean Xiao , Sangwoo Park , Stefan Vlaski

With the aim of further enabling the exploitation of impacts in robotic manipulation, a control framework is presented that directly tackles the challenges posed by tracking control of robotic manipulators that are tasked to perform…

Robotics · Computer Science 2022-12-05 Jari J. van Steen , Nathan van de Wouw , Alessandro Saccon

The recent mainstream reinforcement learning control for quadruped robots often relies on privileged information, demanding meticulous selection and precise estimation, thereby imposing constraints on the development process. This work…

Robotics · Computer Science 2024-10-22 Shiyi Chen , Zeyu Wan , Shiyang Yan , Chun Zhang , Weiyi Zhang , Qiang Li , Debing Zhang , Fasih Ud Din Farrukh

Minimizing empirical risk subject to a set of constraints can be a useful strategy for learning restricted classes of functions, such as monotonic functions, submodular functions, classifiers that guarantee a certain class label for some…

Machine Learning · Computer Science 2016-10-26 Andrew Cotter , Maya Gupta , Jan Pfeifer

Deep Reinforcement Learning is a promising paradigm for robotic control which has been shown to be capable of learning policies for high-dimensional, continuous control of unmodeled systems. However, RoboticReinforcement Learning currently…

Robotics · Computer Science 2019-09-23 W. Cannon Lewis , Mark Moll , Lydia E. Kavraki

We present and analyze several strategies for improving the performance of stochastic variance-reduced gradient (SVRG) methods. We first show that the convergence rate of these methods can be preserved under a decreasing sequence of errors…

Machine Learning · Computer Science 2016-08-06 Reza Babanezhad , Mohamed Osama Ahmed , Alim Virani , Mark Schmidt , Jakub Konečný , Scott Sallinen

Traditionally, networks operate at a small fraction of their capacities; however, recent technologies, such as Software-Defined Networking, may let operators run their networks harder (i.e., at higher utilization levels). Higher utilization…

Networking and Internet Architecture · Computer Science 2018-04-26 Rafael B. R. Lourenco , Massimo Tornatore , Charles U. Martel , Biswanath Mukherjee

Leveraging machine learning methods to solve constraint satisfaction problems has shown promising, but they are mostly limited to a static situation where the problem description is completely known and fixed from the beginning. In this…

Machine Learning · Computer Science 2025-09-23 Wook Lee , Frans A. Oliehoek

Despite the strong theoretical guarantees that variance-reduced finite-sum optimization algorithms enjoy, their applicability remains limited to cases where the memory overhead they introduce (SAG/SAGA), or the periodic full gradient…

Optimization and Control · Mathematics 2021-03-24 Ayoub El Hanchi , David A. Stephens

Preference-based reinforcement learning (PbRL) provides a natural way to align RL agents' behavior with human desired outcomes, but is often restrained by costly human feedback. To improve feedback efficiency, most existing PbRL methods…

Machine Learning · Computer Science 2024-07-08 Xiao Hu , Jianxiong Li , Xianyuan Zhan , Qing-Shan Jia , Ya-Qin Zhang

This study considers multiple reconfigurable intelligent surfaces (RISs)-aided multiuser downlink systems with the goal of jointly optimizing the transmitter precoding and RIS phase shift matrix to maximize spectrum efficiency. Unlike prior…

Information Theory · Computer Science 2025-10-01 Po-Heng Chou , Bo-Ren Zheng , Wan-Jen Huang , Walid Saad , Yu Tsao , Ronald Y. Chang

Reinforcement learning enhances the reasoning capabilities of large language models but often involves high computational costs due to rollout-intensive optimization. Online prompt selection presents a plausible solution by prioritizing…

Artificial Intelligence · Computer Science 2026-05-18 Yun Qu , Qi Wang , Yixiu Mao , Heming Zou , Yuhang Jiang , Weijie Liu , Clive Bai , Kai Yang , Yangkun Chen , Saiyong Yang , Xiangyang Ji

Biological agents, such as humans and animals, are capable of making decisions out of a very large number of choices in a limited time. They can do so because they use their prior knowledge to find a solution that is not necessarily optimal…

Robotics · Computer Science 2023-08-01 Durgakant Pushp , Junhong Xu , Lantao Liu