中文
相关论文

相关论文: Learning to Re-rank with Constrained Meta-Optimal …

200 篇论文

Guided policy search algorithms have been proven to work with incredible accuracy for not only controlling a complicated dynamical system, but also learning optimal policies from various unseen instances. One assumes true nature of the…

系统与控制 · 电气工程与系统科学 2020-10-02 Prakash Mallick , Zhiyong Chen , Mohsen Zamani

Recent advances in Multimodal Large Language Models (MLLMs) have spurred significant progress in Chain-of-Thought (CoT) reasoning. Building on the success of Deepseek-R1, researchers extended multimodal reasoning to post-training paradigms…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Jianyu Qi , Ding Zou , Wenrui Yan , Rui Ma , Jiaxu Li , Zhijie Zheng , Zhiguo Yang , Rongchang Zhao

Reinforcement learning continuously optimizes decision-making based on real-time feedback reward signals through continuous interaction with the environment, demonstrating strong adaptive and self-learning capabilities. In recent years, it…

机器人学 · 计算机科学 2024-08-15 Zixiang Wang , Hao Yan , Yining Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu

We present a novel offline-online method to mitigate the computational burden of the characterization of posterior random variables in statistical learning. In the offline phase, the proposed method learns the joint law of the parameter…

机器学习 · 统计学 2023-03-07 Tiangang Cui , Sergey Dolgov , Olivier Zahm

Despite the significant progress of deep learning models in multitude of applications, their adaption in planning and policy related areas remains challenging due to the black-box nature of these models. In this work, we develop a set of…

机器学习 · 计算机科学 2025-09-18 Jeremy Oon , Rakhi Manohar Mepparambath , Ling Feng

Cross-modal drone navigation remains a challenging task in robotics, requiring efficient retrieval of relevant images from large-scale databases based on natural language descriptions. The RoboSense 2025 Track 4 challenge addresses this…

机器人学 · 计算机科学 2025-11-07 Lingfeng Zhang , Erjia Xiao , Yuchen Zhang , Haoxiang Fu , Ruibin Hu , Yanbiao Ma , Wenbo Ding , Long Chen , Hangjun Ye , Xiaoshuai Hao

Model-free deep-reinforcement-based learning algorithms have been applied to a range of COPs~\cite{bello2016neural}~\cite{kool2018attention}~\cite{nazari2018reinforcement}. However, these approaches suffer from two key challenges when…

机器学习 · 计算机科学 2022-06-01 Nasrin Sultana , Jeffrey Chan , Tabinda Sarwar , A. K. Qin

The framework of optimal transport has been leveraged to extend the notion of rank to the multivariate setting while preserving desirable properties of the resulting goodness-of-fit (GoF) statistics. In particular, the rank energy (RE) and…

机器学习 · 统计学 2022-11-29 Shoaib Bin Masud , Matthew Werenski , James M. Murphy , Shuchin Aeron

Aligning language models for both helpfulness and safety typically requires complex pipelines-separate reward and cost models, online reinforcement learning, and primal-dual updates. Recent direct preference optimization approaches simplify…

机器学习 · 计算机科学 2026-05-13 Tien-Phat Nguyen , Truong Nguyen , Thin Nguyen , Duy Minh Ho Nguyen , Ngoc-Thanh Dinh , Trung Le

Optimizing reranking in advertising feeds is a constrained combinatorial problem, requiring simultaneous maximization of platform revenue and preservation of user experience. Recent generative ranking methods enable listwise optimization…

信息检索 · 计算机科学 2026-03-05 Chenfei Li , Hantao Zhao , Weixi Yao , Ruiming Huang , Rongrong Lu , Geng Tian , Dongying Kong

The matching principles behind optimal transport (OT) play an increasingly important role in machine learning, a trend which can be observed when OT is used to disambiguate datasets in applications (e.g. single-cell genomics) or used to…

机器学习 · 统计学 2022-09-16 Meyer Scetbon , Marco Cuturi

We introduce a new second order stochastic algorithm to estimate the entropically regularized optimal transport cost between two probability measures. The source measure can be arbitrary chosen, either absolutely continuous or discrete,…

统计理论 · 数学 2022-03-03 Bernard Bercu , Jérémie Bigot , Sébastien Gadat , Emilia Siviero

In constrained reinforcement learning (C-RL), an agent seeks to learn from the environment a policy that maximizes the expected cumulative reward while satisfying minimum requirements in secondary cumulative reward constraints. Several…

机器学习 · 计算机科学 2022-12-06 Tianqi Zheng , Pengcheng You , Enrique Mallada

Flow-field reconstruction from sparse sensor measurements remains a central challenge in modern fluid dynamics, as the need for high-fidelity data often conflicts with practical limits on sensor deployment. Existing deep learning-based…

计算工程、金融与科学 · 计算机科学 2026-05-15 Ruoyan Li , Guancheng Wan , Zijie Huang , Zixiao Liu , Haixin Wang , Xiao Luo , Wei Wang , Yizhou Sun

This paper uses stochastic dominance principles to construct upper and lower sample path bounds for Hidden Markov Model (HMM) filters. Given a HMM, by using convex optimization methods for nuclear norm minimization with copositive…

统计计算 · 统计学 2015-06-22 Vikram Krishnamurthy , Cristian Rojas

Reinforcement Learning (RL) algorithms for safety alignment of Large Language Models (LLMs), such as Direct Preference Optimization (DPO), encounter the challenge of distribution shift. Current approaches typically address this issue…

计算与语言 · 计算机科学 2025-06-17 Qiyuan Deng , Xuefeng Bai , Kehai Chen , Yaowei Wang , Liqiang Nie , Min Zhang

Query optimization is a critical task in database systems, focused on determining the most efficient way to execute a query from an enormous set of possible strategies. Traditional approaches rely on heuristic search methods and cost…

数据库 · 计算机科学 2025-03-11 Zhiming Yao , Haoyang Li , Jing Zhang , Cuiping Li , Hong Chen

Reinforcement Learning (RL) traditionally relies on scalar reward signals, limiting its ability to leverage the rich semantic knowledge often available in real-world tasks. In contrast, humans learn efficiently by combining numerical…

We study ranked list truncation (RLT) from a novel "retrieve-then-re-rank" perspective, where we optimize re-ranking by truncating the retrieved list (i.e., trim re-ranking candidates). RLT is crucial for re-ranking as it can improve…

信息检索 · 计算机科学 2024-04-30 Chuan Meng , Negar Arabzadeh , Arian Askari , Mohammad Aliannejadi , Maarten de Rijke

With the rising number of machine learning competitions, the world has witnessed an exciting race for the best algorithms. However, the involved data selection process may fundamentally suffer from evidence ambiguity and concept drift…

机器学习 · 计算机科学 2020-06-15 Hoang D. Nguyen , Xuan-Son Vu , Quoc-Tuan Truong , Duc-Trong Le