English
Related papers

Related papers: Learning to Re-rank with Constrained Meta-Optimal …

200 papers

Levin Tree Search (LTS) is a search algorithm that makes use of a policy (a probability distribution over actions) and comes with a theoretical guarantee on the number of expansions before reaching a goal node, depending on the quality of…

Machine Learning · Computer Science 2024-11-13 Laurent Orseau , Marcus Hutter , Levi H. S. Lelis

In the rapidly evolving field of e-commerce, the effectiveness of search re-ranking models is crucial for enhancing user experience and driving conversion rates. Despite significant advancements in feature representation and model…

Information Retrieval · Computer Science 2024-08-13 Enqiang Xu , Xinhui Li , Zhigong Zhou , Jiahao Ji , Jinyuan Zhao , Dadong Miao , Songlin Wang , Lin Liu , Sulong Xu

Reinforcement Learning with Verifiable Rewards (RLVR) has established itself as the dominant paradigm for instilling rigorous reasoning capabilities in Large Language Models. While effective at amplifying dominant behaviors, we identify a…

Machine Learning · Computer Science 2026-02-16 Zesheng Hong , Jiadong Yu , Hui Pan

Diffusion policies have achieved superior performance in imitation learning and offline reinforcement learning (RL) due to their rich expressiveness. However, the conventional diffusion training procedure requires samples from target…

Machine Learning · Computer Science 2025-07-01 Haitong Ma , Tianyi Chen , Kai Wang , Na Li , Bo Dai

Stochastic resetting, where a dynamical process is intermittently returned to a fixed reference state, has emerged as a powerful mechanism for optimizing first-passage properties. Existing theory largely treats static, non-learning…

Machine Learning · Computer Science 2026-03-18 Jello Zhou , Vudtiwat Ngampruetikorn , David J. Schwab

A common challenge for decision makers is selecting actions whose rewards are unknown and evolve over time based on prior policies. For instance, repeated use may reduce an action's effectiveness (habituation), while inactivity may restore…

Machine Learning · Computer Science 2025-11-06 Fengxu Li , Stephanie M. Carpenter , Matthew P. Buman , Yonatan Mintz

Motivated by robust dynamic resource allocation in operations research, we study the \textit{Online Learning to Transport} (OLT) problem where the decision variable is a probability measure, an infinite-dimensional object. We draw…

Machine Learning · Computer Science 2022-11-21 Wenxuan Guo , YoonHaeng Hur , Tengyuan Liang , Christopher Ryan

Despite measures to reduce congestion, occurrences of both recurrent and non-recurrent congestion cause large delays in road networks with important economic implications. Educated use of Intelligent Transportation Systems (ITS) can…

Optimization and Control · Mathematics 2021-11-23 Nikki Levering , Marko Boon , Michel Mandjes , Rudesindo Núñez-Queija

Model compression plays a vital role in the practical deployment of deep neural networks (DNNs), and evolutionary multi-objective (EMO) pruning is an essential tool in balancing the compression rate and performance of the DNNs. However, due…

Machine Learning · Computer Science 2024-01-02 Ronghua Shang , Songling Zhu , Yinan Wu , Weitong Zhang , Licheng Jiao , Songhua Xu

We introduce a formal model of transportation in an open-pit mine for the purpose of optimising the mine's operations. The model is a network of Markov automata (MA); the optimisation goal corresponds to maximising a time-bounded expected…

Formal Languages and Automata Theory · Computer Science 2024-12-10 Carlos E. Budde , Pedro R. D'Argenio , Arnd Hartmanns

The soft-thinking paradigm for Large Language Model (LLM) reasoning can outperform the conventional discrete-token Chain-of-Thought (CoT) reasoning in some scenarios, underscoring its research and application value. However, while the…

Artificial Intelligence · Computer Science 2026-01-30 Zhi Zheng , Yu Gu , Wei Liu , Yee Whye Teh , Wee Sun Lee

Recent machine-learning approaches to deterministic search and domain-independent planning employ policy learning to speed up search. Unfortunately, when attempting to solve a search problem by successively applying a policy, no guarantees…

Artificial Intelligence · Computer Science 2021-08-05 Pablo Araneda , Matias Greco , Jorge A. Baier

Customizing services for bus travel can bolster its attractiveness, optimize usage, alleviate traffic congestion, and diminish carbon emissions. This potential is realized by harnessing recent advancements in positioning communication…

Machine Learning · Computer Science 2023-12-05 Hongjie Liu , Haotian Shi , Sicheng Fu , Tengfei Yuan , Xinhuan Zhang , Hongzhe Xu , Bin Ran

The recent WSNet [1] is a new model compression method through sampling filterweights from a compact set and has demonstrated to be effective for 1D convolutionneural networks (CNNs). However, the weights sampling strategy of WSNet…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Daquan Zhou , Xiaojie Jin , Qibin Hou , Kaixin Wang , Jianchao Yang , Jiashi Feng

The common pipeline of training deep neural networks consists of several building blocks such as data augmentation and network architecture selection. AutoML is a research field that aims at automatically designing those parts, but most…

Machine Learning · Computer Science 2021-01-13 Taiga Kashima , Yoshihiro Yamada , Shunta Saito

Reinforcement finetuning (RFT) is a key technique for aligning Large Language Models (LLMs) with human preferences and enhancing reasoning, yet its effectiveness is highly sensitive to which tasks are explored during training. Uniform task…

Artificial Intelligence · Computer Science 2026-02-02 Qianli Shen , Daoyuan Chen , Yilun Huang , Zhenqing Ling , Yaliang Li , Bolin Ding , Jingren Zhou

This work studies the linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). Searching this approximation in a data-driven approach is formalised as attempting to solve a low-rank…

Machine Learning · Statistics 2021-08-23 Patrick Héas , Cédric Herzet

Constrained decision-making is essential for designing safe policies in real-world control systems, yet simulated environments often fail to capture real-world adversities. We consider the problem of learning a policy that will maximize the…

Machine Learning · Computer Science 2026-02-10 Sourav Ganguly , Kishan Panaganti , Arnob Ghosh , Adam Wierman

In this paper, we propose a novel probabilistic self-supervised learning via Scoring Rule Minimization (ProSMIN), which leverages the power of probabilistic models to enhance representation quality and mitigate collapsing representations.…

Machine Learning · Computer Science 2023-09-06 Amirhossein Vahidi , Simon Schoßer , Lisa Wimmer , Yawei Li , Bernd Bischl , Eyke Hüllermeier , Mina Rezaei

In this paper, we propose a new natural evolution strategy for unconstrained black-box function optimization (BBFO) problems and implicitly constrained BBFO problems. BBFO problems are known to be difficult because explicit representations…

Neural and Evolutionary Computing · Computer Science 2021-10-19 Masahiro Nomura , Isao Ono