English
Related papers

Related papers: Towards Dynamic Dense Retrieval with Routing Strat…

200 papers

The sequential recommender (SR) system is a crucial component of modern recommender systems, as it aims to capture the evolving preferences of users. Significant efforts have been made to enhance the capabilities of SR systems. These…

Information Retrieval · Computer Science 2024-09-12 Mingjia Yin , Hao Wang , Wei Guo , Yong Liu , Suojuan Zhang , Sirui Zhao , Defu Lian , Enhong Chen

Neural ranking models (NRMs) and dense retrieval (DR) models have given rise to substantial improvements in overall retrieval performance. In addition to their effectiveness, and motivated by the proven lack of robustness of deep…

Information Retrieval · Computer Science 2023-08-22 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Wei Chen , Yixing Fan , Xueqi Cheng

Selecting the appropriate dimensionality reduction (DR) technique and determining its optimal hyperparameter settings that maximize the accuracy of the output projections typically involves extensive trial and error, often resulting in…

Human-Computer Interaction · Computer Science 2026-01-13 Hyeon Jeon , Jeongin Park , Soohyun Lee , Dae Hyun Kim , Sungbok Shin , Jinwook Seo

Based on its great successes in inference and denosing tasks, Dictionary Learning (DL) and its related sparse optimization formulations have garnered a lot of research interest. While most solutions have focused on single layer…

Machine Learning · Computer Science 2021-04-22 Wen Tang , Emilie Chouzenoux , Jean-Christophe Pesquet , Hamid Krim

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

Machine Learning · Computer Science 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

This paper presents a deep reinforcement learning (DRL) framework for dynamic portfolio optimization under market uncertainty and risk. The proposed model integrates a Sharpe ratio-based reward function with direct risk control mechanisms,…

Portfolio Management · Quantitative Finance 2025-11-17 Emmanuel Lwele , Sabuni Emmanuel , Sitali Gabriel Sitali

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

Deep Reinforcement Learning (DRL) has emerged as a powerful model-free paradigm for learning optimal policies. However, in navigation tasks with cluttered environments, DRL methods often suffer from insufficient exploration, especially…

Robotics · Computer Science 2025-07-04 Licheng Luo , Mingyu Cai

Deep Reinforcement Learning (DRL) policies have been shown to be vulnerable to small adversarial noise in observations. Such adversarial noise can have disastrous consequences in safety-critical environments. For instance, a self-driving…

Machine Learning · Computer Science 2024-03-28 Roman Belaire , Pradeep Varakantham , Thanh Nguyen , David Lo

With the growing volume of diverse information, the demand for classifying arbitrary topics has become increasingly critical. To address this challenge, we introduce DRAFT, a simple framework designed to train a classifier for few-shot…

Information Retrieval · Computer Science 2023-12-06 Keonwoo Kim , Younggun Lee

In recent years, domain randomization over dynamics parameters has gained a lot of traction as a method for sim-to-real transfer of reinforcement learning policies in robotic manipulation; however, finding optimal randomization…

Robotics · Computer Science 2023-01-13 Gabriele Tiboni , Karol Arndt , Ville Kyrki

Despite significant advances in deep learning, models often struggle to generalize well to new, unseen domains, especially when training data is limited. To address this challenge, we propose a novel approach for distribution-aware latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Ran Liu , Sahil Khose , Jingyun Xiao , Lakshmi Sathidevi , Keerthan Ramnath , Zsolt Kira , Eva L. Dyer

Model-free continuous control for robot navigation tasks using Deep Reinforcement Learning (DRL) that relies on noisy policies for exploration is sensitive to the density of rewards. In practice, robots are usually deployed in cluttered…

Robotics · Computer Science 2023-02-24 Mingyu Cai , Erfan Aasi , Calin Belta , Cristian-Ioan Vasile

Diffusion Probabilistic Models (DPMs) have been recently utilized to deal with various blind image restoration (IR) tasks, where they have demonstrated outstanding performance in terms of perceptual quality. However, the task-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Magauiya Zhussip , Iaroslav Koshelev , Stamatis Lefkimmiatis

The pre-trained language model (eg, BERT) based deep retrieval models achieved superior performance over lexical retrieval models (eg, BM25) in many passage retrieval tasks. However, limited work has been done to generalize a deep retrieval…

Information Retrieval · Computer Science 2023-02-21 Tao Chen , Mingyang Zhang , Jing Lu , Michael Bendersky , Marc Najork

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

Existing research on Domain Robustness (DR) suffers from disparate setups, limited task variety, and scarce research on recent capabilities such as in-context learning. Furthermore, the common practice of measuring DR might not be fully…

Computation and Language · Computer Science 2024-04-23 Nitay Calderon , Naveh Porat , Eyal Ben-David , Alexander Chapanin , Zorik Gekhman , Nadav Oved , Vitaly Shalumov , Roi Reichart

Deep Learning (DL) models proved themselves to perform extremely well on a wide variety of learning tasks, as they can learn useful patterns from large data sets. However, purely data-driven models might struggle when very difficult…

Machine Learning · Computer Science 2020-05-22 Andrea Borghesi , Federico Baldo , Michela Milano

Many real-world decision problems are characterized by multiple conflicting objectives which must be balanced based on their relative importance. In the dynamic weights setting the relative importance changes over time and specialized…

Machine Learning · Computer Science 2019-05-14 Axel Abels , Diederik M. Roijers , Tom Lenaerts , Ann Nowé , Denis Steckelmacher

Dense retrieval (DR) has the potential to resolve the query understanding challenge in conversational search by matching in the learned embedding space. However, this adaptation is challenging due to DR models' extra needs for supervision…

Information Retrieval · Computer Science 2021-05-20 Shi Yu , Zhenghao Liu , Chenyan Xiong , Tao Feng , Zhiyuan Liu