English
Related papers

Related papers: Unified Demonstration Retriever for In-Context Lea…

200 papers

Deep Reinforcement Learning (RL) has emerged as a powerful paradigm to solve a range of complex yet specific control tasks. Yet training generalist agents that can quickly adapt to new tasks remains an outstanding challenge. Recent advances…

Machine Learning · Computer Science 2021-10-29 Michael Laskin , Denis Yarats , Hao Liu , Kimin Lee , Albert Zhan , Kevin Lu , Catherine Cang , Lerrel Pinto , Pieter Abbeel

This paper proposes an unsupervised method for learning a unified representation that serves both discriminative and generative purposes. While most existing unsupervised learning approaches focus on a representation for only one of these…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shengbang Tong , Xili Dai , Yubei Chen , Mingyang Li , Zengyi Li , Brent Yi , Yann LeCun , Yi Ma

Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is a great challenging task. Existing studies focus on building a context-response matching model with various neural…

Computation and Language · Computer Science 2020-09-15 Ruijian Xu , Chongyang Tao , Daxin Jiang , Xueliang Zhao , Dongyan Zhao , Rui Yan

Multi-task Vehicle Routing Problems (VRPs) aim to minimize routing costs while satisfying diverse constraints. Existing solvers typically adopt a unified reinforcement learning (RL) framework to learn generalizable patterns across tasks.…

Artificial Intelligence · Computer Science 2026-03-03 Shuangchun Gui , Suyu Liu , Xuehe Wang , Zhiguang Cao

In nested Named entity recognition (NER), entities are nested with each other, and thus requiring more data annotations to address. This leads to the development of few-shot nested NER, where the prevalence of pretrained language models…

Computation and Language · Computer Science 2024-02-05 Meishan Zhang , Bin Wang , Hao Fei , Min Zhang

Large language models (LLMs) can use in-context demonstrations to improve performance on zero-shot tasks. However, selecting the best in-context examples is challenging because model performance can vary widely depending on the selected…

Computation and Language · Computer Science 2023-11-29 Dan Iter , Reid Pryzant , Ruochen Xu , Shuohang Wang , Yang Liu , Yichong Xu , Chenguang Zhu

Recent work has shown that more effective dense retrieval models can be obtained by distilling ranking knowledge from an existing base re-ranking model. In this paper, we propose a generic curriculum learning based optimization framework…

Information Retrieval · Computer Science 2022-04-29 Hansi Zeng , Hamed Zamani , Vishwa Vinay

In-context learning$\unicode{x2013}$the ability to configure a model's behavior with different prompts$\unicode{x2013}$has revolutionized the field of natural language processing, alleviating the need for task-specific models and paving the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Ivana Balažević , David Steiner , Nikhil Parthasarathy , Relja Arandjelović , Olivier J. Hénaff

Deep neural networks have achieved state-of-the-art results in various vision and/or language tasks. Despite the use of large training datasets, most models are trained by iterating over single input-output pairs, discarding the remaining…

Computation and Language · Computer Science 2021-04-27 Rita Parada Ramos , Patrícia Pereira , Helena Moniz , Joao Paulo Carvalho , Bruno Martins

With the rapid advancement of multimodal information retrieval, increasingly complex retrieval tasks have emerged. Existing methods predominately rely on task-specific fine-tuning of vision-language models, often those trained with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yikun Liu , Pingan Chen , Jiayin Cai , Xiaolong Jiang , Yao Hu , Jiangchao Yao , Yanfeng Wang , Weidi Xie

There has been appreciable progress in unsupervised network representation learning (UNRL) approaches over graphs recently with flexible random-walk approaches, new optimization objectives and deep architectures. However, there is no common…

Machine Learning · Computer Science 2020-03-12 Megha Khosla , Vinay Setty , Avishek Anand

There is extensive interest in metric learning methods for image retrieval. Many metric learning loss functions focus on learning a correct ranking of training samples, but strongly overfit semantically inconsistent labels and require a…

Machine Learning · Computer Science 2023-06-05 Christopher Liao , Theodoros Tsiligkaridis , Brian Kulis

In-context reinforcement learning (ICRL) leverages the in-context learning capabilities of transformer models (TMs) to efficiently generalize to unseen sequential decision-making tasks without parameter updates. However, existing ICRL…

Machine Learning · Computer Science 2026-02-10 Juncheng Dong , Bowen He , Moyang Guo , Ethan X. Fang , Zhuoran Yang , Vahid Tarokh

In-Context Reinforcement Learning (ICRL) enables agents to learn automatically and on-the-fly from their interactive experiences. However, a major challenge in scaling up ICRL is the lack of scalable task collections. To address this, we…

Machine Learning · Computer Science 2025-11-04 Fan Wang , Pengtao Shao , Yiming Zhang , Bo Yu , Shaoshan Liu , Ning Ding , Yang Cao , Yu Kang , Haifeng Wang

Conventional representation learning methods learn a universal representation that primarily captures dominant semantics, which may not always align with customized downstream tasks. For instance, in animal habitat analysis, researchers…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Honglin Liu , Chao Sun , Peng Hu , Yunfan Li , Xi Peng

Large language models (LLMs) can learn vast amounts of knowledge from diverse domains during pre-training. However, long-tail knowledge from specialized domains is often scarce and underrepresented, rarely appearing in the models'…

Computation and Language · Computer Science 2025-02-11 Shuyang Yu , Runxue Bao , Parminder Bhatia , Taha Kass-Hout , Jiayu Zhou , Cao Xiao

Multimodal retrieval systems are becoming increasingly vital for cutting-edge AI technologies, such as embodied AI and AI-driven digital content industries. However, current multimodal retrieval tasks lack sufficient complexity and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Bangwei Liu , Yicheng Bao , Shaohui Lin , Xuhong Wang , Xin Tan , Yingchun Wang , Yuan Xie , Chaochao Lu

In real-world recommender systems, different retrieval objectives are typically addressed using task-specific datasets with carefully designed model architectures. We demonstrate that Large Language Models (LLMs) can function as universal…

Information Retrieval · Computer Science 2025-05-20 Junguang Jiang , Yanwen Huang , Bin Liu , Xiaoyu Kong , Xinhang Li , Ziru Xu , Han Zhu , Jian Xu , Bo Zheng

A wide variety of deep reinforcement learning (DRL) models have recently been proposed to learn profitable investment strategies. The rules learned by these models outperform the previous strategies specially in high frequency trading…

Statistical Finance · Quantitative Finance 2021-01-12 Mehran Taghian , Ahmad Asadi , Reza Safabakhsh

Text embedding and generative tasks are usually trained separately based on large language models (LLMs) nowadays. This causes a large amount of training cost and deployment effort. Context compression is also a challenging and pressing…

Computation and Language · Computer Science 2026-05-13 Zhongtao Miao , Qiyu Wu , Yoshimasa Tsuruoka