English
Related papers

Related papers: Multi-Objective Instruction-Aware Representation L…

200 papers

Imitation learning (IL) algorithms have shown promising results for robots to learn skills from expert demonstrations. However, they need multi-task demonstrations to be provided at once for acquiring diverse skills, which is difficult in…

Robotics · Computer Science 2021-10-19 Chongkai Gao , Haichuan Gao , Shangqi Guo , Tianren Zhang , Feng Chen

We propose to improve in-context learning (ICL) by optimizing the continuous embeddings of a fixed few-shot prompt at test time. The key observation is that the log-probabilities a model assigns to its demonstrated…

Computation and Language · Computer Science 2026-05-25 Baturay Saglam , Dionysis Kalogerias

Instruction-based image editing has made a great process in using natural human language to manipulate the visual content of images. However, existing models are limited by the quality of the dataset and cannot accurately localize editing…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Tiancheng Li , Jinxiu Liu , Huajun Chen , Qi Liu

Advances in perception modeling have significantly improved the performance of object tracking. However, the current methods for specifying the target object in the initial frame are either by 1) using a box or mask template, or by 2)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Jiawen Zhu , Zhi-Qi Cheng , Jun-Yan He , Chenyang Li , Bin Luo , Huchuan Lu , Yifeng Geng , Xuansong Xie

Reward design plays a pivotal role in the training of game AIs, requiring substantial domain-specific knowledge and human effort. In recent years, several studies have explored reward generation for training game agents and controlling…

Artificial Intelligence · Computer Science 2026-05-26 In-Chang Baek , Sung-Hyun Kim , Sam Earle , Zehua Jiang , Jin-Ha Noh , Julian Togelius , Kyung-Joong Kim

Transformer has demonstrated its great power to learn contextual word representations for multiple languages in a single model. To process multilingual sentences in the model, a learnable vector is usually assigned to each language, which…

Computation and Language · Computer Science 2021-02-17 Shengjie Luo , Kaiyuan Gao , Shuxin Zheng , Guolin Ke , Di He , Liwei Wang , Tie-Yan Liu

In an era of countless content offerings, recommender systems alleviate information overload by providing users with personalized content suggestions. Due to the scarcity of explicit user feedback, modern recommender systems typically…

Machine Learning · Computer Science 2023-03-07 Jessica Maghakian , Paul Mineiro , Kishan Panaganti , Mark Rucker , Akanksha Saran , Cheng Tan

Reinforcement Learning (RL) can enable agents to learn complex tasks. However, it is difficult to interpret the knowledge and reuse it across tasks. Inductive biases can address such issues by explicitly providing generic yet useful…

Artificial Intelligence · Computer Science 2022-12-13 Thomas Schnürer , Malte Probst , Horst-Michael Gross

Recent advances in text-conditioned image generation diffusion models have begun paving the way for new opportunities in modern medical domain, in particular, generating Chest X-rays (CXRs) from diagnostic reports. Nonetheless, to further…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Woojung Han , Chanyoung Kim , Dayun Ju , Yumin Shim , Seong Jae Hwang

In-Context Reinforcement Learning (ICRL) enables Large Language Models (LLMs) to learn online from external rewards directly within the context window. However, a central challenge in ICRL is reward estimation, as models typically lack…

Computation and Language · Computer Science 2026-04-02 Wenxuan Jiang , Yuxin Zuo , Zijian Zhang , Xuecheng Wu , Zining Fan , Wenxuan Liu , Li Chen , Xiaoyu Li , Xuezhi Cao , Xiaolong Jin , Ninghao Liu

The prevailing graph neural network models have achieved significant progress in graph representation learning. However, in this paper, we uncover an ever-overlooked phenomenon: the pre-trained graph representation learning model tested…

Machine Learning · Computer Science 2023-02-14 Hang Gao , Jiangmeng Li , Wenwen Qiang , Lingyu Si , Bing Xu , Changwen Zheng , Fuchun Sun

Recent advances in diffusion models have demonstrated impressive capability in generating high-quality images for simple prompts. However, when confronted with complex prompts involving multiple objects and hierarchical structures, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Hongji Yang , Yucheng Zhou , Wencheng Han , Runzhou Tao , Zhongying Qiu , Jianfei Yang , Jianbing Shen

Continual learning enables pre-trained generative vision-language models (VLMs) to incorporate knowledge from new tasks without retraining data from previous ones. Recent methods update a visual projector to translate visual information for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Hyundong Jin , Hyung Jin Chang , Eunwoo Kim

Implicit discourse relation recognition (IDRR) is a challenging but crucial task in discourse analysis. Most existing methods train multiple models to predict multi-level labels independently, while ignoring the dependence between…

Computation and Language · Computer Science 2021-12-23 Changxing Wu , Liuwen Cao , Yubin Ge , Yang Liu , Min Zhang , Jinsong Su

In-Context Learning (ICL) empowers Large Language Models (LLMs) with the ability to learn from a few examples provided in the prompt, enabling downstream generalization without the requirement for gradient updates. Despite encouragingly…

Computation and Language · Computer Science 2025-01-28 Haitao Mao , Guangliang Liu , Yao Ma , Rongrong Wang , Kristen Johnson , Jiliang Tang

Recent developments in generative artificial intelligence (AI) rely on machine learning techniques such as deep learning and generative modeling to achieve state-of-the-art performance across wide-ranging domains. These methods' surprising…

Machine Learning · Statistics 2026-01-27 Gemma E. Moran , Bryon Aragam

Reinforcement learning (RL) has shown strong promise for LLM-based machine translation, with recent methods such as GRPO demonstrating notable gains; nevertheless, translation-oriented RL remains challenged by noisy learning signals arising…

Computation and Language · Computer Science 2026-05-19 Yunzhi Shen , Hao Zhou , Xin Huang , Xue Han , Junlan Feng , Shujian Huang

Reinforcement learning (RL) is a framework for solving sequential decision-making problems. In this work, we demonstrate that, surprisingly, RL emerges during the inference time of large language models (LLMs), a phenomenon we term…

Machine Learning · Computer Science 2026-04-28 Kefan Song , Amir Moeini , Peng Wang , Lei Gong , Rohan Chandra , Shangtong Zhang , Yanjun Qi

In-context reinforcement learning (ICRL) leverages the in-context learning capabilities of transformer models (TMs) to efficiently generalize to unseen sequential decision-making tasks without parameter updates. However, existing ICRL…

Machine Learning · Computer Science 2026-02-10 Juncheng Dong , Bowen He , Moyang Guo , Ethan X. Fang , Zhuoran Yang , Vahid Tarokh

A major open problem on the road to artificial intelligence is the development of incrementally learning systems that learn about more and more concepts over time from a stream of data. In this work, we introduce a new training strategy,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Sylvestre-Alvise Rebuffi , Alexander Kolesnikov , Georg Sperl , Christoph H. Lampert