English
Related papers

Related papers: Sequential Decision-Making for Inline Text Autocom…

200 papers

Recommender systems play a significant role in information filtering and have been utilized in different scenarios, such as e-commerce and social media. With the prosperity of deep learning, deep recommender systems show superior…

Information Retrieval · Computer Science 2023-01-03 Ruiqi Zheng , Liang Qu , Bin Cui , Yuhui Shi , Hongzhi Yin

Meta-learning algorithms use past experience to learn to quickly solve new tasks. In the context of reinforcement learning, meta-learning algorithms acquire reinforcement learning procedures to solve new problems more efficiently by…

Machine Learning · Computer Science 2020-05-01 Abhishek Gupta , Benjamin Eysenbach , Chelsea Finn , Sergey Levine

Recommending a sequence of activities for an ongoing case requires that the recommendations conform to the underlying business process and meet the performance goal of either completion time or process outcome. Existing work on next…

Artificial Intelligence · Computer Science 2022-05-09 Prerna Agarwal , Avani Gupta , Renuka Sindhgatta , Sampath Dechu

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

Computation and Language · Computer Science 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li

In the last decade, Deep Reinforcement Learning has evolved into a powerful tool for complex sequential decision-making problems. It combines deep learning's proficiency in processing rich input signals with reinforcement learning's…

Machine Learning · Computer Science 2024-12-11 Julien Roy

We study automatic question generation for sentences from text passages in reading comprehension. We introduce an attention-based sequence learning model for the task and investigate the effect of encoding sentence- vs. paragraph-level…

Computation and Language · Computer Science 2017-05-02 Xinya Du , Junru Shao , Claire Cardie

Sequential recommendation aims to estimate how a user's interests evolve over time via uncovering valuable patterns from user behavior history. Many previous sequential models have solely relied on users' historical information to model the…

Information Retrieval · Computer Science 2024-08-15 Lei Zheng , Ning Li , Yanhuan Huang , Ruiwen Xu , Weinan Zhang , Yong Yu

Improving sample efficiency is central to Reinforcement Learning (RL), especially in environments where the rewards are sparse. Some recent approaches have proposed to specify reward functions as manually designed or learned reward…

Machine Learning · Computer Science 2024-01-26 Shuai Han , Mehdi Dastani , Shihan Wang

Autoregressive language models, pretrained using large text corpora to do well on next word prediction, have been successful at solving many downstream tasks, even with zero-shot usage. However, there is little theoretical understanding of…

Computation and Language · Computer Science 2021-04-15 Nikunj Saunshi , Sadhika Malladi , Sanjeev Arora

Despite the success of existing instruction-tuned models, we find that they usually struggle to respond to queries with multiple instructions. This impairs their performance in complex problems whose solution consists of multiple…

Computation and Language · Computer Science 2024-07-04 Hanxu Hu , Simon Yu , Pinzhen Chen , Edoardo M. Ponti

Previous efforts in recommendation of candidates for talent search followed the general pattern of receiving an initial search criteria and generating a set of candidates utilizing a pre-trained model. Traditionally, the generated…

Artificial Intelligence · Computer Science 2018-09-19 Sahin Cem Geyik , Vijay Dialani , Meng Meng , Ryan Smith

In continuing tasks, average-reward reinforcement learning may be a more appropriate problem formulation than the more common discounted reward formulation. As usual, learning an optimal policy in this setting typically requires a large…

Artificial Intelligence · Computer Science 2023-01-18 Yuqian Jiang , Sudarshanan Bharadwaj , Bo Wu , Rishi Shah , Ufuk Topcu , Peter Stone

Task-oriented dialog systems have been applied in various tasks, such as automated personal assistants, customer service providers and tutors. These systems work well when users have clear and explicit intentions that are well-aligned to…

Computation and Language · Computer Science 2018-01-09 Zhou Yu , Alan W Black , Alexander I. Rudnicky

Logical specifications have been shown to help reinforcement learning algorithms in achieving complex tasks. However, when a task is under-specified, agents might fail to learn useful policies. In this work, we explore the possibility of…

Artificial Intelligence · Computer Science 2026-03-02 Tanmay Ambadkar , Đorđe Žikelić , Abhinav Verma

Prompting, which casts downstream applications as language modeling tasks, has shown to be sample efficient compared to standard fine-tuning with pre-trained models. However, one pitfall of prompting is the need of manually-designed…

Computation and Language · Computer Science 2022-09-21 Zichun Yu , Tianyu Gao , Zhengyan Zhang , Yankai Lin , Zhiyuan Liu , Maosong Sun , Jie Zhou

Continually solving new, unsolved tasks is the key to learning diverse behaviors. Through reinforcement learning (RL), we have made massive strides towards solving tasks that have a single goal. However, in the multi-task domain, where an…

Machine Learning · Computer Science 2020-06-18 Yunzhi Zhang , Pieter Abbeel , Lerrel Pinto

In this paper, we propose a theoretically founded sequential strategy for training large-scale Recommender Systems (RS) over implicit feedback, mainly in the form of clicks. The proposed approach consists in minimizing pairwise ranking loss…

Information Retrieval · Computer Science 2020-12-15 Aleksandra Burashnikova , Marianne Clausel , Charlotte Laclau , Frack Iutzeller , Yury Maximov , Massih-Reza Amini

How to usefully encode compositional task structure has long been a core challenge in AI. Recent work in chain of thought prompting has shown that for very large neural language models (LMs), explicitly demonstrating the inferential steps…

Computation and Language · Computer Science 2022-10-25 Victor S. Bursztyn , David Demeter , Doug Downey , Larry Birnbaum

Providing personalized explanations for recommendations can help users to understand the underlying insight of the recommendation results, which is helpful to the effectiveness, transparency, persuasiveness and trustworthiness of…

Information Retrieval · Computer Science 2021-01-12 Hanxiong Chen , Xu Chen , Shaoyun Shi , Yongfeng Zhang

Experience replay is one of the most commonly used approaches to improve the sample efficiency of reinforcement learning algorithms. In this work, we propose an approach to select and replay sequences of transitions in order to accelerate…

Artificial Intelligence · Computer Science 2022-09-29 Thommen George Karimpanal , Roland Bouffanais