English
Related papers

Related papers: Interactive Spoken Content Retrieval by Deep Reinf…

200 papers

Deep reinforcement learning (deep RL) has achieved superior performance in complex sequential tasks by learning directly from image input. A deep neural network is used as a function approximator and requires no specific state information.…

Machine Learning · Computer Science 2018-12-27 Xi Chen , Caylin Hickey

Reinforcement learning is a powerful technique for learning from trial and error, but it often requires a large number of interactions to achieve good performance. In some domains, such as sparse-reward tasks, an oracle that can provide…

Artificial Intelligence · Computer Science 2023-09-22 Zhourui Guo , Meng Yao , Yang Yu , Qiyue Yin

This paper presents first successful steps in designing search agents that learn meta-strategies for iterative query refinement in information-seeking tasks. Our approach uses machine reading to guide the selection of refinement terms from…

Comprehension of spoken natural language is an essential component for robots to communicate with human effectively. However, handling unconstrained spoken instructions is challenging due to (1) complex structures including a wide variety…

We introduce a novel schema for sequence to sequence learning with a Deep Q-Network (DQN), which decodes the output sequence iteratively. The aim here is to enable the decoder to first tackle easier portions of the sequences, and then turn…

Computation and Language · Computer Science 2015-11-02 Hongyu Guo

In this paper, we consider the task of learning control policies for text-based games. In these games, all interactions in the virtual world are through text and the underlying state is not observed. The resulting language barrier makes…

Computation and Language · Computer Science 2015-09-15 Karthik Narasimhan , Tejas Kulkarni , Regina Barzilay

Natural language sentence matching is the task of comparing two sentences and identifying the relationship between them.It has a wide range of applications in natural language processing tasks such as reading comprehension, question and…

Computation and Language · Computer Science 2022-03-22 Kexin Jiang , Yahui Zhao , Rongyi Cui , Zhenguo Zhang

We study reinforcement learning (RL) for text-based games, which are interactive simulations in the context of natural language. While different methods have been developed to represent the environment information and language actions,…

Machine Learning · Computer Science 2020-12-29 Yunqiu Xu , Meng Fang , Ling Chen , Yali Du , Joey Tianyi Zhou , Chengqi Zhang

Human computer conversation is regarded as one of the most difficult problems in artificial intelligence. In this paper, we address one of its key sub-problems, referred to as short text conversation, in which given a message from human,…

Information Retrieval · Computer Science 2014-09-01 Zongcheng Ji , Zhengdong Lu , Hang Li

We examine the problem of joint top-down active search of multiple objects under interaction, e.g., person riding a bicycle, cups held by the table, etc.. Such objects under interaction often can provide contextual cues to each other to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Xiangyu Kong , Bo Xin , Yizhou Wang , Gang Hua

We deal with the scenario of conversational search, where user queries are under-specified or ambiguous. This calls for a mixed-initiative setup. User-asks (queries) and system-answers, as well as system-asks (clarification questions) and…

Computation and Language · Computer Science 2022-05-24 Yosi Mass , Doron Cohen , Asaf Yehudai , David Konopnicki

Multimedia or spoken content presents more attractive information than plain text content, but it's more difficult to display on a screen and be selected by a user. As a result, accessing large collections of the former is much more…

Computation and Language · Computer Science 2016-08-24 Bo-Hsiang Tseng , Sheng-Syun Shen , Hung-Yi Lee , Lin-Shan Lee

Dense retrieval is a basic building block of information retrieval applications. One of the main challenges of dense retrieval in real-world settings is the handling of queries containing misspelled words. A popular approach for handling…

Speaker recognition is a well known and studied task in the speech processing domain. It has many applications, either for security or speaker adaptation of personal devices. In this paper, we present a new paradigm for automatic speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Mathieu Seurin , Florian Strub , Philippe Preux , Olivier Pietquin

When encountering novel objects, humans are able to infer a wide range of physical properties such as mass, friction and deformability by interacting with them in a goal driven way. This process of active interaction is in the same spirit…

Machine Learning · Statistics 2017-08-21 Misha Denil , Pulkit Agrawal , Tejas D Kulkarni , Tom Erez , Peter Battaglia , Nando de Freitas

We will demonstrate a conversational products recommendation agent. This system shows how we combine research in personalized recommendation systems with research in dialogue systems to build a virtual sales agent. Based on new deep…

Computation and Language · Computer Science 2016-10-06 Yueming Sun , Yi Zhang , Yunfei Chen , Roger Jin

As advanced modern systems like deep neural networks (DNNs) and generative AI continue to enhance their capabilities in producing convincing and realistic content, the need to distinguish between user-generated and machine generated content…

Computation and Language · Computer Science 2024-04-01 Yaqi Xie , Anjali Rawal , Yujing Cen , Dixuan Zhao , Sunil K Narang , Shanu Sushmita

Reinforcement learning techniques successfully generate convincing agent behaviors, but it is still difficult to tailor the behavior to align with a user's specific preferences. What is missing is a communication method for the system to…

Human-Computer Interaction · Computer Science 2021-05-28 Christian Arzate Cruz , Takeo Igarashi

Conversational search supports multi-turn user-system interactions to solve complex information needs. Different from the traditional single-turn ad-hoc search, conversational search encounters a more challenging problem of…

Information Retrieval · Computer Science 2024-07-30 Fengran Mo , Chen Qu , Kelong Mao , Yihong Wu , Zhan Su , Kaiyu Huang , Jian-Yun Nie

Training and refreshing a web-scale Question Answering (QA) system for a multi-lingual commercial search engine often requires a huge amount of training examples. One principled idea is to mine implicit relevance feedback from user behavior…

Information Retrieval · Computer Science 2020-06-17 Linjun Shou , Shining Bo , Feixiang Cheng , Ming Gong , Jian Pei , Daxin Jiang