English
Related papers

Related papers: Personalizing Universal Recurrent Neural Network L…

200 papers

Large language models have made significant progress in the past few years. However, they are either generic {\it or} field specific, splitting the community into different groups. In this paper, we unify these large language models into a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Yuanhao Gong

Nowadays, news apps have taken over the popularity of paper-based media, providing a great opportunity for personalization. Recurrent Neural Network (RNN)-based sequential recommendation is a popular approach that utilizes users' recent…

Information Retrieval · Computer Science 2020-04-13 Bing Bai , Guanhua Zhang , Ye Lin , Hao Li , Kun Bai , Bo Luo

Fixed-vocabulary language models fail to account for one of the most characteristic statistical facts of natural language: the frequent creation and reuse of new word types. Although character-level language models offer a partial solution…

Computation and Language · Computer Science 2017-04-25 Kazuya Kawakami , Chris Dyer , Phil Blunsom

Large language models are typically trained densely: all parameters are updated with respect to all inputs. This requires synchronization of billions of parameters across thousands of GPUs. We introduce a simple but effective method to…

Computation and Language · Computer Science 2023-03-27 Suchin Gururangan , Margaret Li , Mike Lewis , Weijia Shi , Tim Althoff , Noah A. Smith , Luke Zettlemoyer

Inferring latent attributes of people online is an important social computing task, but requires integrating the many heterogeneous sources of information available on the web. We propose learning individual representations of people using…

Social and Information Networks · Computer Science 2017-05-15 Jiwei Li , Alan Ritter , Dan Jurafsky

We study the problem of imposing conversational goals/keywords on open-domain conversational agents, where the agent is required to lead the conversation to a target keyword smoothly and fast. Solving this problem enables the application of…

Computation and Language · Computer Science 2021-03-02 Peixiang Zhong , Yong Liu , Hao Wang , Chunyan Miao

We propose a novel decentralized feature extraction approach in federated learning to address privacy-preservation issues for speech recognition. It is built upon a quantum convolutional neural network (QCNN) composed of a quantum circuit…

In this study, we present an approach to train a single speech enhancement network that can perform both personalized and non-personalized speech enhancement. This is achieved by incorporating a frame-wise conditioning input that specifies…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-24 Zhepei Wang , Ritwik Giri , Devansh Shah , Jean-Marc Valin , Michael M. Goodwin , Paris Smaragdis

Statistical language models are central to many applications that use semantics. Recurrent Neural Networks (RNN) are known to produce state of the art results for language modelling, outperforming their traditional n-gram counterparts in…

Computation and Language · Computer Science 2016-02-05 Anantharaman Palacode Narayana Iyer

Speaker identity plays a significant role in human communication and is being increasingly used in societal applications, many through advances in machine learning. Speaker identity perception is an essential cognitive phenomenon that can…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-18 Gasser Elbanna

Existing review-based recommendation methods usually use the same model to learn the representations of all users/items from reviews posted by users towards items. However, different users have different preference and different items have…

Information Retrieval · Computer Science 2019-05-31 Hongtao Liu , Fangzhao Wu , Wenjun Wang , Xianchen Wang , Pengfei Jiao , Chuhan Wu , Xing Xie

Neural networks are among the state-of-the-art techniques for language modeling. Existing neural language models typically map discrete words to distributed, dense vector representations. After information processing of the preceding…

Computation and Language · Computer Science 2016-10-14 Yunchuan Chen , Lili Mou , Yan Xu , Ge Li , Zhi Jin

This paper briefly reports our ongoing attempt at the development of a multi-platform browser-based speech recording system. We designed the system toward a service of providing open service of building large-scale speech corpora at a…

Human-Computer Interaction · Computer Science 2019-12-20 Keita Ishizuka , Takashi Nose

In this paper, we summarize recent progresses made in deep learning based acoustic models and the motivation and insights behind the surveyed techniques. We first discuss acoustic models that can effectively exploit variable-length…

Audio and Speech Processing · Electrical Eng. & Systems 2018-04-30 Dong Yu , Jinyu Li

As more information becomes available electronically, tools for finding information of interest to users becomes increasingly important. The goal of the research described here is to build a system for generating comprehensible user…

cmp-lg · Computer Science 2007-05-23 Eric Bloedorn , Inderjeet Mani , T. Richard MacMillan

The performance of Neural Network (NN)-based language models is steadily improving due to the emergence of new architectures, which are able to learn different natural language characteristics. This paper presents a novel framework, which…

Computation and Language · Computer Science 2017-08-24 Youssef Oualil , Dietrich Klakow

Endowing chatbots with a consistent personality plays a vital role for agents to deliver human-like interactions. However, existing personalized approaches commonly generate responses in light of static predefined personas depicted with…

Computation and Language · Computer Science 2022-08-24 Yifan Liu , Wei Wei , Jiayi Liu , Xianling Mao , Rui Fang , Dangyang Chen

Recurrent neural networks (RNNs) are very good at modelling the flow of text, but typically need to be trained on a far larger corpus than is available for the PAN 2015 Author Identification task. This paper describes a novel approach where…

Computation and Language · Computer Science 2016-08-17 Douglas Bagnall

Deep neural networks have shown recent promise in many language-related tasks such as the modeling of conversations. We extend RNN-based sequence to sequence models to capture the long range discourse across many turns of conversation. We…

Computation and Language · Computer Science 2016-07-18 John M. Pierre , Mark Butler , Jacob Portnoff , Luis Aguilar

Generating responses that are consistent with the dialogue context is one of the central challenges in building engaging conversational agents. We demonstrate that neural conversation models can be geared towards generating consistent…

Computation and Language · Computer Science 2021-08-13 Yizhe Zhang , Xiang Gao , Sungjin Lee , Chris Brockett , Michel Galley , Jianfeng Gao , Bill Dolan