中文
相关论文

相关论文: A Generalized Recurrent Neural Architecture for Te…

200 篇论文

Recurrent Neural Network (RNN) is one of the most popular architectures used in Natural Language Processsing (NLP) tasks because its recurrent structure is very suitable to process variable-length text. RNN can utilize distributed…

计算与语言 · 计算机科学 2016-11-22 Peng Zhou , Zhenyu Qi , Suncong Zheng , Jiaming Xu , Hongyun Bao , Bo Xu

Deep neural networks have become a standard building block for designing models that can perform multiple dense computer vision tasks such as depth estimation and semantic segmentation thanks to their ability to capture complex correlations…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Wei-Hong Li , Steven McDonagh , Ales Leonardis , Hakan Bilen

We develop new algorithms for simultaneous learning of multiple tasks (e.g., image classification, depth estimation), and for adapting to unseen task/domain distributions within those high-level tasks (e.g., different environments). First,…

机器学习 · 计算机科学 2020-06-16 Kiran Lekkala , Laurent Itti

Countless learning tasks require dealing with sequential data. Image captioning, speech synthesis, and music generation all require that a model produce outputs that are sequences. In other domains, such as time series prediction, video…

机器学习 · 计算机科学 2015-10-20 Zachary C. Lipton , John Berkowitz , Charles Elkan

Modern discriminative predictors have been shown to match natural intelligences in specific perceptual tasks in image classification, object and part detection, boundary extraction, etc. However, a major advantage that natural intelligences…

机器学习 · 统计学 2016-11-30 Hakan Bilen , Andrea Vedaldi

Similarity-based method gives rise to a new class of methods for multi-label learning and also achieves promising performance. In this paper, we generalize this method, resulting in a new framework for classification task. Specifically, we…

机器学习 · 计算机科学 2022-03-08 Zhongchen Ma , Songcan Chen

In this work we present a novel recurrent neural network architecture designed to model systems characterized by multiple characteristic timescales in their dynamics. The proposed network is composed by several recurrent groups of neurons…

神经与进化计算 · 计算机科学 2017-01-19 Filippo Maria Bianchi , Michael Kampffmeyer , Enrico Maiorino , Robert Jenssen

Rich semantic relations are important in a variety of visual recognition problems. As a concrete example, group activity recognition involves the interactions and relative spatial relations of a set of people in a scene. State of the art…

计算机视觉与模式识别 · 计算机科学 2016-04-13 Zhiwei Deng , Arash Vahdat , Hexiang Hu , Greg Mori

Multi-Task Learning (MTL) is a learning paradigm in machine learning and its aim is to leverage useful information contained in multiple related tasks to help improve the generalization performance of all the tasks. In this paper, we give a…

机器学习 · 计算机科学 2021-03-30 Yu Zhang , Qiang Yang

We address the task of assessing discourse coherence, an aspect of text quality that is essential for many NLP tasks, such as summarization and language assessment. We propose a hierarchical neural network trained in a multi-task fashion…

计算与语言 · 计算机科学 2020-05-01 Youmna Farag , Helen Yannakoudakis

Additive models form a widely popular class of regression models which represent the relation between covariates and response variables as the sum of low-dimensional transfer functions. Besides flexibility and accuracy, a key benefit of…

机器学习 · 统计学 2015-05-20 Alhussein Fawzi , Mathieu Sinn , Pascal Frossard

This study aims to explore the performance improvement method of large language models based on GPT-4 under the multi-task learning framework and conducts experiments on two tasks: text classification and automatic summary generation.…

计算与语言 · 计算机科学 2024-12-10 Zhen Qi , Jiajing Chen , Shuo Wang , Bingying Liu , Hongye Zheng , Chihang Wang

Learning distributed sentence representations is one of the key challenges in natural language processing. Previous work demonstrated that a recurrent neural network (RNNs) based sentence encoder trained on a large collection of annotated…

计算与语言 · 计算机科学 2018-08-20 Wasi Uddin Ahmad , Xueying Bai , Zhechao Huang , Chao Jiang , Nanyun Peng , Kai-Wei Chang

Multimedia applications often require concurrent solutions to multiple tasks. These tasks hold clues to each-others solutions, however as these relations can be complex this remains a rarely utilized property. When task relations are…

计算机视觉与模式识别 · 计算机科学 2019-04-08 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

In this paper, we present a new MTL framework that searches for structures optimized for multiple tasks with diverse graph topologies and shares features among tasks. We design a restricted DAG-based central network with read-in/read-out…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Wonhyeok Choi , Sunghoon Im

Retrieving relevant contexts from a large corpus is a crucial step for tasks such as open-domain question answering and fact checking. Although neural retrieval outperforms traditional methods like tf-idf and BM25, its performance degrades…

计算与语言 · 计算机科学 2021-01-05 Jean Maillard , Vladimir Karpukhin , Fabio Petroni , Wen-tau Yih , Barlas Oğuz , Veselin Stoyanov , Gargi Ghosh

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

机器学习 · 计算机科学 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

We present methods for multi-task learning that take advantage of natural groupings of related tasks. Task groups may be defined along known properties of the tasks, such as task domain or language. Such task groups represent supervised…

计算与语言 · 计算机科学 2019-07-04 Shiva Pentyala , Mengwen Liu , Markus Dreyer

Multitask learning is a common approach in machine learning, which allows to train multiple objectives with a shared architecture. It has been shown that by training multiple tasks together inference time and compute resources can be saved,…

计算机视觉与模式识别 · 计算机科学 2021-09-13 Falk Heuer , Sven Mantowsky , Syed Saqib Bukhari , Georg Schneider

This paper proposes a novel framework for recurrent neural networks (RNNs) inspired by the human memory models in the field of cognitive neuroscience to enhance information processing and transmission between adjacent RNNs' units. The…

神经与进化计算 · 计算机科学 2018-06-05 Xi Chen , Zhihong Deng , Gehui Shen , Ting Huang