English
Related papers

Related papers: Scoring Lexical Entailment with a Supervised Direc…

200 papers

In human learning, it is common to use multiple sources of information jointly. However, most existing feature learning approaches learn from only a single task. In this paper, we propose a novel multi-task deep network to learn…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Zhongzheng Ren , Yong Jae Lee

Learning semantically meaningful sentence embeddings is an open problem in natural language processing. In this work, we propose a sentence embedding learning approach that exploits both visual and textual information via a multimodal…

Computation and Language · Computer Science 2022-04-26 Miaoran Zhang , Marius Mosbach , David Ifeoluwa Adelani , Michael A. Hedderich , Dietrich Klakow

Human adaptability relies crucially on learning and merging knowledge from both supervised and unsupervised tasks: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Silvia Bucci , Antonio D'Innocente , Yujun Liao , Fabio Maria Carlucci , Barbara Caputo , Tatiana Tommasi

Modern neural networks (NNs), trained on extensive raw sentence data, construct distributed representations by compressing individual words into dense, continuous, high-dimensional vectors. These representations are expected to capture…

Computation and Language · Computer Science 2024-12-04 Zhu Liu

Neural network models often generalize poorly to mismatched domains or distributions. In NLP, this issue arises in particular when models are expected to generalize compositionally, that is, to novel combinations of familiar words and…

Computation and Language · Computer Science 2021-11-10 Wang Zhu , Peter Shaw , Tal Linzen , Fei Sha

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

As the cornerstone of other important technologies, such as speech recognition and speech synthesis, speech enhancement is a critical area in audio signal processing. In this paper, a new deep learning structure for speech enhancement is…

Sound · Computer Science 2021-08-30 Yuzi Yan , Wei-Qiang Zhang , Michael T. Johnson

Stacking-based deep neural network (S-DNN), in general, denotes a deep neural network (DNN) resemblance in terms of its very deep, feedforward network architecture. The typical S-DNN aggregates a variable number of individually learnable…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Cheng-Yaw Low , Andrew Beng-Jin Teoh

The paper proposes the ScatterNet Hybrid Deep Learning (SHDL) network that extracts invariant and discriminative image representations for object recognition. SHDL framework is constructed with a multi-layer ScatterNet front-end, an…

Computer Vision and Pattern Recognition · Computer Science 2017-08-31 Amarjot Singh , Nick Kingsbury

In this paper, we propose Double Supervised Network with Attention Mechanism (DSAN), a novel end-to-end trainable framework for scene text recognition. It incorporates one text attention module during feature extraction which enforces the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Yuting Gao , Zheng Huang , Yuchen Dai , Cheng Xu , Kai Chen , Jie Tuo

Semantic edge detection (SED), which aims at jointly extracting edges as well as their category information, has far-reaching applications in domains such as semantic segmentation, object proposal generation, and object recognition. SED…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Yun Liu , Ming-Ming Cheng , Deng-Ping Fan , Le Zhang , JiaWang Bian , Dacheng Tao

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Understanding human language is one of the key themes of artificial intelligence. For language representation, the capacity of effectively modeling the linguistic knowledge from the detail-riddled and lengthy texts and getting rid of the…

Computation and Language · Computer Science 2021-01-08 Zhuosheng Zhang , Yuwei Wu , Junru Zhou , Sufeng Duan , Hai Zhao , Rui Wang

Higher-order features bring significant accuracy gains in semantic dependency parsing. However, modeling higher-order features with exact inference is NP-hard. Graph neural networks (GNNs) have been demonstrated to be an effective tool for…

Computation and Language · Computer Science 2022-01-28 Bin Li , Yunlong Fan , Yikemaiti Sataer , Zhiqiang Gao

While supervised learning models have shown remarkable performance in various natural language processing (NLP) tasks, their success heavily relies on the availability of large-scale labeled datasets, which can be costly and time-consuming…

Computation and Language · Computer Science 2024-06-04 Wrick Talukdar , Anjanava Biswas

In this paper, we propose supervised dictionary learning (SDL) by incorporating information on class labels into the learning of the dictionary. To this end, we propose to learn the dictionary in a space where the dependency between the…

Computer Vision and Pattern Recognition · Computer Science 2013-11-27 Mehrdad J. Gangeh , Ali Ghodsi , Mohamed S. Kamel

This paper describes our system (HIT-SCIR) submitted to the CoNLL 2018 shared task on Multilingual Parsing from Raw Text to Universal Dependencies. We base our submission on Stanford's winning system for the CoNLL 2017 shared task and make…

Computation and Language · Computer Science 2018-07-31 Wanxiang Che , Yijia Liu , Yuxuan Wang , Bo Zheng , Ting Liu

We combine multi-task learning and semi-supervised learning by inducing a joint embedding space between disparate label spaces and learning transfer functions between label embeddings, enabling us to jointly leverage unlabelled data and…

Computation and Language · Computer Science 2018-04-10 Isabelle Augenstein , Sebastian Ruder , Anders Søgaard

In this paper, we applied a novel learning algorithm, namely, Deep Belief Networks (DBN) to word sense disambiguation (WSD). DBN is a probabilistic generative model composed of multiple layers of hidden units. DBN uses Restricted Boltzmann…

Computation and Language · Computer Science 2012-07-03 Peratham Wiriyathammabhum , Boonserm Kijsirikul , Hiroya Takamura , Manabu Okumura

This paper proposes a novel pixel-level distribution regularization scheme (DRSL) for self-supervised domain adaptation of semantic segmentation. In a typical setting, the classification loss forces the semantic segmentation model to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Javed Iqbal , Hamza Rawal , Rehan Hafiz , Yu-Tseh Chi , Mohsen Ali