English
Related papers

Related papers: Concept Transfer Learning for Adaptive Language Un…

200 papers

In the present paper we show that distributional information is particularly important when considering concept availability under implicit language learning conditions. Based on results from different behavioural experiments we argue that…

Computation and Language · Computer Science 2016-06-30 Dimitrios Alikaniotis , John N. Williams

Semantic communication, an intelligent communication paradigm that aims to transmit useful information in the semantic domain, is facilitated by deep learning techniques. Robust semantic features can be learned and transmitted in an analog…

Signal Processing · Electrical Eng. & Systems 2024-01-05 Lei Guo , Wei Chen , Yuxuan Sun , Bo Ai

In this paper, we introduce a novel interpreting framework that learns an interpretable model based on an ontology-based sampling technique to explain agnostic prediction models. Different from existing approaches, our algorithm considers…

Machine Learning · Computer Science 2020-04-02 Phung Lai , NhatHai Phan , Han Hu , Anuja Badeti , David Newman , Dejing Dou

Unsupervised domain adaptation without consuming annotation process for unlabeled target data attracts appealing interests in semantic segmentation. However, 1) existing methods neglect that not all semantic representations across domains…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jiahua Dong , Yang Cong , Gan Sun , Yuyang Liu , Xiaowei Xu

We propose a novel adaptive transfer learning framework, learning to transfer learn (L2TL), to improve performance on a target dataset by careful extraction of the related information from a source dataset. Our framework considers…

Machine Learning · Computer Science 2020-07-17 Linchao Zhu , Sercan O. Arik , Yi Yang , Tomas Pfister

This work investigates spoken language understanding (SLU) systems in the scenario when the semantic information is extracted directly from the speech signal by means of a single end-to-end neural network model. Two SLU tasks are…

Computation and Language · Computer Science 2019-10-29 Natalia Tomashenko , Antoine Caubriere , Yannick Esteve , Antoine Laurent , Emmanuel Morin

Hierarchical Multiscale LSTM (Chung et al., 2016a) is a state-of-the-art language model that learns interpretable structure from character-level input. Such models can provide fertile ground for (cognitive) computational linguistics…

Computation and Language · Computer Science 2018-07-11 Ákos Kádár , Marc-Alexandre Côté , Grzegorz Chrupała , Afra Alishahi

Transfer Learning (TL) offers the potential to accelerate learning by transferring knowledge across tasks. However, it faces critical challenges such as negative transfer, domain adaptation and inefficiency in selecting solid source…

Machine Learning · Computer Science 2025-07-29 Alessandro Capurso , Elia Piccoli , Davide Bacciu

End-to-end Spoken Language Understanding (SLU) models are made increasingly large and complex to achieve the state-ofthe-art accuracy. However, the increased complexity of a model can also introduce high risk of over-fitting, which is a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Xueli Jia , Jianzong Wang , Zhiyong Zhang , Ning Cheng , Jing Xiao

Knowledge sharing is crucial in healthcare, especially when leveraging data from multiple clinical sites to address data scarcity, reduce costs, and enable timely interventions. Transfer learning can facilitate cross-site knowledge…

Computation and Language · Computer Science 2024-09-24 Yuhe Gao , Runxue Bao , Yuelyu Ji , Yiming Sun , Chenxi Song , Jeffrey P. Ferraro , Ye Ye

We propose a novel framework ConceptX, to analyze how latent concepts are encoded in representations learned within pre-trained language models. It uses clustering to discover the encoded concepts and explains them by aligning with a large…

Computation and Language · Computer Science 2022-06-28 Hassan Sajjad , Nadir Durrani , Fahim Dalvi , Firoj Alam , Abdul Rafae Khan , Jia Xu

Sentiment analysis is known as one of the most crucial tasks in the field of natural language processing and Convolutional Neural Network (CNN) is one of those prominent models that is commonly used for this aim. Although convolutional…

Computation and Language · Computer Science 2021-02-24 Hossein Sadr , Mozhdeh Nazari Solimandarabi , Mir Mohsen Pedram , Mohammad Teshnehlab

We present an end-to-end approach to extract semantic concepts directly from the speech audio signal. To overcome the lack of data available for this spoken language understanding approach, we investigate the use of a transfer learning…

Computation and Language · Computer Science 2019-06-19 Antoine Caubrière , Natalia Tomashenko , Antoine Laurent , Emmanuel Morin , Nathalie Camelin , Yannick Estève

With the popularity of deep neural networks (DNNs), model interpretability is becoming a critical concern. Many approaches have been developed to tackle the problem through post-hoc analysis, such as explaining how predictions are made or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Haixing Dai , Lu Zhang , Lin Zhao , Zihao Wu , Zhengliang Liu , David Liu , Xiaowei Yu , Yanjun Lyu , Changying Li , Ninghao Liu , Tianming Liu , Dajiang Zhu

Natural language understanding (NLU) has made massive progress driven by large benchmarks, but benchmarks often leave a long tail of infrequent phenomena underrepresented. We reflect on the question: have transfer learning methods…

Computation and Language · Computer Science 2022-06-07 Aakanksha Naik , Jill Lehman , Carolyn Rose

Attribute based knowledge transfer has proven very successful in visual object analysis and learning previously unseen classes. However, the common approach learns and transfers attributes without taking into consideration the embedded…

Computer Vision and Pattern Recognition · Computer Science 2016-04-04 Ziad Al-Halah , Rainer Stiefelhagen

Cross-lingual knowledge transfer is critical for building high-performing multilingual language models for languages with insufficient training data. When target language data is scarce, the knowledge required for many downstream tasks…

Computation and Language · Computer Science 2026-05-25 Anastasiia Sedova , Natalie Schluter , Skyler Seto , Maartje ter Hoeve

Simultaneous Machine Translation (SiMT) requires high-quality translations under strict real-time constraints, which traditional policies with only READ/WRITE actions cannot fully address. We extend the action space of SiMT with four…

Computation and Language · Computer Science 2026-01-19 Qianen Zhang , Zeyu Yang , Satoshi Nakamura

While different neural models often exhibit latent spaces that are alike when exposed to semantically related data, this intrinsic similarity is not always immediately discernible. Towards a better understanding of this phenomenon, our work…

Machine Learning · Computer Science 2024-02-13 Valentino Maiorca , Luca Moschella , Antonio Norelli , Marco Fumero , Francesco Locatello , Emanuele Rodolà

Cross-lingual semantic textual similarity systems estimate the degree of the meaning similarity between two sentences, each in a different language. State-of-the-art algorithms usually employ machine translation and combine vast amount of…

Computation and Language · Computer Science 2018-07-12 Tomáš Brychcín