English
Related papers

Related papers: TaskDrop: A Competitive Baseline for Continual Lea…

200 papers

Most domain adaptation methods focus on single-source-single-target adaptation settings. Multi-target domain adaptation is a powerful extension in which a single classifier is learned for multiple unlabeled target domains. To build a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Sudipan Saha , Shan Zhao , Nasrullah Sheikh , Xiao Xiang Zhu

Text classification has long been a staple within Natural Language Processing (NLP) with applications spanning across diverse areas such as sentiment analysis, recommender systems and spam detection. With such a powerful solution, it is…

Computation and Language · Computer Science 2021-12-06 Amir Atapour-Abarghouei , Stephen Bonner , Andrew Stephen McGough

Domain adaptation is important in sentiment analysis as sentiment-indicating words vary between domains. Recently, multi-domain adaptation has become more pervasive, but existing approaches train on all available source domains including…

Computation and Language · Computer Science 2017-02-09 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

Traditional machine learning assumes a stationary data distribution, yet many real-world applications operate on nonstationary streams in which the underlying concept evolves over time. This problem can also be viewed as task-free continual…

Machine Learning · Computer Science 2026-03-17 Michal Wozniak , Marek Klonowski , Maciej Maczynski , Bartosz Krawczyk

Dropout is a simple but efficient regularization technique for achieving better generalization of deep neural networks (DNNs); hence it is widely used in tasks based on DNNs. During training, dropout randomly discards a portion of the…

Neural and Evolutionary Computing · Computer Science 2020-10-22 Hiroshi Inoue

In this study, we develop a method for multi-task manifold learning. The method aims to improve the performance of manifold learning for multiple tasks, particularly when each task has a small number of samples. Furthermore, the method also…

Machine Learning · Computer Science 2021-11-25 Hideaki Ishibashi , Kazushi Higa , Tetsuo Furukawa

Aspect term extraction is a fundamental task in fine-grained sentiment analysis, which aims at detecting customer's opinion targets from reviews on product or service. The traditional supervised models can achieve promising results with…

Computation and Language · Computer Science 2023-03-03 Jingli Shi , Weihua Li , Quan Bai , Yi Yang , Jianhua Jiang

Multitask learning assumes that models capable of learning from multiple tasks can achieve better quality and efficiency via knowledge transfer, a key feature of human learning. Though, state of the art ML models rely on high customization…

Machine Learning · Computer Science 2022-11-17 Andrea Gesmundo , Jeff Dean

When an agent encounters a continual stream of new tasks in the lifelong learning setting, it leverages the knowledge it gained from the earlier tasks to help learn the new tasks better. In such a scenario, identifying an efficient…

Machine Learning · Computer Science 2022-08-31 Pranshu Malviya , Balaraman Ravindran , Sarath Chandar

Targeted Sentiment Analysis (TSA) is a central task for generating insights from consumer reviews. Such content is extremely diverse, with sites like Amazon or Yelp containing reviews on products and businesses from many different domains.…

Computation and Language · Computer Science 2022-05-10 Orith Toledo-Ronen , Matan Orbach , Yoav Katz , Noam Slonim

Detecting what emotions are expressed in text is a well-studied problem in natural language processing. However, research on finer grained emotion analysis such as what causes an emotion is still in its infancy. We present solutions that…

Computation and Language · Computer Science 2021-06-21 Elsbeth Turcan , Shuai Wang , Rishita Anubhai , Kasturi Bhattacharjee , Yaser Al-Onaizan , Smaranda Muresan

Sequential sentence classification deals with the categorisation of sentences based on their content and context. Applied to scientific texts, it enables the automatic structuring of research papers and the improvement of academic search…

Computation and Language · Computer Science 2022-03-22 Arthur Brack , Anett Hoppe , Pascal Buschermöhle , Ralph Ewerth

Curriculum Learning (CL) is the idea that learning on a training set sequenced or ordered in a manner where samples range from easy to difficult, results in an increment in performance over otherwise random ordering. The idea parallels…

Computation and Language · Computer Science 2020-07-23 Vijjini Anvesh Rao , Kaveri Anuranjana , Radhika Mamidi

The training of deep-learning-based text classification models relies heavily on a huge amount of annotation data, which is difficult to obtain. When the labeled data is scarce, models tend to struggle to achieve satisfactory performance.…

Computation and Language · Computer Science 2020-04-07 Dianbo Sui , Yubo Chen , Binjie Mao , Delai Qiu , Kang Liu , Jun Zhao

In multi-label learning, a particular case of multi-task learning where a single data point is associated with multiple target labels, it was widely assumed in the literature that, to obtain best accuracy, the dependence among the labels…

Machine Learning · Computer Science 2022-07-26 Jesse Read

In continuing tasks, average-reward reinforcement learning may be a more appropriate problem formulation than the more common discounted reward formulation. As usual, learning an optimal policy in this setting typically requires a large…

Artificial Intelligence · Computer Science 2023-01-18 Yuqian Jiang , Sudarshanan Bharadwaj , Bo Wu , Rishi Shah , Ufuk Topcu , Peter Stone

Recently the emergence of novel presentation attacks has drawn increasing attention to face anti-spoofing. However, existing methods tend to memorize data patterns from the training set, resulting in poor generalization to unknown attack…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Fangling Jiang , Qi Li , Weining Wang , Gang Wang , Bing Liu , Zhenan Sun

Sentiment analysis is a common task in natural language processing that aims to detect polarity of a text document (typically a consumer review). In the simplest settings, we discriminate only between positive and negative sentiment,…

Computation and Language · Computer Science 2015-05-28 Grégoire Mesnil , Tomas Mikolov , Marc'Aurelio Ranzato , Yoshua Bengio

Large language models (LLMs) with reasoning capabilities have fueled a compelling narrative that reasoning universally improves performance across language tasks. We test this claim through a comprehensive evaluation of 504 configurations…

Computation and Language · Computer Science 2026-03-02 Donghao Huang , Zhaoxia Wang

We investigate task clustering for deep-learning based multi-task and few-shot learning in a many-task setting. We propose a new method to measure task similarities with cross-task transfer performance matrix for the deep learning scenario.…

Machine Learning · Computer Science 2018-05-21 Mo Yu , Xiaoxiao Guo , Jinfeng Yi , Shiyu Chang , Saloni Potdar , Gerald Tesauro , Haoyu Wang , Bowen Zhou