English
Related papers

Related papers: On Multiplicative Multitask Feature Learning

200 papers

Representation learning seeks meaningful sensory representations without supervision and can model aspects of human development. Although many neural networks empirically learn useful features, a principled account of what makes a…

Machine Learning · Computer Science 2026-05-07 Takayuki Komatsu , Yoshiyuki Ohmura , Yasuo Kuniyoshi

We describe a framework for reformulating and solving optimization problems that generalizes the well-known framework originally introduced by Benders. We discuss details of the application of the procedures to several classes of…

Optimization and Control · Mathematics 2023-07-14 Suresh Bolusani , Ted K. Ralphs

One-class recognition is traditionally approached either as a representation learning problem or a feature modeling problem. In this work, we argue that both of these approaches have their own limitations; and a more effective solution can…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Pramuditha Perera , Vishal Patel

Typical multi-task learning (MTL) methods rely on architectural adjustments and a large trainable parameter set to jointly optimize over several tasks. However, when the number of tasks increases so do the complexity of the architectural…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

With the advent of kernel methods, automating the task of specifying a suitable kernel has become increasingly important. In this context, the Multiple Kernel Learning (MKL) problem of finding a combination of pre-specified base kernels…

Machine Learning · Computer Science 2012-07-03 Abhishek Kumar , Alexandru Niculescu-Mizil , Koray Kavukcuoglu , Hal Daume

The aim of multi-task reinforcement learning is two-fold: (1) efficiently learn by training against multiple tasks and (2) quickly adapt, using limited samples, to a variety of new tasks. In this work, the tasks correspond to reward…

Machine Learning · Computer Science 2019-11-05 Nicholas C. Landolfi , Garrett Thomas , Tengyu Ma

Nonlinear hyperspectral unmixing has recently received considerable attention, as linear mixture models do not lead to an acceptable resolution in some problems. In fact, most nonlinear unmixing methods are designed by assuming specific…

Image and Video Processing · Electrical Eng. & Systems 2024-02-07 Saeid Mehrdad , Seyed AmirHossein Janani

Meta-reinforcement learning algorithms can enable robots to acquire new skills much more quickly, by leveraging prior experience to learn how to learn. However, much of the current research on meta-reinforcement learning focuses on task…

In recent years, multi-task learning has turned out to be of great success in various applications. Though single model training has promised great results throughout these years, it ignores valuable information that might help us estimate…

Machine Learning · Computer Science 2022-09-28 Yeshwant Singh , Anupam Biswas , Angshuman Bora , Debashish Malakar , Subham Chakraborty , Suman Bera

Neural network models often generalize poorly to mismatched domains or distributions. In NLP, this issue arises in particular when models are expected to generalize compositionally, that is, to novel combinations of familiar words and…

Computation and Language · Computer Science 2021-11-10 Wang Zhu , Peter Shaw , Tal Linzen , Fei Sha

Single-image 3D shape reconstruction is an important and long-standing problem in computer vision. A plethora of existing works is constantly pushing the state-of-the-art performance in the deep learning era. However, there remains a much…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Songfang Han , Jiayuan Gu , Kaichun Mo , Li Yi , Siyu Hu , Xuejin Chen , Hao Su

This paper presents a novel information-theoretic perspective on generalization in machine learning by framing the learning problem within the context of lossy compression and applying finite blocklength analysis. In our approach, the…

Machine Learning · Computer Science 2026-02-05 Kosuke Sugiyama , Masato Uchida

A primary challenge for visual-based Reinforcement Learning (RL) is to generalize effectively across unseen environments. Although previous studies have explored different auxiliary tasks to enhance generalization, few adopt image…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Di Zhang , Bowen Lv , Hai Zhang , Feifan Yang , Junqiao Zhao , Hang Yu , Chang Huang , Hongtu Zhou , Chen Ye , Changjun Jiang

In computer simulation of the learning process is usually assumed that all elements of the training material are assimilated equally durable. But in practice, the knowledge, which a student uses in its operations, are remembered much…

Computers and Society · Computer Science 2013-12-20 Robert V Mayer

With the recent success of representation learning methods, which includes deep learning as a special case, there has been considerable interest in developing techniques that incorporate known physical constraints into the learned…

Machine Learning · Computer Science 2024-01-02 Harsha Vardhan Tetali , Joel B. Harley , Benjamin D. Haeffele

In many distributed learning problems, the heterogeneous loading of computing machines may harm the overall performance of synchronous strategies. In this paper, we propose an effective asynchronous distributed framework for the…

Machine Learning · Statistics 2017-05-23 Bikash Joshi , Franck Iutzeler , Massih-Reza Amini

Block-sparse regularization is already well-known in active thermal imaging and is used for multiple measurement based inverse problems. The main bottleneck of this method is the choice of regularization parameters which differs for each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Samim Ahmadi , Jan Christian Hauffen , Linh Kästner , Peter Jung , Giuseppe Caire , Mathias Ziegler

For argumentation mining, there are several sub-tasks such as argumentation component type classification, relation classification. Existing research tends to solve such sub-tasks separately, but ignore the close relation between them. In…

Computation and Language · Computer Science 2017-01-20 Zhongyu Wei , Chen Li , Yang Liu

Learning the similarity between images constitutes the foundation for numerous vision tasks. The common paradigm is discriminative metric learning, which seeks an embedding that separates different training classes. However, the main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Timo Milbich , Karsten Roth , Biagio Brattoli , Björn Ommer

Recovering the latent factors of variation of high dimensional data has so far focused on simple synthetic settings. Mostly building on unsupervised and weakly-supervised objectives, prior work missed out on the positive implications for…