English
Related papers

Related papers: A Convex Feature Learning Formulation for Latent T…

200 papers

Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks…

Machine Learning · Computer Science 2017-06-21 Sulin Liu , Sinno Jialin Pan , Qirong Ho

We propose a novel problem formulation of learning a single task when the data are provided in different feature spaces. Each such space is called an outlook, and is assumed to contain both labeled and unlabeled data. The objective is to…

Machine Learning · Computer Science 2011-06-15 Maayan Harel , Shie Mannor

Over recent decades have witnessed considerable progress in whether multi-task learning or multi-view learning, but the situation that consider both learning scenes simultaneously has received not too much attention. How to utilize multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Run-kun Lu , Jian-wei Liu , Si-ming Lian , Xin Zuo

Low-rank learning has attracted much attention recently due to its efficacy in a rich variety of real-world tasks, e.g., subspace segmentation and image categorization. Most low-rank methods are incapable of capturing low-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 Ping Li , Jun Yu , Meng Wang , Luming Zhang , Deng Cai , Xuelong Li

Continual learning algorithms which keep the parameters of new tasks close to that of previous tasks, are popular in preventing catastrophic forgetting in sequential task learning settings. However, 1) the performance for the new continual…

Machine Learning · Computer Science 2023-07-21 Wei Cong , Yang Cong , Gan Sun , Yuyang Liu , Jiahua Dong

Convex regularizers are often used for sparse learning. They are easy to optimize, but can lead to inferior prediction performance. The difference of $\ell_1$ and $\ell_2$ ($\ell_{1-2}$) regularizer has been recently proposed as a nonconvex…

Machine Learning · Computer Science 2017-06-21 Quanming Yao , James T. Kwok , Xiawei Guo

Identifying statistical regularities in solutions to some tasks in multi-task reinforcement learning can accelerate the learning of new tasks. Skill learning offers one way of identifying these regularities by decomposing pre-collected…

Machine Learning · Computer Science 2022-12-12 Yiding Jiang , Evan Zheran Liu , Benjamin Eysenbach , Zico Kolter , Chelsea Finn

We consider the two problems of predicting links in a dynamic graph sequence and predicting functions defined at each node of the graph. In many applications, the solution of one problem is useful for solving the other. Indeed, if these…

Machine Learning · Computer Science 2012-03-27 Emile Richard , Andreas Argyriou , Theodoros Evgeniou , Nicolas Vayatis

Recent work in signal processing and statistics have focused on defining new regularization functions, which not only induce sparsity of the solution, but also take into account the structure of the problem. We present in this paper a class…

Machine Learning · Computer Science 2011-10-21 Julien Mairal , Rodolphe Jenatton , Guillaume Obozinski , Francis Bach

Deep networks are an integral part of the current machine learning paradigm. Their inherent ability to learn complex functional mappings between data and various target variables, while discovering hidden, task-driven features, makes them a…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Riddhish Bhalodia , Shireen Elhabian , Ladislav Kavan , Ross Whitaker

Modern decision-making scenarios often involve data that is both high-dimensional and rich in higher-order contextual information, where existing bandits algorithms fail to generate effective policies. In response, we propose in this paper…

Machine Learning · Computer Science 2025-01-24 Jiannan Li , Yiyang Yang , Yao Wang , Shaojie Tang

Training a fine-grained image recognition model with limited data presents a significant challenge, as the subtle differences between categories may not be easily discernible amidst distracting noise patterns. One commonly employed strategy…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Avraham Chapman , Haiming Xu , Lingqiao Liu

Low-rank matrix recovery is a fundamental problem in signal processing and machine learning. A recent very popular approach to recovering a low-rank matrix X is to factorize it as a product of two smaller matrices, i.e., X = UV^T, and then…

Optimization and Control · Mathematics 2023-07-19 Shuang Li , Qiuwei Li , Zhihui Zhu , Gongguo Tang , Michael B. Wakin

This paper provides a set of sensitivity analysis and activity identification results for a class of convex functions with a strong geometric structure, that we coined "mirror-stratifiable". These functions are such that there is a…

Optimization and Control · Mathematics 2018-06-06 Jalal Fadili , Jérôme Malick , Gabriel Peyré

In this paper, we develop a randomized algorithm and theory for learning a sparse model from large-scale and high-dimensional data, which is usually formulated as an empirical risk minimization problem with a sparsity-inducing regularizer.…

Machine Learning · Computer Science 2016-10-18 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find…

Machine Learning · Statistics 2018-11-20 Sebastian Ruder , Joachim Bingel , Isabelle Augenstein , Anders Søgaard

As people's aesthetic preferences for images are far from understood, image aesthetic assessment is a challenging artificial intelligence task. The range of factors underlying this task is almost unlimited, but we know that some aesthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Derya Soydaner , Johan Wagemans

The ability of deep networks to learn superior representations hinges on leveraging the proper inductive biases, considering the inherent properties of datasets. In tabular domains, it is critical to effectively handle heterogeneous…

Machine Learning · Computer Science 2024-05-15 Kyungeun Lee , Ye Seul Sim , Hye-Seung Cho , Moonjung Eo , Suhee Yoon , Sanghyu Yoon , Woohyung Lim

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

In many learning settings, it is beneficial to augment the main features with pairwise interactions. Such interaction models can be often enhanced by performing variable selection under the so-called strong hierarchy constraint: an…

Machine Learning · Statistics 2020-07-15 Hussein Hazimeh , Rahul Mazumder