English
Related papers

Related papers: Learning Tensor Representations for Meta-Learning

200 papers

Meta-learning has proven to be successful for few-shot learning across the regression, classification, and reinforcement learning paradigms. Recent approaches have adopted Bayesian interpretations to improve gradient-based meta-learners by…

Machine Learning · Computer Science 2020-12-01 Amrith Setlur , Saket Dingliwal , Barnabas Poczos

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising approach towards…

Nowadays, with the availability of massive amount of trade data collected, the dynamics of the financial markets pose both a challenge and an opportunity for high frequency traders. In order to take advantage of the rapid, subtle movement…

Computational Engineering, Finance, and Science · Computer Science 2018-07-06 Dat Thanh Tran , Martin Magris , Juho Kanniainen , Moncef Gabbouj , Alexandros Iosifidis

We consider the problem of distributed multi-task learning, where each machine learns a separate, but related, task. Specifically, each machine learns a linear predictor in high-dimensional space,where all tasks share the same small…

Machine Learning · Statistics 2015-10-05 Jialei Wang , Mladen Kolar , Nathan Srebro

This paper studies a tensor-structured linear regression model with a scalar response variable and tensor-structured predictors, such that the regression parameters form a tensor of order $d$ (i.e., a $d$-fold multiway array) in…

Machine Learning · Computer Science 2020-11-26 Talal Ahmed , Haroon Raja , Waheed U. Bajwa

In computer vision, pre-training models based on largescale supervised learning have been proven effective over the past few years. However, existing works mostly focus on learning from individual task with single data source (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yinan He , Gengshi Huang , Siyu Chen , Jianing Teng , Wang Kun , Zhenfei Yin , Lu Sheng , Ziwei Liu , Yu Qiao , Jing Shao

The goal of meta-learning is to train a model on a variety of learning tasks, such that it can adapt to new problems within only a few iterations. Here we propose a principled information-theoretic model that optimally partitions the…

Machine Learning · Statistics 2020-09-10 Heinke Hihn , Daniel A. Braun

Meta-learning consists in learning learning algorithms. We use a Long Short Term Memory (LSTM) based network to learn to compute on-line updates of the parameters of another neural network. These parameters are stored in the cell state of…

Machine Learning · Computer Science 2016-10-20 Tom Bosc

We consider the problem of the estimation of a high-dimensional probability distribution from i.i.d. samples of the distribution using model classes of functions in tree-based tensor formats, a particular case of tensor networks associated…

Machine Learning · Statistics 2021-05-21 Erwan Grelier , Anthony Nouy , Régis Lebrun

This paper presents a meta-learning based, automatic distribution system load forecasting model selection framework. The framework includes the following processes: feature extraction, candidate model labeling, offline training, and online…

Systems and Control · Electrical Eng. & Systems 2021-04-19 Yiyan Li , Si Zhang , Rongxing Hu , Ning Lu

The vast majority of work in self-supervised learning, both theoretical and empirical (though mostly the latter), have largely focused on recovering good features for downstream tasks, with the definition of "good" often being intricately…

Machine Learning · Computer Science 2022-02-21 Bingbin Liu , Daniel Hsu , Pradeep Ravikumar , Andrej Risteski

We develop a metalearning approach for learning hierarchically structured policies, improving sample efficiency on unseen tasks through the use of shared primitives---policies that are executed for large numbers of timesteps. Specifically,…

Machine Learning · Computer Science 2017-10-27 Kevin Frans , Jonathan Ho , Xi Chen , Pieter Abbeel , John Schulman

Meta-learning represents a strong class of approaches for solving few-shot learning tasks. Nonetheless, recent research suggests that simply pre-training a generic encoder can potentially surpass meta-learning algorithms. In this paper, we…

Machine Learning · Computer Science 2025-03-14 Wei Cui , Tongzi Wu , Jesse C. Cresswell , Yi Sui , Keyvan Golestan

In this report we review memory-based meta-learning as a tool for building sample-efficient strategies that learn from past experience to adapt to any task within a target class. Our goal is to equip the reader with the conceptual…

Multi-mode tensor time series (TTS) can be found in many domains, such as search engines and environmental monitoring systems. Learning representations of a TTS benefits various applications, but it is also challenging since the…

Machine Learning · Computer Science 2026-03-02 Kohei Obata , Taichi Murayama , Zheng Chen , Yasuko Matsubara , Yasushi Sakurai

Meta-learning, or learning to learn, is a machine learning approach that utilizes prior learning experiences to expedite the learning process on unseen tasks. As a data-driven approach, meta-learning requires meta-features that represent…

Machine Learning · Computer Science 2021-01-12 Hadi S. Jomaa , Lars Schmidt-Thieme , Josif Grabocka

Learning a sequence of tasks without access to i.i.d. observations is a widely studied form of continual learning (CL) that remains challenging. In principle, Bayesian learning directly applies to this setting, since recursive and one-off…

The advancement of sensing technology has driven the widespread application of high-dimensional data. However, issues such as missing entries during acquisition and transmission negatively impact the accuracy of subsequent tasks. Tensor…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Jie Yang , Chang Su , Yuhan Zhang , Jianjun Zhu , Jianli Wang

Beyond their origin in modeling many-body quantum systems, tensor networks have emerged as a promising class of models for solving machine learning problems, notably in unsupervised generative learning. While possessing many desirable…

Machine Learning · Computer Science 2024-07-26 Alex Meiburg , Jing Chen , Jacob Miller , Raphaëlle Tihon , Guillaume Rabusseau , Alejandro Perdomo-Ortiz

Current meta-learning approaches focus on learning functional representations of relationships between variables, i.e. on estimating conditional expectations in regression. In many applications, however, we are faced with conditional…

Machine Learning · Statistics 2021-02-25 Jean-Francois Ton , Lucian Chan , Yee Whye Teh , Dino Sejdinovic