English
Related papers

Related papers: Learning Tensor Representations for Meta-Learning

200 papers

This thesis focuses on representation learning for sequence data over time or space, aiming to improve downstream sequence prediction tasks by using the learned representations. Supervised learning has been the most dominant approach for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-02 Qingming Tang

Latent class models are powerful statistical modeling tools widely used in psychological, behavioral, and social sciences. In the modern era of data science, researchers often have access to response data collected from large-scale surveys…

Methodology · Statistics 2025-01-08 Zhenghao Zeng , Yuqi Gu , Gongjun Xu

Recent progress in AutoML has lead to state-of-the-art methods (e.g., AutoSKLearn) that can be readily used by non-experts to approach any supervised learning problem. Whereas these methods are quite effective, they are still limited in the…

Machine Learning · Computer Science 2019-07-23 Jorge Madrid , Hugo Jair Escalante , Eduardo Morales

In this work, we present tensor-based linear and nonlinear models for hyperspectral data classification and analysis. By exploiting principles of tensor algebra, we introduce new classification architectures, the weight parameters of which…

Computer Vision and Pattern Recognition · Computer Science 2018-12-26 Konstantinos Makantasis , Anastasios Doulamis , Nikolaos Doulamis , Antonis Nikitakis

A key property of neural networks (both biological and artificial) is how they learn to represent and manipulate input information in order to solve a task. Different types of representations may be suited to different types of tasks,…

Machine Learning · Computer Science 2023-07-18 Ryan Pyle , Sebastian Musslick , Jonathan D. Cohen , Ankit B. Patel

Learning-to-learn or meta-learning leverages data-driven inductive bias to increase the efficiency of learning on a novel task. This approach encounters difficulty when transfer is not advantageous, for instance, when tasks are considerably…

Machine Learning · Computer Science 2019-06-20 Ghassen Jerfel , Erin Grant , Thomas L. Griffiths , Katherine Heller

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Recent years have witnessed an abundance of new publications and approaches on meta-learning. This community-wide enthusiasm has sparked great insights but has also created a plethora of seemingly different frameworks, which can be hard to…

Machine Learning · Computer Science 2020-02-04 Wei-Lun Chao , Han-Jia Ye , De-Chuan Zhan , Mark Campbell , Kilian Q. Weinberger

Recent advances in sensing technologies require the design and development of pattern recognition models capable of processing spatiotemporal data efficiently. In this study, we propose a spatially and temporally aware tensor-based neural…

Deep learning has achieved remarkable success in many machine learning tasks such as image classification, speech recognition, and game playing. However, these breakthroughs are often difficult to translate into real-world engineering…

Machine Learning · Computer Science 2022-10-07 Lisha Chen , Sharu Theresa Jose , Ivana Nikoloska , Sangwoo Park , Tianyi Chen , Osvaldo Simeone

In this paper, we propose a novel tensor learning and coding model for third-order data completion. Our model is to learn a data-adaptive dictionary from the given observations, and determine the coding coefficients of third-order tensor…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Tai-Xiang Jiang , Xi-Le Zhao , Hao Zhang , Michael K. Ng

In this paper, we introduce a type of tensor neural network based machine learning method to solve elliptic multiscale problems. Based on the special structure, we can do the direct and highly accurate high dimensional integrations for the…

Numerical Analysis · Mathematics 2024-03-26 Zhongshuo Lin , Haochen Liu , Hehu Xie

This work extends the theory of identifiability in supervised learning by considering the consequences of having access to a distribution of tasks. In such cases, we show that linear identifiability is achievable in the general multi-task…

Machine Learning · Statistics 2024-08-26 Wenlin Chen , Julien Horwood , Juyeon Heo , José Miguel Hernández-Lobato

We provide new statistical guarantees for transfer learning via representation learning--when transfer is achieved by learning a feature representation shared across different tasks. This enables learning on new tasks using far less data…

Machine Learning · Computer Science 2020-10-23 Nilesh Tripuraneni , Michael I. Jordan , Chi Jin

The prominence of deep learning, large amount of annotated data and increasingly powerful hardware made it possible to reach remarkable performance for supervised classification tasks, in many cases saturating the training sets. However the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Adrian Bulat , Jean Kossaifi , Georgios Tzimiropoulos , Maja Pantic

Latent representation learned from multi-layered neural networks via hierarchical feature abstraction enables recent success of deep learning. Under the deep learning framework, generalization performance highly depends on the learned…

Machine Learning · Computer Science 2016-11-07 Hyo-Eun Kim , Sangheum Hwang , Kyunghyun Cho

Representation learning is the foundation for the recent success of neural network models. However, the distributed representations generated by neural networks are far from ideal. Due to their highly entangled nature, they are di cult to…

Machine Learning · Computer Science 2016-02-09 William Whitney

The current methods for learning representations with auto-encoders almost exclusively employ vectors as the latent representations. In this work, we propose to employ a tensor product structure for this purpose. This way, the obtained…

Machine Learning · Computer Science 2023-09-01 Michael Rotman , Amit Dekel , Shir Gur , Yaron Oz , Lior Wolf

Collaborative learning through latent shared feature representations enables heterogeneous clients to train personalized models with improved performance and reduced sample complexity. Despite empirical success and extensive study, the…

Machine Learning · Computer Science 2025-11-25 Xiaochun Niu , Lili Su , Jiaming Xu , Pengkun Yang

We develop a functional encoder-decoder approach to supervised meta-learning, where labeled data is encoded into an infinite-dimensional functional representation rather than a finite-dimensional one. Furthermore, rather than directly…

Machine Learning · Statistics 2020-08-18 Jin Xu , Jean-Francois Ton , Hyunjik Kim , Adam R. Kosiorek , Yee Whye Teh