English
Related papers

Related papers: Unsupervised Learning of Equivariant Structure fro…

200 papers

We introduce a new approach to probabilistic unsupervised learning based on the recognition-parametrised model (RPM): a normalised semi-parametric hypothesis class for joint distributions over observed and latent variables. Under the key…

Machine Learning · Computer Science 2023-04-21 William I. Walker , Hugo Soulat , Changmin Yu , Maneesh Sahani

Analyzing sequential data is crucial in many domains, particularly due to the abundance of data collected from the Internet of Things paradigm. Time series classification, the task of categorizing sequential data, has gained prominence,…

Machine Learning · Computer Science 2024-06-21 Venkata Ragavendra Vavilthota , Ranjith Ramanathan , Sathyanarayanan N. Aakur

Unsupervised learning is a discipline of machine learning which aims at discovering patterns in big data sets or classifying the data into several categories without being trained explicitly. We show that unsupervised learning techniques…

Statistical Mechanics · Physics 2016-11-04 Lei Wang

This paper is concerned with learning of mixture regression models for individuals that are measured repeatedly. The adjective "unsupervised" implies that the number of mixing components is unknown and has to be determined, ideally by data…

Methodology · Statistics 2018-01-09 Peirong Xu , Heng Peng , Tao Huang

Large intra-class variation is the result of changes in multiple object characteristics. Images, however, only show the superposition of different variable factors such as appearance or shape. Therefore, learning to disentangle and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Dominik Lorenz , Leonard Bereska , Timo Milbich , Björn Ommer

Can meta-learning discover generic ways of processing time series (TS) from a diverse dataset so as to greatly improve generalization on new TS coming from different datasets? This work provides positive evidence to this using a broad…

Machine Learning · Computer Science 2020-12-16 Boris N. Oreshkin , Dmitri Carpov , Nicolas Chapados , Yoshua Bengio

In machine learning datasets with symmetries, the paradigm for backward compatibility with symmetry-breaking has been to relax equivariant architectural constraints, engineering extra weights to differentiate symmetries of interest.…

Machine Learning · Computer Science 2024-10-08 Haozhe Huang , Leo Kaixuan Cheng , Kaiwen Chen , Alán Aspuru-Guzik

Owing to the advances in computational techniques and the increase in computational power, atomistic simulations of materials can simulate large systems with higher accuracy. Complex phenomena can be observed in such state-of-the-art…

Materials Science · Physics 2022-02-16 Ryo Tamura , Momo Matsuda , Jianbo Lin , Yasunori Futamura , Tetsuya Sakurai , Tsuyoshi Miyazaki

While great strides have been made in using deep learning algorithms to solve supervised learning tasks, the problem of unsupervised learning - leveraging unlabeled examples to learn about the structure of a domain - remains a difficult…

Machine Learning · Computer Science 2017-03-02 William Lotter , Gabriel Kreiman , David Cox

Understanding sequential information is a fundamental task for artificial intelligence. Current neural networks attempt to learn spatial and temporal information as a whole, limited their abilities to represent large scale spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Bo Pang , Kaiwen Zha , Hanwen Cao , Jiajun Tang , Minghui Yu , Cewu Lu

The requirement of generating predictions that exactly fulfill the fundamental symmetry of the corresponding physical quantities has profoundly shaped the development of machine-learning models for physical simulations. In many cases,…

Machine Learning · Computer Science 2026-03-27 Michelangelo Domina , Joseph William Abbott , Paolo Pegolo , Filippo Bigi , Michele Ceriotti

Sequence data is challenging for machine learning approaches, because the lengths of the sequences may vary between samples. In this paper, we present an unsupervised learning model for sequence data, called the Integrated Sequence…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Wenjie Pei , David M. J. Tax

Current state-of-the-art classification and detection algorithms rely on supervised training. In this work we study unsupervised feature learning in the context of temporally coherent video data. We focus on feature learning from unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2015-04-17 Ross Goroshin , Joan Bruna , Jonathan Tompson , David Eigen , Yann LeCun

Unsupervised multi-object scene decomposition is a fast-emerging problem in representation learning. Despite significant progress in static scenes, such models are unable to leverage important dynamic cues present in video. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Polina Zablotskaia , Edoardo A. Dominici , Leonid Sigal , Andreas M. Lehrmann

In this work, we investigate unsupervised representation learning on medical time series, which bears the promise of leveraging copious amounts of existing unlabeled data in order to eventually assist clinical decision making. By evaluating…

Machine Learning · Computer Science 2018-12-04 Xinrui Lyu , Matthias Hueser , Stephanie L. Hyland , George Zerveas , Gunnar Raetsch

Computing universal distributed representations of sentences is a fundamental task in natural language processing. We propose ConsSent, a simple yet surprisingly powerful unsupervised method to learn such representations by enforcing…

Computation and Language · Computer Science 2019-01-25 Siddhartha Brahma

Humans easily recognize object parts and their hierarchical structure by watching how they move; they can then predict how each part moves in the future. In this paper, we propose a novel formulation that simultaneously learns a…

Computer Vision and Pattern Recognition · Computer Science 2019-03-14 Zhenjia Xu , Zhijian Liu , Chen Sun , Kevin Murphy , William T. Freeman , Joshua B. Tenenbaum , Jiajun Wu

Autoencoding is a popular method in representation learning. Conventional autoencoders employ symmetric encoding-decoding procedures and a simple Euclidean latent space to detect hidden low-dimensional structures in an unsupervised way.…

Machine Learning · Computer Science 2024-10-07 Stefan C. Schonsheck , Scott Mahan , Timo Klock , Alexander Cloninger , Rongjie Lai

Despite their irresistible success, deep learning algorithms still heavily rely on annotated data. On the other hand, unsupervised settings pose many challenges, especially about determining the right inductive bias in diverse scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Beril Besbinar , Pascal Frossard

Time series are often complex and rich in information but sparsely labeled and therefore challenging to model. In this paper, we propose a self-supervised framework for learning generalizable representations for non-stationary time series.…

Machine Learning · Computer Science 2021-06-03 Sana Tonekaboni , Danny Eytan , Anna Goldenberg