English
Related papers

Related papers: Learning Symmetric Embeddings for Equivariant Worl…

200 papers

Robotic pick and place tasks are symmetric under translations and rotations of both the object to be picked and the desired place pose. For example, if the pick object is rotated or translated, then the optimal pick action should also…

Robotics · Computer Science 2023-12-27 Haojie Huang , Dian Wang , Arsh Tangri , Robin Walters , Robert Platt

Different neural networks trained on the same dataset often learn similar input-output mappings with very different weights. Is there some correspondence between these neural network solutions? For linear networks, it has been shown that…

Machine Learning · Computer Science 2019-03-19 Qihong Lu , Po-Hsuan Chen , Jonathan W. Pillow , Peter J. Ramadge , Kenneth A. Norman , Uri Hasson

Machine learning has enabled the prediction of quantum chemical properties with high accuracy and efficiency, allowing to bypass computationally costly ab initio calculations. Instead of training on a fixed set of properties, more recent…

Symmetric objects are common in daily life and industry, yet their inherent orientation ambiguities that impede the training of deep learning networks for pose estimation are rarely discussed in the literature. To cope with these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Andreas Kriegler , Csaba Beleznai , Margrit Gelautz

We study the problem of large-scale network embedding, which aims to learn low-dimensional latent representations for network mining applications. Recent research in the field of network embedding has led to significant progress such as…

Social and Information Networks · Computer Science 2021-12-03 Junsheng Kong , Weizhao Li , Ben Liao , Jiezhong Qiu , Chang-Yu , Hsieh , Yi Cai , Jinhui Zhu , Shengyu Zhang

In contrast to regular (simple) networks, hyper networks possess the ability to depict more complex relationships among nodes and store extensive information. Such networks are commonly found in real-world applications, such as in social…

Social and Information Networks · Computer Science 2023-11-08 Shu Liu , Cameron Lai , Fujio Toriumi

Rotation-invariance is a desired property of machine-learning models for medical image analysis and in particular for computational pathology applications. We propose a framework to encode the geometric structure of the special Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Maxime W. Lafarge , Erik J. Bekkers , Josien P. W. Pluim , Remco Duits , Mitko Veta

Recent developments in the field of quantum machine learning have promoted the idea of incorporating physical symmetries in the structure of quantum circuits. A crucial milestone in this area is the realization of $S_{n}$-permutation…

Quantum Physics · Physics 2024-08-20 Zhelun Li , Lento Nagano , Koji Terashi

In many machine learning tasks it is desirable that a model's prediction transforms in an equivariant way under transformations of its input. Convolutional neural networks (CNNs) implement translational equivariance by construction; for…

Machine Learning · Computer Science 2018-03-20 Maurice Weiler , Fred A. Hamprecht , Martin Storath

Perceptual learning enables humans to recognize and represent stimuli invariant to various transformations and build a consistent representation of the self and physical world. Such representations preserve the invariant physical relations…

Neural and Evolutionary Computing · Computer Science 2020-07-02 Du Xiaorui , Yavuzhan Erdem , Immanuel Schweizer , Cristian Axenie

Subsampling is used in convolutional neural networks (CNNs) in the form of pooling or strided convolutions, to reduce the spatial dimensions of feature maps and to allow the receptive fields to grow exponentially with depth. However, it is…

Machine Learning · Computer Science 2021-06-11 Jin Xu , Hyunjik Kim , Tom Rainforth , Yee Whye Teh

Applications of machine learning techniques for materials modeling typically involve functions known to be equivariant or invariant to specific symmetries. While graph neural networks (GNNs) have proven successful in such tasks, they…

Recently, a variety of new equivariant neural network model architectures have been proposed that generalize better over rotational and reflectional symmetries than standard models. These models are relevant to robotics because many…

Robotics · Computer Science 2021-11-01 Dian Wang , Robin Walters , Xupeng Zhu , Robert Platt

Traditional sentence embedding models encode sentences into vector representations to capture useful properties such as the semantic similarity between sentences. However, in addition to similarity, sentence semantics can also be…

Computation and Language · Computer Science 2023-11-07 James Y. Huang , Wenlin Yao , Kaiqiang Song , Hongming Zhang , Muhao Chen , Dong Yu

Learning representations of geographical space is vital for any machine learning model that integrates geolocated data, spanning application domains such as remote sensing, ecology, or epidemiology. Recent work embeds coordinates using sine…

Machine Learning · Computer Science 2024-04-16 Marc Rußwurm , Konstantin Klemmer , Esther Rolf , Robin Zbinden , Devis Tuia

The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical…

Machine Learning · Computer Science 2019-05-15 Taco S. Cohen , Maurice Weiler , Berkay Kicanaoglu , Max Welling

Entity alignment is a viable means for integrating heterogeneous knowledge among different knowledge graphs (KGs). Recent developments in the field often take an embedding-based approach to model the structural information of KGs so that…

Computation and Language · Computer Science 2019-09-23 Yuting Wu , Xiao Liu , Yansong Feng , Zheng Wang , Dongyan Zhao

Much of human knowledge is encoded in text, available in scientific publications, books, and the web. Given the rapid growth of these resources, we need automated methods to extract such knowledge into machine-processable structures, such…

Information Retrieval · Computer Science 2019-07-02 Shobeir Fakhraei , Joel Mathew , Jose Luis Ambite

The strength of machine learning models stems from their ability to learn complex function approximations from data; however, this strength also makes training deep neural networks challenging. Notably, the complex models tend to memorize…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Mofassir ul Islam Arif , Mohsan Jameel , Josif Grabocka , Lars Schmidt-Thieme

Joint-embedding self-supervised learning (SSL) commonly relies on transformations such as data augmentation and masking to learn visual representations, a task achieved by enforcing invariance or equivariance with respect to these…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Hafez Ghaemi , Eilif Muller , Shahab Bakhtiari