English
Related papers

Related papers: Learning Task-General Representations with Generat…

200 papers

Logic-based machine learning aims to learn general, interpretable knowledge in a data-efficient manner. However, labelled data must be specified in a structured logical form. To address this limitation, we propose a neural-symbolic learning…

Machine Learning · Computer Science 2023-01-06 Daniel Cunnington , Mark Law , Alessandra Russo , Jorge Lobo

Deep neural networks have become the default choice for many applications like image and video recognition, segmentation and other image and video related tasks.However, a critical challenge with these models is the lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Sunil Kumar Vengalil , Neelam Sinha

Recent research has seen many behavioral comparisons between humans and deep neural networks (DNNs) in the domain of image classification. Often, comparison studies focus on the end-result of the learning process by measuring and comparing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Lukas S. Huber , Fred W. Mast , Felix A. Wichmann

Graph Neural Networks (GNNs) have become the de facto standard for learning on relational data. While traditional GNNs' message passing is well suited for vector-valued node features, there are cases in which node features are better…

Machine Learning · Computer Science 2026-05-21 André Ribeiro , Ana Luiza Tenório , Tiago da Silva , Diego Mesquita

In machine learning, exploring data correlations to predict outcomes is a fundamental task. Recognizing causal relationships embedded within data is pivotal for a comprehensive understanding of system dynamics, the significance of which is…

Machine Learning · Computer Science 2023-11-28 Simi Job , Xiaohui Tao , Taotao Cai , Haoran Xie , Lin Li , Jianming Yong , Qing Li

Symbolic regression (SR) is an area of interpretable machine learning that aims to identify mathematical expressions, often composed of simple functions, that best fit in a given set of covariates $X$ and response $y$. In recent years, deep…

Machine Learning · Computer Science 2023-12-04 Sida Li , Ioana Marinescu , Sebastian Musslick

Generative concept representations have three major advantages over discriminative ones: they can represent uncertainty, they support integration of learning and reasoning, and they are good for unsupervised and semi-supervised learning. We…

Machine Learning · Computer Science 2018-11-19 Daniel T. Chang

Learning concepts that are consistent with human perception is important for Deep Neural Networks to win end-user trust. Post-hoc interpretation methods lack transparency in the feature representations learned by the models. This work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Most existing generative models are limited to learning a single probability distribution from the training data and cannot generalize to novel distributions for unseen data. An architecture that can generate samples from both trained…

Machine Learning · Computer Science 2024-10-16 Xinyu Liao , Aoyang Qin , Jacob Seidman , Junqi Wang , Wei Wang , Paris Perdikaris

Recurrent Neural Networks (RNNs) are general-purpose parallel-sequential computers. The program of an RNN is its weight matrix. How to learn useful representations of RNN weights that facilitate RNN analysis as well as downstream tasks?…

Machine Learning · Computer Science 2025-04-30 Vincent Herrmann , Francesco Faccio , Jürgen Schmidhuber

A central question in neuroscience is how self-organizing dynamic interactions in the brain emerge on their relatively static structural backbone. Due to the complexity of spatial and temporal dependencies between different brain areas,…

Neurons and Cognition · Quantitative Biology 2020-10-15 Simon Wein , Wilhelm Malloni , Ana Maria Tomé , Sebastian M. Frank , Gina-Isabelle Henze , Stefan Wüst , Mark W. Greenlee , Elmar W. Lang

Pre-trained seq2seq models excel at graph semantic parsing with rich annotated data, but generalize worse to out-of-distribution (OOD) and long-tail examples. In comparison, symbolic parsers under-perform on population-level metrics, but…

Computation and Language · Computer Science 2023-01-30 Zi Lin , Jeremiah Liu , Jingbo Shang

Visualizing high-dimensional datasets through a generalized embedding has been a challenge for a long time. Several methods have shown up for the same, but still, they have not been able to generate a generalized embedding, which not only…

Machine Learning · Computer Science 2024-10-21 Chayan Maitra , Rajat K. De

Identifying governing equations for a dynamical system is a topic of critical interest across an array of disciplines, from mathematics to engineering to biology. Machine learning -- specifically deep learning -- techniques have shown their…

Dynamical Systems · Mathematics 2026-05-07 Nibodh Boddupalli , Timothy Matchen , Jeff Moehlis

Motivated by the Gestalt pattern theory, and the Winograd Challenge for language understanding, we design synthetic experiments to investigate a deep learning algorithm's ability to infer simple (at least for human) visual concepts, such as…

Computer Vision and Pattern Recognition · Computer Science 2017-11-02 Zhennan Yan , Xiang Sean Zhou

Graph Neural Networks (GNNs) have emerged as powerful tools for learning representations from structured data. Despite their growing popularity and success across various applications, GNNs encounter several challenges that limit their…

Machine Learning · Computer Science 2026-02-03 Yassine Abbahaddou

Cognitive neuroscience is enjoying rapid increase in extensive public brain-imaging datasets. It opens the door to large-scale statistical models. Finding a unified perspective for all available data calls for scalable and automated…

Machine Learning · Statistics 2019-05-16 Arthur Mensch , Julien Mairal , Danilo Bzdok , Bertrand Thirion , Gaël Varoquaux

Graph Neural Networks (GNNs) have recently been used for node and graph classification tasks with great success, but GNNs model dependencies among the attributes of nearby neighboring nodes rather than dependencies among observed node…

Machine Learning · Computer Science 2020-09-30 Mengyue Hang , Jennifer Neville , Bruno Ribeiro

Learning structured task representations from human demonstrations is essential for understanding long-horizon manipulation behaviors, particularly in bimanual settings where action ordering, object involvement, and interaction geometry can…

Robotics · Computer Science 2026-01-19 Franziska Herbert , Vignesh Prasad , Han Liu , Dorothea Koert , Georgia Chalvatzaki

Given a natural language instruction and an input scene, our goal is to train a model to output a manipulation program that can be executed by the robot. Prior approaches for this task possess one of the following limitations: (i) rely on…