English
Related papers

Related papers: GraViti: Graph-Level Variational Autoencoders with…

200 papers

Recently, particle-based variational inference (ParVI) methods have gained interest because they can avoid arbitrary parametric assumptions that are common in variational inference. However, many ParVI approaches do not allow arbitrary…

Machine Learning · Computer Science 2021-08-12 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

Our way of grasping objects is challenging for efficient, intelligent and optimal grasp by COBOTs. To streamline the process, here we use deep learning techniques to help robots learn to generate and execute appropriate grasps quickly. We…

Robotics · Computer Science 2021-07-16 Priya Shukla , Nilotpal Pramanik , Deepesh Mehta , G. C. Nandi

Predicating macroscopic influences of drugs on human body, like efficacy and toxicity, is a central problem of small-molecule based drug discovery. Molecules can be represented as an undirected graph, and we can utilize graph convolution…

Machine Learning · Computer Science 2017-09-19 Junying Li , Deng Cai , Xiaofei He

Reliable fault detection is an essential requirement for safe and efficient operation of complex mechanical systems in various industrial applications. Despite the abundance of existing approaches and the maturity of the fault detection…

Signal Processing · Electrical Eng. & Systems 2024-08-19 Tianfu Li , Chuang Sun , Ruqiang Yan , Xuefeng Chen

Graph Transformer (GT), as a special type of Graph Neural Networks (GNNs), utilizes multi-head attention to facilitate high-order message passing. However, this also imposes several limitations in node classification applications: 1) nodes…

Machine Learning · Computer Science 2024-10-16 Jiajun Zhou , Xuanze Chen , Chenxuan Xie , Yu Shanqing , Qi Xuan , Xiaoniu Yang

Rearranging deformable objects is a long-standing challenge in robotic manipulation for the high dimensionality of configuration space and the complex dynamics of deformable objects. We present a novel framework, Graph-Transporter, for…

Robotics · Computer Science 2023-02-22 Yuhong Deng , Chongkun Xia , Xueqian Wang , Lipeng Chen

We argue that Transformers are essentially graph-to-graph models, with sequences just being a special case. Attention weights are functionally equivalent to graph edges. Our Graph-to-Graph Transformer architecture makes this ability…

Computation and Language · Computer Science 2023-10-30 James Henderson , Alireza Mohammadshahi , Andrei C. Coman , Lesly Miculicich

Spatial-temporal graph modeling is an important task to analyze the spatial relations and temporal trends of components in a system. Existing approaches mostly capture the spatial dependency on a fixed graph structure, assuming that the…

Machine Learning · Computer Science 2019-06-04 Zonghan Wu , Shirui Pan , Guodong Long , Jing Jiang , Chengqi Zhang

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Graph generative models have broad applications in biology, chemistry and social science. However, modelling and understanding the generative process of graphs is challenging due to the discrete and high-dimensional nature of graphs, as…

Machine Learning · Computer Science 2022-12-06 Han Huang , Leilei Sun , Bowen Du , Yanjie Fu , Weifeng Lv

We introduce a novel neural network architecture for encoding and synthesis of 3D shapes, particularly their structures. Our key insight is that 3D shapes are effectively characterized by their hierarchical organization of parts, which…

Graphics · Computer Science 2017-05-16 Jun Li , Kai Xu , Siddhartha Chaudhuri , Ersin Yumer , Hao Zhang , Leonidas Guibas

Learning useful representations of complex data has been the subject of extensive research for many years. With the diffusion of Deep Neural Networks, Variational Autoencoders have gained lots of attention since they provide an explicit…

Machine Learning · Computer Science 2020-09-15 Marco Maggipinto , Matteo Terzi , Gian Antonio Susto

This article proposes to auto-encode text at byte-level using convolutional networks with a recursive architecture. The motivation is to explore whether it is possible to have scalable and homogeneous text generation at byte-level in a…

Computation and Language · Computer Science 2018-02-07 Xiang Zhang , Yann LeCun

The problem of accelerating drug discovery relies heavily on automatic tools to optimize precursor molecules to afford them with better biochemical properties. Our work in this paper substantially extends prior state-of-the-art on…

Chemical Physics · Physics 2019-10-22 Wengong Jin , Regina Barzilay , Tommi Jaakkola

Vision Transformers (ViTs) have recently become the state-of-the-art across many computer vision tasks. In contrast to convolutional networks (CNNs), ViTs enable global information sharing even within shallow layers of a network, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jongwoo Park , Kumara Kahatapitiya , Donghyun Kim , Shivchander Sudalairaj , Quanfu Fan , Michael S. Ryoo

Graph Neural Networks (GNNs) have demonstrated remarkable success in various applications, yet they often struggle to capture long-range dependencies (LRD) effectively. This paper introduces GraphMinNet, a novel GNN architecture that…

Machine Learning · Computer Science 2025-02-04 Md Atik Ahamed , Andrew Cheng , Qiang Ye , Qiang Cheng

The Transformer architecture has gained growing attention in graph representation learning recently, as it naturally overcomes several limitations of graph neural networks (GNNs) by avoiding their strict structural inductive biases and…

Machine Learning · Statistics 2022-06-14 Dexiong Chen , Leslie O'Bray , Karsten Borgwardt

We propose a novel positional encoding for learning graph on Transformer architecture. Existing approaches either linearize a graph to encode absolute position in the sequence of nodes, or encode relative position with another node using…

Machine Learning · Computer Science 2022-10-17 Wonpyo Park , Woonggi Chang , Donggeon Lee , Juntae Kim , Seung-won Hwang

Graph representation learning nowadays becomes fundamental in analyzing graph-structured data. Inspired by recent success of contrastive methods, in this paper, we propose a novel framework for unsupervised graph representation learning by…

Machine Learning · Computer Science 2020-07-14 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Deep generative networks have been widely used for learning mappings from a low-dimensional latent space to a high-dimensional data space. In many cases, data transformations are defined by linear paths in this latent space. However, the…

Machine Learning · Statistics 2019-12-06 Marissa Connor , Christopher Rozell