English
Related papers

Related papers: EvoFormer: Learning Dynamic Graph-Level Representa…

200 papers

The transformer architecture has shown remarkable success in various domains, such as natural language processing and computer vision. When it comes to graph learning, transformers are required not only to capture the interactions between…

Machine Learning · Computer Science 2024-01-30 Van Thuy Hoang , O-Joun Lee

Representation learning of static and more recently dynamically evolving graphs has gained noticeable attention. Existing approaches for modelling graph dynamics focus extensively on the evolution of individual nodes independently of the…

Machine Learning · Computer Science 2021-05-12 Simeon Spasov , Alessandro Di Stefano , Pietro Lio , Jian Tang

The representation learning on textual graph is to generate low-dimensional embeddings for the nodes based on the individual textual features and the neighbourhood information. Recent breakthroughs on pretrained language models and graph…

Computation and Language · Computer Science 2023-10-10 Junhan Yang , Zheng Liu , Shitao Xiao , Chaozhuo Li , Defu Lian , Sanjay Agrawal , Amit Singh , Guangzhong Sun , Xing Xie

In this article, we propose a novel navigation framework that leverages a two layered graph representation of the environment for efficient large-scale exploration, while it integrates a novel uncertainty awareness scheme to handle dynamic…

Robotics · Computer Science 2024-02-07 Akash Patel , Mario A V Saucedo , Christoforos Kanellakis , George Nikolakopoulos

Transformers have achieved remarkable performance in a myriad of fields including natural language processing and computer vision. However, when it comes to the graph mining area, where graph neural network (GNN) has been the dominant…

Machine Learning · Computer Science 2021-10-26 Jianan Zhao , Chaozhuo Li , Qianlong Wen , Yiqi Wang , Yuming Liu , Hao Sun , Xing Xie , Yanfang Ye

Enabling robots to perform complex dynamic tasks such as picking up an object in one sweeping motion or pushing off a wall to quickly turn a corner is a challenging problem. The dynamic interactions implicit in these tasks are critical…

Robotics · Computer Science 2022-10-03 Saumya Saxena , Oliver Kroemer

Learning representations on large-sized graphs is a long-standing challenge due to the inter-dependence nature involved in massive data points. Transformers, as an emerging class of foundation encoders for graph-structured data, have shown…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Wentao Zhao , Chenxiao Yang , Hengrui Zhang , Fan Nie , Haitian Jiang , Yatao Bian , Junchi Yan

A challenging problem when studying a dynamical system is to find the interdependencies among its individual components. Several algorithms have been proposed to detect directed dynamical influences between time series. Two of the most used…

Data Analysis, Statistics and Probability · Physics 2015-09-09 Alessandro Montalto , Sebastiano Stramaglia , Luca Faes , Giovanni Tessitore , Roberto Prevete , Daniele Marinazzo

Graph Transformers have recently been successful in various graph representation learning tasks, providing a number of advantages over message-passing Graph Neural Networks. Utilizing Graph Transformers for learning the representation of…

Neurons and Cognition · Quantitative Biology 2023-12-27 Byung-Hoon Kim , Jungwon Choi , EungGu Yun , Kyungsang Kim , Xiang Li , Juho Lee

Time series modeling has attracted extensive research efforts; however, achieving both reliable efficiency and interpretability from a unified model still remains a challenging problem. Among the literature, shapelets offer interpretable…

Machine Learning · Computer Science 2020-12-01 Ziqiang Cheng , Yang Yang , Wei Wang , Wenjie Hu , Yueting Zhuang , Guojie Song

A robust awareness of how dynamic scenes evolve is essential for Autonomous Driving systems, as they must accurately detect, track, and predict the behaviour of surrounding obstacles. Traditional perception pipelines that rely on modular…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Miguel Antunes-García , Santiago Montiel-Marín , Fabio Sánchez-García , Rodrigo Gutiérrez-Moreno , Rafael Barea , Luis M. Bergasa

Node embedding refers to techniques that generate low-dimensional vector representations of nodes in a graph while preserving specific properties of the nodes. A key challenge in the field is developing scalable methods that can preserve…

The intelligent behavior of robots does not emerge solely from control systems, but from the tight coupling between body and brain, a principle known as embodied intelligence. Designing soft robots that leverage this interaction remains a…

Robotics · Computer Science 2026-03-23 Jianqiang Wang , Shuaiqun Pan , Alvaro Serra-Gomez , Xiaohan Wei , Yue Xie

Bio-inspired neuromorphic cameras asynchronously record pixel brightness changes and generate sparse event streams. They can capture dynamic scenes with little motion blur and more details in extreme illumination conditions. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Pei Zhang , Chutian Wang , Edmund Y. Lam

Recent advances in Graph Convolutional Neural Networks (GCNNs) have shown their efficiency for non-Euclidean data on graphs, which often require a large amount of labeled data with high cost. It it thus critical to learn graph feature…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Xiang Gao , Wei Hu , Guo-Jun Qi

In continual learning, solving the catastrophic forgetting problem may make the models fall into the stability-plasticity dilemma. Moreover, inter-task confusion will also occur due to the lack of knowledge exchanges between different…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sheng-Kai Huang , Jiun-Feng Chang , Chun-Rong Huang

Modern machine learning is still largely organized around a single recipe: choose a parameterized model family and optimize its weights. Although highly successful, this paradigm is too narrow for many structured prediction problems, where…

Artificial Intelligence · Computer Science 2026-04-23 Kamer Ali Yuksel , Hassan Sawaf

As acquiring pixel-wise annotations of real-world images for semantic segmentation is a costly process, a model can instead be trained with more accessible synthetic data and adapted to real images without requiring their annotations. This…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Lukas Hoyer , Dengxin Dai , Luc Van Gool

One common belief is that with complex models and pre-training on large-scale datasets, transformer-based methods for referring expression comprehension (REC) perform much better than existing graph-based methods. We observe that since most…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Jingcheng Ke , Dele Wang , Jun-Cheng Chen , I-Hong Jhuo , Chia-Wen Lin , Yen-Yu Lin

Recent works on representation learning for graph structured data predominantly focus on learning distributed representations of graph substructures such as nodes and subgraphs. However, many graph analytics tasks such as graph…

Artificial Intelligence · Computer Science 2017-07-18 Annamalai Narayanan , Mahinthan Chandramohan , Rajasekar Venkatesan , Lihui Chen , Yang Liu , Shantanu Jaiswal