English
Related papers

Related papers: DAM-GT: Dual Positional Encoding-Based Attention M…

200 papers

Origin-Destination Estimation plays an important role in the era of Intelligent Transportation. Nevertheless, as a under-determined problem, OD estimation confronts many challenges from cross-space inference to non-convex, non-linear…

Machine Learning · Computer Science 2022-08-24 Guanzhou Li , Yujing He , Jianping Wu , Duowei Li

The design of Graph Transformers (GTs) generally neglects considerations for fairness, resulting in biased outcomes against certain sensitive subgroups. Since GTs encode graph information without relying on message-passing mechanisms,…

Machine Learning · Computer Science 2024-04-29 Renqiang Luo , Huafei Huang , Shuo Yu , Xiuzhen Zhang , Feng Xia

In this work, we propose a new segmentation network by integrating DenseUNet and bidirectional LSTM together with attention mechanism, termed as DA-BDense-UNet. DenseUNet allows learning enough diverse features and enhancing the…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Wenming Cao , Philip L. H. Yu , Gilbert C. S. Lui , Keith W. H. Chiu , Ho-Ming Cheng , Yanwen Fang , Man-Fung Yuen , Wai-Kay Seto

Molecular understanding is central to advancing areas such as scientific discovery, yet Large Language Models (LLMs) struggle to understand molecular graphs effectively. Existing graph-LLM bridges often adapt the Q-Former-style connector…

Machine Learning · Computer Science 2026-03-03 Zihao Jing , Qiuhao Zeng , Ruiyi Fang , Yan Sun , Boyu Wang , Pingzhao Hu

Importance estimators are explainability methods that quantify feature importance for deep neural networks (DNN). In vision transformers (ViT), the self-attention mechanism naturally leads to attention maps, which are sometimes interpreted…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Lennart Brocki , Jakub Binda , Neo Christopher Chung

Graph transformer has been proven as an effective graph learning method for its adoption of attention mechanism that is capable of capturing expressive representations from complex topological and feature information of graphs. Graph…

Machine Learning · Computer Science 2024-03-26 Dongqi Fu , Zhigang Hua , Yan Xie , Jin Fang , Si Zhang , Kaan Sancak , Hao Wu , Andrey Malevich , Jingrui He , Bo Long

Graph Transformers (GTs) facilitate the comprehension of graph-structured data by calculating the self-attention of node pairs without considering node position information. To address this limitation, we introduce an innovative and…

Machine Learning · Computer Science 2023-12-12 Kushal Bose , Swagatam Das

The prosperity of deep learning contributes to the rapid progress in scene text detection. Among all the methods with convolutional networks, segmentation-based ones have drawn extensive attention due to their superiority in detecting text…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Jingyu Lin , Jie Jiang , Yan Yan , Chunchao Guo , Hongfa Wang , Wei Liu , Hanzi Wang

In this paper, we consider recommender systems with side information in the form of graphs. Existing collaborative filtering algorithms mainly utilize only immediate neighborhood information and have a hard time taking advantage of deeper…

Machine Learning · Computer Science 2019-05-30 Liwei Wu , Hsiang-Fu Yu , Nikhil Rao , James Sharpnack , Cho-Jui Hsieh

Consider $n$ agents connected over a network collaborating to minimize the average of their local cost functions combined with a common nonsmooth function. This paper introduces a unified algorithmic framework for solving such a problem…

Optimization and Control · Mathematics 2026-05-05 Kun Huang , Shi Pu , Angelia Nedić

Modeling visual question answering(VQA) through scene graphs can significantly improve the reasoning accuracy and interpretability. However, existing models answer poorly for complex reasoning questions with attributes or relations, which…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Hao Li , Xu Li , Belhal Karimi , Jie Chen , Mingming Sun

Fake news detection is a significant challenge in the digital age, which has become increasingly important with the proliferation of social media and online communication networks. Graph Neural Networks (GNN)-based methods have shown high…

Machine Learning · Computer Science 2025-02-12 Batool Lakzaei , Mostafa Haghir Chehreghani , Alireza Bagheri

The Transformer architecture, underpinned by the self-attention mechanism, has become the de facto standard for sequence modeling tasks. However, its core computational primitive scales quadratically with sequence length (O(N^2)), creating…

Computation and Language · Computer Science 2025-09-03 Rishiraj Acharya

Domain Adaptive Object Detection (DAOD) focuses on improving the generalization ability of object detectors via knowledge transfer. Recent advances in DAOD strive to change the emphasis of the adaptation process from global to local in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Chaoqi Chen , Jiongcheng Li , Hong-Yu Zhou , Xiaoguang Han , Yue Huang , Xinghao Ding , Yizhou Yu

Many real-world problems can be represented as graph-based learning problems. In this paper, we propose a novel framework for learning spatial and attentional convolution neural networks on arbitrary graphs. Different from previous…

Machine Learning · Computer Science 2019-02-26 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Yuanxing Ning , Philip S. Yu

Accurate traffic forecasting is essential for intelligent transportation systems, supporting a wide range of real-world applications. However, it remains challenging due to two key factors:~(1) Traffic series contain heterogeneous temporal…

Artificial Intelligence · Computer Science 2026-05-26 Ruiwen Gu , Qitai Tan , Yahao Liu , Xiao-Ping Zhang

Encoder-decoder architectures are prominent building blocks of state-of-the-art solutions for tasks across multiple fields where deep learning (DL) or foundation models play a key role. Although there is a growing community working on the…

Machine Learning · Computer Science 2022-10-14 Breno W. Carvalho , Artur D'Avilla Garcez , Luis C. Lamb

Weakly supervised object localization (WSOL) is a challenging problem when given image category labels but requires to learn object localization models. Optimizing a convolutional neural network (CNN) for classification tends to activate…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Wei Gao , Fang Wan , Xingjia Pan , Zhiliang Peng , Qi Tian , Zhenjun Han , Bolei Zhou , Qixiang Ye

Transformer models typically calculate attention matrices using dot products, which have limitations when capturing nonlinear relationships between embedding vectors. We propose Neural Attention, a technique that replaces dot products with…

Machine Learning · Computer Science 2025-11-10 Andrew DiGiugno , Ausif Mahmood

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak
‹ Prev 1 8 9 10 Next ›