English
Related papers

Related papers: Dynamically Relative Position Encoding-Based Trans…

200 papers

Neural-based multi-task learning (MTL) has gained significant improvement, and it has been successfully applied to recommendation system (RS). Recent deep MTL methods for RS (e.g. MMoE, PLE) focus on designing soft gating-based…

Artificial Intelligence · Computer Science 2023-08-21 Qi Liu , Zhilong Zhou , Gangwei Jiang , Tiezheng Ge , Defu Lian

The real-world deployment of an autonomous driving system requires its components to run on-board and in real-time, including the motion prediction module that predicts the future trajectories of surrounding traffic participants. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Zhejun Zhang , Alexander Liniger , Christos Sakaridis , Fisher Yu , Luc Van Gool

Next-gen networks require significant evolution of management to enable automation and adaptively adjust network configuration based on traffic dynamics. The advent of software-defined networking (SDN) and programmable switches enables…

Networking and Internet Architecture · Computer Science 2024-02-08 Akshita Abrol , Purnima Murali Mohan , Tram Truong-Huu

Developing effective quantitative trading strategies using reinforcement learning (RL) is challenging due to the high risks associated with online interaction with live financial markets. Consequently, offline RL, which leverages historical…

Computational Finance · Quantitative Finance 2024-11-28 Suyeol Yun

Tracking the 6D pose of objects in video sequences is important for robot manipulation. This task, however, introduces multiple challenges: (i) robot manipulation involves significant occlusions; (ii) data and annotations are troublesome…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Bowen Wen , Chaitanya Mitash , Baozhang Ren , Kostas E. Bekris

This work is concerned with camera pose estimation from correspondences of 3D/2D lines, i. e. with the Perspective-n-Line (PnL) problem. We focus on large line sets, which can be efficiently solved by methods using linear formulation of…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Bronislav Přibyl , Pavel Zemčík , Martin Čadík

Deep learning models for channel estimation in Orthogonal Frequency Division Multiplexing (OFDM) systems often suffer from performance degradation under fast-fading channels and low-SNR scenarios. To address these limitations, we introduce…

Machine Learning · Computer Science 2025-05-15 Berkay Guler , Hamid Jafarkhani

Temporal action proposal generation is an important and challenging task in video understanding, which aims at detecting all temporal segments containing action instances of interest. The existing proposal generation approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Jing Tan , Jiaqi Tang , Limin Wang , Gangshan Wu

As the next generation of mobile systems evolves, artificial intelligence (AI) is expected to deeply integrate with wireless communications for resource management in variable environments. In particular, deep reinforcement learning (DRL)…

Signal Processing · Electrical Eng. & Systems 2024-10-15 Jie Zhang , Jun Li , Long Shi , Zhe Wang , Shi Jin , Wen Chen , H. Vincent Poor

Accurate predictions rely on the expressiveness power of graph deep learning frameworks like graph neural networks and graph transformers, where a positional encoding mechanism has become much more indispensable in recent state-of-the-art…

Machine Learning · Computer Science 2025-06-12 Katherine Tieu , Dongqi Fu , Zihao Li , Ross Maciejewski , Jingrui He

Leveraging user-provided translation to constrain NMT has practical significance. Existing methods can be classified into two main categories, namely the use of placeholder tags for lexicon words and the use of hard constraints during…

Computation and Language · Computer Science 2019-05-17 Kai Song , Yue Zhang , Heng Yu , Weihua Luo , Kun Wang , Min Zhang

Based on its great successes in inference and denosing tasks, Dictionary Learning (DL) and its related sparse optimization formulations have garnered a lot of research interest. While most solutions have focused on single layer…

Machine Learning · Computer Science 2021-04-22 Wen Tang , Emilie Chouzenoux , Jean-Christophe Pesquet , Hamid Krim

Transformer residual streams evolve by additive accumulation: each layer appends a feature update to a shared hidden state, but has no direct mechanism for replacing content that has become obsolete or conflicting. We introduce Deep Delta…

Machine Learning · Computer Science 2026-05-14 Yifan Zhang , Yifeng Liu , Mengdi Wang , Quanquan Gu

Visual place recognition (VPR) aims to determine the general geographical location of a query image by retrieving visually similar images from a large geo-tagged database. To obtain a global representation for each place image, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Tong Jin , Feng Lu , Shuyu Hu , Chun Yuan , Yunpeng Liu

The speed-precision trade-off is a critical problem for visual object tracking which usually requires low latency and deployment on constrained resources. Existing solutions for efficient tracking mainly focus on adopting light-weight…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Jiawen Zhu , Xin Chen , Haiwen Diao , Shuai Li , Jun-Yan He , Chenyang Li , Bin Luo , Dong Wang , Huchuan Lu

In this work, we propose a novel paradigm to encode the position of targets for target tracking in videos using transformers. The proposed paradigm, Dense Spatio-Temporal (DST) position encoding, encodes spatio-temporal position information…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Jinkun Cao , Hao Wu , Kris Kitani

One critical challenge in 6D object pose estimation from a single RGBD image is efficient integration of two different modalities, i.e., color and depth. In this work, we tackle this problem by a novel Deep Fusion Transformer~(DFTr) block…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Jun Zhou , Kai Chen , Linlin Xu , Qi Dou , Jing Qin

Adaptive impedance matching between antennas and radio frequency front-end modules is critical for maximizing power transmission efficiency in mobile communication systems. Conventional numerical and analytical methods struggle with a…

Signal Processing · Electrical Eng. & Systems 2026-04-10 Guoquan Zhang , Wendong Cheng , Weidong Wang , Li Chen

Transformer has been widely used for self-supervised pre-training in Natural Language Processing (NLP) and achieved great success. However, it has not been fully explored in visual self-supervised learning. Meanwhile, previous methods only…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhaowen Li , Zhiyang Chen , Fan Yang , Wei Li , Yousong Zhu , Chaoyang Zhao , Rui Deng , Liwei Wu , Rui Zhao , Ming Tang , Jinqiao Wang

Recent years have witnessed growing interest in the application of deep neural networks (DNNs) for receiver design, which can potentially be applied in complex environments without relying on knowledge of the channel model. However, the…

Information Theory · Computer Science 2023-02-14 Tomer Raviv , Sangwoo Park , Osvaldo Simeone , Yonina C. Eldar , Nir Shlezinger