English
Related papers

Related papers: DN-DETR: Accelerate DETR Training by Introducing Q…

200 papers

Detection Transformers (DETR) are increasingly adopted in autonomous vehicle (AV) perception systems due to their superior accuracy over convolutional networks. However, concurrently executing multiple DETR tasks presents significant…

Systems and Control · Electrical Eng. & Systems 2025-05-30 Woojin Shin , Donghwa Kang , Byeongyun Park , Brent Byunghoon Kang , Jinkyu Lee , Hyeongboo Baek

Object detection with Transformers (DETR) has achieved a competitive performance over traditional detectors, such as Faster R-CNN. However, the potential of DETR remains largely unexplored for the more challenging task of arbitrary-oriented…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Teli Ma , Mingyuan Mao , Honghui Zheng , Peng Gao , Xiaodi Wang , Shumin Han , Errui Ding , Baochang Zhang , David Doermann

Image denoising is a classical problem in low level computer vision. Model-based optimization methods and deep learning approaches have been the two main strategies for solving the problem. Model-based optimization methods are flexible for…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Chang Liu , Zhaowei Shang , Anyong Qin

Channel denoising is a practical and effective technique for mitigating channel estimation errors in multiple-input multiple-output orthogonal frequency-division multiplexing (MIMO-OFDM) systems. However, adapting denoising techniques to…

Signal Processing · Electrical Eng. & Systems 2025-08-14 Sungyoung Ha , Ikbeom Lee , Seunghyeon Jeon , Yo-Seb Jeon

Numerous dual-energy CT (DECT) techniques have been developed in the past few decades. Dual-energy CT (DECT) statistical iterative reconstruction (SIR) has demonstrated its potential for reducing noise and increasing accuracy. Our lab…

Image and Video Processing · Electrical Eng. & Systems 2023-02-02 Tao Ge , Maria Medrano , Rui Liao , David G. Politte , Jeffrey F. Williamson , Bruce R. Whiting , Joseph A. O'Sullivan

The accurate detection of suspicious regions in medical images is an error-prone and time-consuming process required by many routinely performed diagnostic procedures. To support clinicians during this difficult task, several automated…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Marc K. Ickler , Michael Baumgartner , Saikat Roy , Tassilo Wald , Klaus H. Maier-Hein

Although detection with Transformer (DETR) is increasingly popular, its global attention modeling requires an extremely long training period to optimize and achieve promising detection performance. Alternative to existing studies that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Zhe Chen , Jing Zhang , Dacheng Tao

We present RiO-DETR: DETR for Real-time Oriented Object Detection, the first real-time oriented detection transformer to the best of our knowledge. Adapting DETR to oriented bounding boxes (OBBs) poses three challenges: semantics-dependent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Zhangchi Hu , Yifan Zhao , Yansong Peng , Wenzhang Sun , Xiangchen Yin , Jie Chen , Peixi Wu , Hebei Li , Xinghao Wang , Dongsheng Jiang , Xiaoyan Sun

This paper presents TAG, an automatic system to derive optimized DNN training graph and its deployment onto any device topology, for expedited training in device- and topology- heterogeneous ML clusters. We novelly combine both the DNN…

Machine Learning · Computer Science 2023-02-14 Shiwei Zhang , Xiaodong Yi , Lansong Diao , Chuan Wu , Siyu Wang , Wei Lin

This paper presents an simple yet sophisticated approach to the challenge by Sproat and Jaitly (2016)- given a large corpus of written text aligned to its normalized spoken form, train an RNN to learn the correct normalization function.…

Computation and Language · Computer Science 2017-12-20 Maryam Zare , Shaurya Rohatgi

The remarkable progress in deep learning (DL) showcases outstanding results in various computer vision tasks. However, adaptation to real-time variations in data distributions remains an important challenge. Test-Time Training (TTT) was…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Marco Colussi , Sergio Mascetti , Jose Dolz , Christian Desrosiers

Deep convolutional neural networks (CNNs) for image denoising are usually trained on large datasets. These models achieve the current state of the art, but they have difficulties generalizing when applied to data that deviate from the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sreyas Mohan , Joshua L. Vincent , Ramon Manzorro , Peter A. Crozier , Eero P. Simoncelli , Carlos Fernandez-Granda

RT-DETR is the first real-time end-to-end transformer-based object detector. Its efficiency comes from the framework design and the Hungarian matching. However, compared to dense supervision detectors like the YOLO series, the Hungarian…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Shuo Wang , Chunlong Xia , Feng Lv , Yifeng Shi

The \textit{de facto} paradigm for applying dense retrieval (DR) to new tasks involves fine-tuning a pre-trained model for a specific task. However, this paradigm has two significant limitations: (1) It is difficult adapt the DR to a new…

Information Retrieval · Computer Science 2026-02-27 Zhan Su , Fengran Mo , Jinghan Zhang , Yuchen Hui , Jia Ao Sun , Bingbing Wen , Jian-Yun Nie

PET is affected by statistical noise due to constraints on tracer dose and scan duration, impacting both diagnostic performance and quantitative accuracy. While deep learning (DL)-based PET denoising methods have been used to improve image…

Exiting deep-learning based dense stereo matching methods often rely on ground-truth disparity maps as the training signals, which are however not always available in many situations. In this paper, we design a simple convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Yiran Zhong , Yuchao Dai , Hongdong Li

In this paper, we propose a framework to enhance the robustness of the neural models by mitigating the effects of process-induced and aging-related variations of analog computing components on the accuracy of the analog neural networks. We…

Machine Learning · Computer Science 2024-09-30 Seyedarmin Azizi , Mohammad Erfan Sadeghi , Mehdi Kamal , Massoud Pedram

Dynamic computed tomography perfusion (CTP) imaging is a promising approach for acute ischemic stroke diagnosis and evaluation. Hemodynamic parametric maps of cerebral parenchyma are calculated from repeated CT scans of the first pass of…

Medical Physics · Physics 2020-05-21 Dufan Wu , Hui Ren , Quanzheng Li

Convolution neural networks (CNNs) and Transformers have their own advantages and both have been widely used for dense prediction in multi-task learning (MTL). Most of the current studies on MTL solely rely on CNN or Transformer. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yangyang Xu , Yibo Yang , Lefei Zhang

Most change detection models based on vision transformers currently follow a "pretraining then fine-tuning" strategy. This involves initializing the model weights using large scale classification datasets, which can be either natural images…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Yang Zhao , Yuxiang Zhang , Yanni Dong , Bo Du