English
Related papers

Related papers: DeMT: Deformable Mixer Transformer for Multi-Task …

200 papers

The task of object segmentation in videos is usually accomplished by processing appearance and motion information separately using standard 2D convolutional networks, followed by a learned fusion of the two sources of information. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Sabarinath Mahadevan , Ali Athar , Aljoša Ošep , Sebastian Hennen , Laura Leal-Taixé , Bastian Leibe

In document-level neural machine translation (DocNMT), multi-encoder approaches are common in encoding context and source sentences. Recent studies \cite{li-etal-2020-multi-encoder} have shown that the context encoder generates noise and…

Computation and Language · Computer Science 2024-07-04 Ramakrishna Appicharla , Baban Gain , Santanu Pal , Asif Ekbal , Pushpak Bhattacharyya

Temporal convolutions have been the paradigm of choice in action segmentation, which enhances long-term receptive fields by increasing convolution layers. However, high layers cause the loss of local information necessary for frame…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Jiahui Wang , Zhenyou Wang , Shanna Zhuang , Hui Wang

With the rapid advancement of Neural Machine Translation (NMT), enhancing translation efficiency and quality has become a focal point of research. Despite the commendable performance of general models such as the Transformer in various…

Computation and Language · Computer Science 2024-02-26 Jingpu Yang , Zehua Han , Mengyu Xiang , Helin Wang , Yuxiao Huang , Miao Fang

Manipulating deformable objects is a ubiquitous task in household environments, demanding adequate representation and accurate dynamics prediction due to the objects' infinite degrees of freedom. This work proposes DeformNet, which utilizes…

Robotics · Computer Science 2024-02-13 Chenchang Li , Zihao Ai , Tong Wu , Xiaosa Li , Wenbo Ding , Huazhe Xu

Multi-task scene understanding aims to design models that can simultaneously predict several scene understanding tasks with one versatile model. Previous studies typically process multi-task features in a more local way, and thus cannot…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Hanrong Ye , Dan Xu

Convolutional neural networks (CNNs) are ubiquitous in computer vision, with a myriad of effective and efficient variations. Recently, Transformers -- originally introduced in natural language processing -- have been increasingly adopted in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Peng Gao , Jiasen Lu , Hongsheng Li , Roozbeh Mottaghi , Aniruddha Kembhavi

Multiple object tracking (MOT) tends to become more challenging when severe occlusions occur. In this paper, we analyze the limitations of traditional Convolutional Neural Network-based methods and Transformer-based methods in handling…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Teng Fu , Xiaocong Wang , Haiyang Yu , Ke Niu , Bin Li , Xiangyang Xue

This paper proposes a joint multi-task learning algorithm to better predict attributes in images using deep convolutional neural networks (CNN). We consider learning binary semantic attributes through a multi-task CNN model, where each CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Abrar H. Abdulnabi , Gang Wang , Jiwen Lu , Kui Jia

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

Machine Learning · Computer Science 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

Transformer and its variants have shown great potential for various vision tasks in recent years, including image classification, object detection and segmentation. Meanwhile, recent studies also reveal that with proper architecture design,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Xinghao Chen , Siwei Li , Yijing Yang , Yunhe Wang

Convolution neural networks (CNNs) have succeeded in compressive image sensing. However, due to the inductive bias of locality and weight sharing, the convolution operations demonstrate the intrinsic limitations in modeling the long-range…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Dongjie Ye , Zhangkai Ni , Hanli Wang , Jian Zhang , Shiqi Wang , Sam Kwong

Recently, deep learning has attracted more and more attention in phase unwrapping of fringe projection three-dimensional (3D) measurement, with the aim to improve the performance leveraging the powerful Convolutional Neural Network (CNN)…

Image and Video Processing · Electrical Eng. & Systems 2022-11-23 Xinjun Zhu , Zhiqiang Han , Mengkai Yuan , Qinghua Guo , Hongyi Wang

Fine-grained action recognition is a challenging task in computer vision. As fine-grained datasets have small inter-class variations in spatial and temporal space, fine-grained action recognition model requires good temporal reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Mei Chee Leong , Haosong Zhang , Hui Li Tan , Liyuan Li , Joo Hwee Lim

In this work we propose a HyperTransformer, a Transformer-based model for supervised and semi-supervised few-shot learning that generates weights of a convolutional neural network (CNN) directly from support samples. Since the dependence of…

Machine Learning · Computer Science 2022-07-15 Andrey Zhmoginov , Mark Sandler , Max Vladymyrov

Transformers have become one of the dominant architectures in deep learning, particularly as a powerful alternative to convolutional neural networks (CNNs) in computer vision. However, Transformer training and inference in previous works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Zizheng Pan , Bohan Zhuang , Haoyu He , Jing Liu , Jianfei Cai

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

Convolutional Neural Networks (CNNs) can provide accurate object classification. They can be extended to perform object detection by iterating over dense or selected proposed object regions. However, the runtime of such detectors scales as…

Computer Vision and Pattern Recognition · Computer Science 2014-04-08 Forrest Iandola , Matt Moskewicz , Sergey Karayev , Ross Girshick , Trevor Darrell , Kurt Keutzer

Stable consumer electronic systems can assist traffic better. Good traffic consumer electronic systems require collaborative work between traffic algorithms and hardware. However, performance of popular traffic algorithms containing vehicle…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Chunwei Tian , Kai Liu , Bob Zhang , Zhixiang Huang , Chia-Wen Lin , David Zhang

Semantic segmentation has witnessed remarkable advancements with the adaptation of the Transformer architecture. Parallel to the strides made by the Transformer, CNN-based U-Net has seen significant progress, especially in high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Seul-Ki Yeom , Julian von Klitzing