English
Related papers

Related papers: A Full Transformer-based Framework for Automatic P…

200 papers

Automatic pain intensity assessment has a high value in disease diagnosis applications. Inspired by the fact that many diseases and brain disorders can interrupt normal facial expression formation, we aim to develop a computational model…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Mohammad Tavakolian , Abdenour Hadid

Transformer is a new kind of neural architecture which encodes the input data as powerful features via the attention mechanism. Basically, the visual transformers first divide the input images into several local patches and then calculate…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Kai Han , An Xiao , Enhua Wu , Jianyuan Guo , Chunjing Xu , Yunhe Wang

Law enforcement and city safety are significantly impacted by detecting violent incidents in surveillance systems. Although modern (smart) cameras are widely available and affordable, such technological solutions are impotent in most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Sanskar Singh , Shivaibhav Dewangan , Ghanta Sai Krishna , Vandit Tyagi , Sainath Reddy , Prathistith Raj Medi

Visual place recognition is a challenging task for applications such as autonomous driving navigation and mobile robot localization. Distracting elements presenting in complex scenes often lead to deviations in the perception of visual…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ruotong Wang , Yanqing Shen , Weiliang Zuo , Sanping Zhou , Nanning Zheng

This paper introduces a new concept called "transferable visual words" (TransVW), aiming to achieve annotation efficiency for deep learning in medical image analysis. Medical imaging--focusing on particular parts of the body for defined…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Fatemeh Haghighi , Mohammad Reza Hosseinzadeh Taher , Zongwei Zhou , Michael B. Gotway , Jianming Liang

Audio Visual Scene-aware Dialog (AVSD) is a task to generate responses when discussing about a given video. The previous state-of-the-art model shows superior performance for this task using Transformer-based architecture. However, there…

Computation and Language · Computer Science 2020-10-22 Wubo Li , Dongwei Jiang , Wei Zou , Xiangang Li

Transformer models have shown great success handling long-range interactions, making them a promising tool for modeling video. However, they lack inductive biases and scale quadratically with input length. These limitations are further…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Javier Selva , Anders S. Johansen , Sergio Escalera , Kamal Nasrollahi , Thomas B. Moeslund , Albert Clapés

Automatic pain intensity estimation plays a pivotal role in healthcare and medical fields. While many methods have been developed to gauge human pain using behavioral or physiological indicators, facial expressions have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Issam Serraoui , Eric Granger , Abdenour Hadid , Abdelmalik Taleb-Ahmed

Visual segmentation seeks to partition images, video frames, or point clouds into multiple segments or groups. This technique has numerous real-world applications, such as autonomous driving, image editing, robot sensing, and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiangtai Li , Henghui Ding , Haobo Yuan , Wenwei Zhang , Jiangmiao Pang , Guangliang Cheng , Kai Chen , Ziwei Liu , Chen Change Loy

Transformers have recently shown superior performances on various vision tasks. The large, sometimes even global, receptive field endows Transformer models with higher representation power over their CNN counterparts. Nevertheless, simply…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zhuofan Xia , Xuran Pan , Shiji Song , Li Erran Li , Gao Huang

Training on large-scale datasets can boost the performance of video instance segmentation while the annotated datasets for VIS are hard to scale up due to the high labor cost. What we possess are numerous isolated filed-specific datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Yu Qiao , Hengshuang Zhao

The automatic classification of 3D medical data is memory-intensive. Also, variations in the number of slices between samples is common. Na\"ive solutions such as subsampling can solve these problems, but at the cost of potentially…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Marzieh Oghbaie , Teresa Araujo , Taha Emre , Ursula Schmidt-Erfurth , Hrvoje Bogunovic

Transformer-based neural networks have surpassed promising performance on many biomedical image segmentation tasks due to a better global information modeling from the self-attention mechanism. However, most methods are still designed for…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Zheyuan Zhang , Ulas Bagci

Synthesizing high-quality dynamic medical videos remains a significant challenge due to the need for modeling both spatial consistency and temporal dynamics. Existing Transformer-based approaches face critical limitations, including…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Huihan Wang , Zhiwen Yang , Hui Zhang , Dan Zhao , Bingzheng Wei , Yan Xu

We present a convolution-free approach to video classification built exclusively on self-attention over space and time. Our method, named "TimeSformer," adapts the standard Transformer architecture to video by enabling spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Gedas Bertasius , Heng Wang , Lorenzo Torresani

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Transformer architecture has emerged to be successful in a number of natural language processing tasks. However, its applications to medical vision remain largely unexplored. In this study, we present UTNet, a simple yet powerful hybrid…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Yunhe Gao , Mu Zhou , Dimitris Metaxas

Convolutional Neural Networks (CNNs) have advanced existing medical systems for automatic disease diagnosis. However, there are still concerns about the reliability of deep medical diagnosis systems against the potential threats of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Omid Nejati Manzari , Hamid Ahmadabadi , Hossein Kashiani , Shahriar B. Shokouhi , Ahmad Ayatollahi

While current methods have shown promising progress on estimating 3D human motion from monocular videos, their motion estimates are often physically unrealistic because they mainly consider kinematics. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yufei Zhang , Jeffrey O. Kephart , Zijun Cui , Qiang Ji

Biomedical image classification requires capturing of bio-informatics based on specific feature distribution. In most of such applications, there are mainly challenges due to limited availability of samples for diseased cases and imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Arun K. Sharma , Nishchal K. Verma