English
Related papers

Related papers: OperA: Attention-Regularized Transformers for Surg…

200 papers

Multi-task learning based video anomaly detection methods combine multiple proxy tasks in different branches to detect video anomalies in different situations. Most existing methods either do not combine complementary tasks to effectively…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Mohammad Baradaran , Robert Bergevin

Online surgical phase recognition plays a significant role towards building contextual tools that could quantify performance and oversee the execution of surgical workflows. Current approaches are limited since they train spatial feature…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yang Liu , Maxence Boels , Luis C. Garcia-Peraza-Herrera , Tom Vercauteren , Prokar Dasgupta , Alejandro Granados , Sebastien Ourselin

Optical coherence tomography angiography (OCTA) is a noninvasive imaging technique that can reveal high-resolution retinal vessels. In this work, we propose an accurate and efficient neural network for retinal vessel segmentation in OCTA…

Image and Video Processing · Electrical Eng. & Systems 2023-09-19 Haojian Ning , Chengliang Wang , Xinrun Chen , Shiying Li

Time-series data in real-world medical settings typically exhibit long-range dependencies and are observed at non-uniform intervals. In such contexts, traditional sequence-based recurrent models struggle. To overcome this, researchers…

Machine Learning · Statistics 2024-03-18 Fernando Moreno-Pino , Álvaro Arroyo , Harrison Waldon , Xiaowen Dong , Álvaro Cartea

Video stabilization remains a fundamental problem in computer vision, particularly pixel-level synthesis solutions for video stabilization, which synthesize full-frame outputs, add to the complexity of this task. These methods aim to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Muhammad Kashif Ali , Eun Woo Im , Dongjin Kim , Tae Hyun Kim , Vivek Gupta , Haonan Luo , Tianrui Li

Complex-valued signals encode both amplitude and phase, yet most deep models treat attention as real-valued correlation, overlooking interference effects. We introduce the Holographic Transformer, a physics-inspired architecture that…

Signal Processing · Electrical Eng. & Systems 2025-10-31 Enhao Huang , Zhiyu Zhang , Tianxiang Xu , Chunshu Xia , Kaichun Hu , Yuchen Yang , Tongtong Pan , Dong Dong , Zhan Qin

This paper addresses video anomaly detection problem for videosurveillance. Due to the inherent rarity and heterogeneity of abnormal events, the problem is viewed as a normality modeling strategy, in which our model learns object-centric…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Khalil Bergaoui , Yassine Naji , Aleksandr Setkov , Angélique Loesch , Michèle Gouiffès , Romaric Audigier

Precision breast cancer (BC) risk assessment is crucial for developing individualized screening and prevention. Despite the promising potential of recent mammogram (MG) based deep learning models in predicting BC risk, they mostly overlook…

Image and Video Processing · Electrical Eng. & Systems 2024-09-12 Xin Wang , Tao Tan , Yuan Gao , Eric Marcus , Luyi Han , Antonio Portaluri , Tianyu Zhang , Chunyao Lu , Xinglong Liang , Regina Beets-Tan , Jonas Teuwen , Ritse Mann

Unsupervised anomaly detection plays a pivotal role in industrial defect inspection and medical image analysis, with most methods relying on the reconstruction framework. However, these methods may suffer from over-generalization, enabling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wei Luo , Peng Xing , Yunkang Cao , Haiming Yao , Weiming Shen , Zechao Li

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

Medical image segmentation is crucial for diagnosis and treatment planning. Traditional CNN-based models, like U-Net, have shown promising results but struggle to capture long-range dependencies and global context. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Marzia Binta Nizam , Marian Zlateva , James Davis

Inspired by recent trends in vision and language learning, we explore applications of attention mechanisms for visio-lingual fusion within an application to story-based video understanding. Like other video-based QA tasks, video story…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Björn Bebensee , Byoung-Tak Zhang

In recent years, the long-range attention mechanism of vision transformers has driven significant performance breakthroughs across various computer vision tasks. However, the traditional self-attention mechanism, which processes both…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Tianyi Zhang , Baoxin Li , Jae-sun Seo , Yu Cao

Transformers have recently gained attention in the computer vision domain due to their ability to model long-range dependencies. However, the self-attention mechanism, which is the core part of the Transformer model, usually suffers from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Reza Azad , René Arimond , Ehsan Khodapanah Aghdam , Amirhossein Kazerouni , Dorit Merhof

Computer-Assisted Intervention (CAI) has the potential to revolutionize modern surgery, with surgical scene understanding serving as a critical component in supporting decision-making, improving procedural efficacy, and ensuring…

Inspired by the observation that humans are able to process videos efficiently by only paying attention where and when it is needed, we propose an interpretable and easy plug-in spatial-temporal attention mechanism for video action…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Lili Meng , Bo Zhao , Bo Chang , Gao Huang , Wei Sun , Frederich Tung , Leonid Sigal

This paper proposes a novel memory-based online video representation that is efficient, accurate and predictive. This is in contrast to prior works that often rely on computationally heavy 3D convolutions, ignore actual motion when aligning…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Tuan-Hung Vu , Wongun Choi , Samuel Schulter , Manmohan Chandraker

Leading methods in the domain of action recognition try to distill information from both the spatial and temporal dimensions of an input video. Methods that reach State of the Art (SotA) accuracy, usually make use of 3D convolution layers…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Gilad Sharir , Asaf Noy , Lihi Zelnik-Manor

The development of effective training and evaluation strategies is critical. Conventional methods for assessing surgical proficiency typically rely on expert supervision, either through onsite observation or retrospective analysis of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yan Meng , Daniel A. Donoho , Marcelle Altshuler , Omar Arnaout

The interest in leveraging Artificial Intelligence (AI) for surgical procedures to automate analysis has witnessed a significant surge in recent years. One of the primary tools for recording surgical procedures and conducting subsequent…