English
Related papers

Related papers: S3Former: Self-supervised High-resolution Transfor…

200 papers

Timely and accurate detection of defects and contaminants in solar panels is critical for maintaining the efficiency and reliability of photovoltaic (PV) systems. While recent studies have applied deep learning to PV inspection, fair…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Ashen Rodrigo , Isuru Munasinghe , Pubudu Sanjeewani , Asanka Perera

Providing reliable predictive maintenance is a critical industrial AI service essential for ensuring the high availability of manufacturing devices. Existing deep-learning methods present competitive results on such tasks but lack a general…

Machine Learning · Computer Science 2026-03-25 Jiahui Zhou , Dan Li , Ruibing Jin , Jian Lou , Yanran Zhao , Zhenghua Chen , Zigui Jiang , See-Kiong Ng

The pre-trained transformer demonstrates remarkable generalization ability in natural image processing. However, directly transferring it to magnetic resonance images faces two key challenges: the inability to adapt to the specificity of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jingkai Li , Xiaoze Tian , Yuhang Shen , Jia Wang , Dianjie Lu , Guijuan Zhang , Zhuoran Zheng

The energy transition towards photovoltaic solar energy has evolved to be a viable and sustainable source for the generation of electricity. It has effectively emerged as an alternative to the conventional mode of electricity generation for…

Image and Video Processing · Electrical Eng. & Systems 2023-01-02 Divyanshi Dwivedi , Pradeep Kumar Yemula , Mayukha Pal

We introduce SkelFormer, a novel markerless motion capture pipeline for multi-view human pose and shape estimation. Our method first uses off-the-shelf 2D keypoint estimators, pre-trained on large-scale in-the-wild data, to obtain 3D joint…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Vandad Davoodnia , Saeed Ghorbani , Alexandre Messier , Ali Etemad

Transformer-based methods have demonstrated superior performance for monocular 3D object detection recently, which aims at predicting 3D attributes from a single 2D image. Most existing transformer-based methods leverage both visual and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Xuan He , Fan Yang , Kailun Yang , Jiacheng Lin , Haolong Fu , Meng Wang , Jin Yuan , Zhiyong Li

Standard registration algorithms need to be independently applied to each surface to register, following careful pre-processing and hand-tuning. Recently, learning-based approaches have emerged that reduce the registration of new scans to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Mehdi Bahri , Eimear O' Sullivan , Shunwang Gong , Feng Liu , Xiaoming Liu , Michael M. Bronstein , Stefanos Zafeiriou

Accurate photovoltaic (PV) power forecasting is critical for integrating renewable energy sources into the grid, optimizing real-time energy management, and ensuring energy reliability amidst increasing demand. However, existing models…

Machine Learning · Computer Science 2025-05-08 Guang Wu , Yun Wang , Qian Zhou , Ziyang Zhang

Photovoltaic (PV) systems allow us to tap into all abundant solar energy, however they require regular maintenance for high efficiency and to prevent degradation. Traditional manual health check, using Electroluminescence (EL) imaging, is…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Abhishek Jha , Yogesh Rawat , Shruti Vyas

How to identify and segment camouflaged objects from the background is challenging. Inspired by the multi-head self-attention in Transformers, we present a simple masked separable attention (MSA) for camouflaged object detection. We first…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Bowen Yin , Xuying Zhang , Qibin Hou , Bo-Yuan Sun , Deng-Ping Fan , Luc Van Gool

Designing novel functional proteins crucially depends on accurately modeling their fitness landscape. Given the limited availability of functional annotations from wet-lab experiments, previous methods have primarily relied on…

Machine Learning · Computer Science 2024-12-03 Zuobai Zhang , Pascal Notin , Yining Huang , Aurélie Lozano , Vijil Chenthamarakshan , Debora Marks , Payel Das , Jian Tang

Vision Transformer has demonstrated impressive success across various vision tasks. However, its heavy computation cost, which grows quadratically with respect to the token sequence length, largely limits its power in handling large feature…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Sucheng Ren , Xingyi Yang , Songhua Liu , Xinchao Wang

3D human pose estimation can be handled by encoding the geometric dependencies between the body parts and enforcing the kinematic constraints. Recently, Transformer has been adopted to encode the long-range dependencies between the joints…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Mohammed Hassanin , Abdelwahed Khamiss , Mohammed Bennamoun , Farid Boussaid , Ibrahim Radwan

Recent Transformer-based low-light enhancement methods have made promising progress in recovering global illumination. However, they still struggle with non-uniform lighting scenarios, such as backlit and shadow, appearing as over-exposure…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Hanting Li , Fei Zhou , Xin Sun , Yang Hua , Jungong Han , Liang-Jie Zhang

Solar Photovoltaic (PV) technology is increasingly recognized as a pivotal solution in the global pursuit of clean and renewable energy. This technology addresses the urgent need for sustainable energy alternatives by converting solar power…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhiyuan Yang , Ryan Rad

Detailed structural and species information on individual tree level is increasingly important to support precision forestry, biodiversity conservation, and provide reference data for biomass and carbon mapping. Point clouds from airborne…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Aldino Rizaldy , Fabian Ewald Fassnacht , Ahmed Jamal Afifi , Hua Jiang , Richard Gloaguen , Pedram Ghamisi

Partial point cloud registration is a challenging problem in robotics, especially when the robot undergoes a large transformation, causing a significant initial pose error and a low overlap between measurements. This work proposes…

Robotics · Computer Science 2024-07-25 Chien Erh Lin , Minghan Zhu , Maani Ghaffari

Precise localization is critical for autonomous vehicles. We present a self-supervised learning method that employs Transformers for the first time for the task of outdoor localization using LiDAR data. We propose a pre-text task that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Muhammad Ibrahim , Naveed Akhtar , Saeed Anwar , Michael Wise , Ajmal Mian

Transformer-based Self-supervised Representation Learning methods learn generic features from unlabeled datasets for providing useful network initialization parameters for downstream tasks. Recently, self-supervised learning based upon…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Jincen Jiang , Xuequan Lu , Lizhi Zhao , Richard Dazeley , Meili Wang

Solar energy is rapidly becoming a robust renewable energy source to conventional finite resources such as fossil fuels. It is harvested using interconnected photovoltaic panels, typically built with crystalline silicon cells, i.e.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Booy Vitas Faassen , Jorge Serrano , Paul D. Rosero-Montalvo