English
Related papers

Related papers: S3Former: Self-supervised High-resolution Transfor…

200 papers

Structure-informed protein representation learning is essential for effective protein function annotation and \textit{de novo} design. However, the presence of inherent noise in both crystal and AlphaFold-predicted structures poses…

Biomolecules · Quantitative Biology 2025-03-25 Zhongyue Zhang , Runze Ma , Yanjie Huang , Shuangjia Zheng

Accurate detection and localization of solar photovoltaic (PV) panels in satellite imagery is essential for optimizing microgrids and active distribution networks (ADNs), which are critical components of renewable energy systems. Existing…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Yang Weng

Sea Surface Temperature (SST) prediction plays a vital role in climate modeling and disaster forecasting. However, it remains challenging due to its nonlinear spatiotemporal dynamics and extended prediction horizons. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yin Wang , Chunlin Gong , Zhuozhen Xu , Lehan Zhang , Xiang Wu

Learning feature interaction is the critical backbone to building recommender systems. In web-scale applications, learning feature interaction is extremely challenging due to the sparse and large input feature space; meanwhile, manually…

Information Retrieval · Computer Science 2023-11-13 Huan Gui , Ruoxi Wang , Ke Yin , Long Jin , Maciej Kula , Taibai Xu , Lichan Hong , Ed H. Chi

Accurate detection of defects such as hotspots and snail trails in photovoltaic modules is essential for maintaining energy efficiency and system reliablility. This work presents a supervised deep learning framework for segmenting thermal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Deepak Joshi , Mayukha Pal

Sustained operation of solar photovoltaic assets hinges on accurate detection and prioritization of surface faults across vast, geographically distributed modules. While multi modal imaging strategies are popular, they introduce logistical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Ishwaryah Pandiarajan , Mohamed Mansoor Roomi Sindha , Uma Maheswari Pandyan , Sharafia N

DEtection TRansformer (DETR) started a trend that uses a group of learnable queries for unified visual perception. This work begins by applying this appealing paradigm to LiDAR-based point cloud segmentation and obtains a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zeqi Xiao , Wenwei Zhang , Tai Wang , Chen Change Loy , Dahua Lin , Jiangmiao Pang

Fully-supervised category-level pose estimation aims to determine the 6-DoF poses of unseen instances from known categories, requiring expensive mannual labeling costs. Recently, various self-supervised category-level pose estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Jingtao Sun , Yaonan Wang , Mingtao Feng , Chao Ding , Mike Zheng Shou , Ajmal Saeed Mian

Previous works have shown that increasing the window size for Transformer-based image super-resolution models (e.g., SwinIR) can significantly improve the model performance. Still, the computation overhead is also considerable when the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Yupeng Zhou , Zhen Li , Chun-Le Guo , Li Liu , Ming-Ming Cheng , Qibin Hou

Understanding user intent is essential for situational and context-aware decision-making. Motivated by a real-world scenario, this work addresses intent predictions of smart device users in the vicinity of vehicles by modeling sequential…

Inferring the three-dimensional (3D) solar atmospheric structures from observations is a critical task for advancing our understanding of the magnetic fields and electric currents that drive solar activity. In this work, we introduce a…

3D object detection in point clouds is a core component for modern robotics and autonomous driving systems. A key challenge in 3D object detection comes from the inherent sparse nature of point occupancy within the 3D scene. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Pei Sun , Mingxing Tan , Weiyue Wang , Chenxi Liu , Fei Xia , Zhaoqi Leng , Dragomir Anguelov

Despite the significant advancements in pre-training methods for point cloud understanding, directly capturing intricate shape information from irregular point clouds without reliance on external data remains a formidable challenge. To…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Changshuo Wang , Meiqing Wu , Siew-Kei Lam , Xin Ning , Shangshu Yu , Ruiping Wang , Weijun Li , Thambipillai Srikanthan

Spiking Neural Networks have attracted significant attention in recent years due to their distinctive low-power characteristics. Meanwhile, Transformer models, known for their powerful self-attention mechanisms and parallel processing…

Neural and Evolutionary Computing · Computer Science 2024-12-19 Hangming Zhang , Alexander Sboev , Roman Rybka , Qiang Yu

Transformer-based methods have recently achieved significant success in 3D human pose estimation, owing to their strong ability to model long-range dependencies. However, relying solely on the global attention mechanism is insufficient for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Guangsheng Xu , Guoyi Zhang , Lejia Ye , Shuwei Gan , Xiaohu Zhang , Xia Yang

This paper presents ViewFormer, a simple yet effective model for multi-view 3d shape recognition and retrieval. We systematically investigate the existing methods for aggregating multi-view information and propose a novel ``view set"…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Hongyu Sun , Yongcai Wang , Peng Wang , Xudong Cai , Deying Li

Rain-by-snow weather removal is a specialized task in weather-degraded image restoration aiming to eliminate coexisting rain streaks and snow particles. In this paper, we propose RSFormer, an efficient and effective Transformer that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tao Gao , Yuanbo Wen , Kaihao Zhang , Peng Cheng , Ting Chen

Multivariate time series classification is a crucial task in data mining, attracting growing research interest due to its broad applications. While many existing methods focus on discovering discriminative patterns in time series,…

Machine Learning · Computer Science 2024-12-24 Wenjie Xi , Rundong Zuo , Alejandro Alvarez , Jie Zhang , Byron Choi , Jessica Lin

Deep learning models have gained increasing prominence in recent years in the field of solar pho-tovoltaic (PV) forecasting. One drawback of these models is that they require a lot of high-quality data to perform well. This is often…

Signal Processing · Electrical Eng. & Systems 2025-10-13 Joris Depoortere , Johan Driesen , Johan Suykens , Hussain Syed Kazmi

Automatic tree density estimation and counting using single aerial and satellite images is a challenging task in photogrammetry and remote sensing, yet has an important role in forest management. In this paper, we propose the first…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Hamed Amini Amirkolaee , Miaojing Shi , Mark Mulligan