English
Related papers

Related papers: Polarized Self-Attention: Towards High-quality Pix…

200 papers

Vehicle re-identification (re-ID) focuses on matching images of the same vehicle across different cameras. It is fundamentally challenging because differences between vehicles are sometimes subtle. While several studies incorporate…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Tsai-Shien Chen , Chih-Ting Liu , Chih-Wei Wu , Shao-Yi Chien

The objective of single image dehazing is to restore hazy images and produce clear, high-quality visuals. Traditional convolutional models struggle with long-range dependencies due to their limited receptive field size. While Transformers…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Lihan Tong , Yun Liu , Tian Ye , Weijia Li , Liyuan Chen , Erkang Chen

In this paper, we propose a novel approach named by Discriminative Principal Component Analysis which is abbreviated as Discriminative PCA in order to enhance separability of PCA by Linear Discriminant Analysis (LDA). The proposed method…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Hanli Qiao

Most convolutional network (CNN)-based inpainting methods adopt standard convolution to indistinguishably treat valid pixels and holes, making them limited in handling irregular holes and more likely to generate inpainting results with…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Chaohao Xie , Shaohui Liu , Chao Li , Ming-Ming Cheng , Wangmeng Zuo , Xiao Liu , Shilei Wen , Errui Ding

Labeling medical images depends on professional knowledge, making it difficult to acquire large amount of annotated medical images with high quality in a short time. Thus, making good use of limited labeled samples in a small dataset to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Peng Jiang , Juan Liu , Lang Wang , Zhihui Ynag , Hongyu Dong , Jing Feng

Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However, many existing vision transformer (ViT) works simply inherent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Leijie Wu , Song Guo , Yaohong Ding , Junxiao Wang , Wenchao Xu , Richard Yida Xu , Jie Zhang

This paper proposes a novel sparse principal component analysis algorithm with self-learning ability for successive modes, where synaptic intelligence is employed to measure the importance of variables and a regularization term is added to…

Machine Learning · Computer Science 2021-08-10 Jingxin Zhang , Donghua Zhou , Maoyin Chen

Pixel-level annotation demands expensive human efforts and limits the performance of deep networks that usually benefits from more such training data. In this work we aim to achieve high quality instance and semantic segmentation results…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Chuang Niu , Shenghan Ren , Jimin Liang

Discriminative features play an important role in image and object classification and also in other fields of research such as semi-supervised learning, fine-grained classification, out of distribution detection. Inspired by Linear…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Mai Lan Ha , Gianni Franchi , Emanuel Aldea , Volker Blanz

Channel and spatial attentions have respectively brought significant improvements in extracting feature dependencies and spatial structure relations for various downstream vision tasks. While their combination is more beneficial for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Yunzhong Si , Huiying Xu , Xinzhong Zhu , Wenhao Zhang , Yao Dong , Yuxing Chen , Hongbo Li

While originally designed for natural language processing tasks, the self-attention mechanism has recently taken various computer vision areas by storm. However, the 2D nature of images brings three challenges for applying self-attention in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Meng-Hao Guo , Cheng-Ze Lu , Zheng-Ning Liu , Ming-Ming Cheng , Shi-Min Hu

Semantic segmentation in very high resolution (VHR) aerial images is one of the most challenging tasks in remote sensing image understanding. Most of the current approaches are based on deep convolutional neural networks (DCNNs). However,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Ruigang Niu , Xian Sun , Yu Tian , Wenhui Diao , Kaiqiang Chen , Kun Fu

Spectral clustering is a popular method for effectively clustering nonlinearly separable data. However, computational limitations, memory requirements, and the inability to perform incremental learning challenge its widespread application.…

Machine Learning · Computer Science 2023-11-15 Jo-Chun Chen , Hung-Hsuan Chen

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Attention serves as the fundamental mechanism for long-context modeling in large language models (LLMs), yet dense attention becomes structurally prohibitive for long sequences due to its quadratic complexity. Consequently, sparse attention…

Computation and Language · Computer Science 2026-01-07 Junxiang Qiu , Shuo Wang , Zhengsu Chen , Hengheng Zhang , Jinda Lu , Changcheng Li , Qi Tian

State-of-the-art semantic segmentation methods were almost exclusively trained on images within a fixed resolution range. These segmentations are inaccurate for very high-resolution images since using bicubic upsampling of low-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Ho Kei Cheng , Jihoon Chung , Yu-Wing Tai , Chi-Keung Tang

Object parts serve as crucial intermediate representations in various downstream tasks, but part-level representation learning still has not received as much attention as other vision tasks. Previous research has established that Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jiahao Xia , Wenjian Huang , Min Xu , Jianguo Zhang , Haimin Zhang , Ziyu Sheng , Dong Xu

Regularized variants of Principal Components Analysis, especially Sparse PCA and Functional PCA, are among the most useful tools for the analysis of complex high-dimensional data. Many examples of massive data, have both sparse and…

Machine Learning · Statistics 2019-08-21 Genevera I. Allen , Michael Weylandt

Representational similarity analysis (RSA) is a multivariate technique to investigate cortical representations of objects or constructs. While avoiding ill-posed matrix inversions that plague multivariate approaches in the presence of many…

Methodology · Statistics 2021-12-03 Roberto Viviani

The task of point cloud upsampling aims to acquire dense and uniform point sets from sparse and irregular point sets. Although significant progress has been made with deep learning models, state-of-the-art methods require ground-truth dense…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Xinhai Liu , Xinchen Liu , Yu-Shen Liu , Zhizhong Han