English
Related papers

Related papers: Wavelet-Driven Masked Image Modeling: A Path to Ef…

200 papers

Masked Autoencoders (MAE) achieve self-supervised learning of image representations by randomly removing a portion of visual tokens and reconstructing the original image as a pretext task, thereby significantly enhancing pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jiaxuan Li , Qing Xu , Xiangjian He , Ziyu Liu , Chang Xing , Zhen Chen , Daokun Zhang , Rong Qu , Chang Wen Chen

Deep image prior (DIP), which utilizes a deep convolutional network (ConvNet) structure itself as an image prior, has attracted attentions in computer vision and machine learning communities. It empirically shows the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Tatsuya Yokota , Hidekata Hontani , Qibin Zhao , Andrzej Cichocki

Recent years have witnessed the great success of deep convolutional neural networks (CNNs) in image denoising. Albeit deeper network and larger model capacity generally benefit performance, it remains a challenging practical issue to train…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Yali Peng , Yue Cao , Shigang Liu , Jian Yang , Wangmeng Zuo

Multimodal representation learning has shown promising improvements on various vision-language tasks. Most existing methods excel at building global-level alignment between vision and language while lacking effective fine-grained image-text…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zijia Zhao , Longteng Guo , Xingjian He , Shuai Shao , Zehuan Yuan , Jing Liu

Image retargeting aims to alter the size of the image with attention to the contents. One of the main obstacles to training deep learning models for image retargeting is the need for a vast labeled dataset. Labeled datasets are unavailable…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 MohammadHossein Givkashi , MohammadReza Naderi , Nader Karimi , Shahram Shirani , Shadrokh Samavi

Continual learning (CL) aims to learn new tasks while retaining past knowledge, addressing the challenge of forgetting during task adaptation. Rehearsal-based methods, which replay previous samples, effectively mitigate forgetting. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Ruiqi Liu , Boyu Diao , Libo Huang , Hangda Liu , Chuanguang Yang , Zhulin An , Yongjun Xu

Diffusion model shows remarkable potential on sparse-view computed tomography (SVCT) reconstruction. However, when a network is trained on a limited sample space, its generalization capability may be constrained, which degrades performance…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Zekun Zhou , Tan Liu , Bing Yu , Yanru Gong , Liu Shi , Qiegen Liu

Spatial frequency analysis and transforms serve a central role in most engineered image and video lossy codecs, but are rarely employed in neural network (NN)-based approaches. We propose a novel NN-based image coding framework that…

Image and Video Processing · Electrical Eng. & Systems 2023-01-04 Hyomin Choi , Fabien Racape , Shahab Hamidi-Rad , Mateen Ulhaq , Simon Feltman

We present a comparative study on how and why contrastive learning (CL) and masked image modeling (MIM) differ in their representations and in their performance of downstream tasks. In particular, we demonstrate that self-supervised Vision…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Namuk Park , Wonjae Kim , Byeongho Heo , Taekyung Kim , Sangdoo Yun

Generative transformers have experienced rapid popularity growth in the computer vision community in synthesizing high-fidelity and high-resolution images. The best generative transformer models so far, however, still treat an image naively…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Huiwen Chang , Han Zhang , Lu Jiang , Ce Liu , William T. Freeman

A novel energy-efficient edge computing paradigm is proposed for real-time deep learning-based image upsampling applications. State-of-the-art deep learning solutions for image upsampling are currently trained using either resize or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Ian Colbert , Ken Kreutz-Delgado , Srinjoy Das

Low-light image enhancement techniques have significantly progressed, but unstable image quality recovery and unsatisfactory visual perception are still significant challenges. To solve these problems, we propose a novel and robust…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Minglong Xue , Jinhong He , Wenhai Wang , Mingliang Zhou

We present a new approach for representing and reconstructing multidimensional magnetic resonance imaging (MRI) data. Our method builds on a novel, learned feature-based image representation that disentangles different types of features,…

Image and Video Processing · Electrical Eng. & Systems 2026-01-01 Ruiyang Zhao , Fan Lam

The GHM multi-level discrete wavelet transform is proposed as preprocessing for image super resolution with convolutional neural networks. Previous works perform analysis with the Haar wavelet only. In this work, 37 single-level wavelets…

Image and Video Processing · Electrical Eng. & Systems 2022-04-19 Ben Lowe , Hadi Salman , Justin Zhan

As the deep learning revolution marches on, masked modeling has emerged as a distinctive approach that involves predicting parts of the original data that are proportionally masked during training, and has demonstrated exceptional…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Qinrong Cai , Yu Guan , Zhibo Chen , Dong Liang , Qiuyun Fan , Qiegen Liu

We propose a novel neural architecture for computer vision -- WaveMix -- that is resource-efficient and yet generalizable and scalable. While using fewer trainable parameters, GPU RAM, and computations, WaveMix networks achieve comparable…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Pranav Jeevan , Kavitha Viswanathan , Anandu A S , Amit Sethi

Sparse representation of images under certain transform domain has been playing a fundamental role in image restoration tasks. One such representative method is the widely used wavelet tight frame systems. Instead of adopting fixed filters…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Dai-Qiang Chen

In view of the fact that semi- and self-supervised learning share a fundamental principle, effectively modeling knowledge from unlabeled data, various semi-supervised semantic segmentation methods have integrated representative…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yangyang Li , Xuanting Hao , Ronghua Shang , Licheng Jiao

Policy learning focuses on devising strategies for agents in embodied artificial intelligence systems to perform optimal actions based on their perceived states. One of the key challenges in policy learning involves handling complex,…

Robotics · Computer Science 2025-07-08 Hao Huang , Shuaihang Yuan , Geeta Chandra Raju Bethala , Congcong Wen , Anthony Tzes , Yi Fang

While transformers have surpassed convolutional neural networks (CNNs) in various computer vision tasks, microelectronics defect detection still largely relies on CNNs. We hypothesize that this gap is due to the fact that a) transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Nikolai Röhrich , Alwin Hoffmann , Richard Nordsieck , Emilio Zarbali , Alireza Javanmardi