English
Related papers

Related papers: Embedded Self-Distillation in Compact Multi-Branch…

200 papers

This paper proposes a branched residual network for image classification. It is known that high-level features of deep neural network are more representative than lower-level features. By sharing the low-level features, the network can…

Computer Vision and Pattern Recognition · Computer Science 2017-02-22 Byungju Kim , Youngsoo Kim , Yeakang Lee , Junmo Kim

Optimizing a deep neural network is a fundamental task in computer vision, yet direct training methods often suffer from over-fitting. Teacher-student optimization aims at providing complementary cues from a model trained previously, but…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Chenglin Yang , Lingxi Xie , Chi Su , Alan L. Yuille

Convolutional Neural Networks (CNNs) have revolutionized image classification by extracting spatial features and enabling state-of-the-art accuracy in vision-based tasks. The squeeze and excitation network proposed module gathers…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Mahendran Narayanan

This paper introduces the Strain Elevation Tension Spring embedding (SETSe) algorithm, a graph embedding method that uses a physics model to create node and edge embeddings in undirected attribute networks. Using a low-dimensional…

Social and Information Networks · Computer Science 2020-07-21 Jonathan Bourne

Dataset distillation has demonstrated strong performance on simple datasets like CIFAR, MNIST, and TinyImageNet but struggles to achieve similar results in more complex scenarios. In this paper, we propose EDF (emphasizes the discriminative…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Kai Wang , Zekai Li , Zhi-Qi Cheng , Samir Khaki , Ahmad Sajedi , Ramakrishna Vedantam , Konstantinos N Plataniotis , Alexander Hauptmann , Yang You

Downsampling is widely adopted to achieve a good trade-off between accuracy and latency for visual recognition. Unfortunately, the commonly used pooling layers are not learned, and thus cannot preserve important information. As another…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Ho Man Kwan , Shenghui Song

This paper introduces Progressively Diffused Networks (PDNs) for unifying multi-scale context modeling with deep feature learning, by taking semantic image segmentation as an exemplar application. Prior neural networks, such as ResNet, tend…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Ruimao Zhang , Wei Yang , Zhanglin Peng , Xiaogang Wang , Liang Lin

Traditional machine learning approaches may fail to perform satisfactorily when dealing with complex data. In this context, the importance of data mining evolves w.r.t. building an efficient knowledge discovery and mining framework.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Abdul Mueed Hafiz , Ghulam Mohiuddin Bhat

Network embedding, aiming to project a network into a low-dimensional space, is increasingly becoming a focus of network research. Semi-supervised network embedding takes advantage of labeled data, and has shown promising performance.…

Machine Learning · Computer Science 2025-08-05 Zheng Wang , Xiaojun Ye , Chaokun Wang , Jian Cui , Philip S. Yu

Land cover maps generated from semantic segmentation of high-resolution remotely sensed images have drawn mucon in the photogrammetry and remote sensing research community. Currently, massive fine-resolution remotely sensed (FRRS) images…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Naftaly Wambugu , Ruisheng Wang , Bo Guo , Tianshu Yu , Sheng Xu , Mohammed Elhassan

Recently, there have been significant improvements in the accuracy of CNN models for semantic segmentation. However, these models are often heavy and suffer from low inference speed, which limits their practical application. To address this…

Image and Video Processing · Electrical Eng. & Systems 2025-06-27 Minglong Li , Lianlei Shan , Weiqiang Wang , Ke Lv , Bin Luo , Si-Bao Chen

In this paper, we propose Neural Spectrum Decomposition, a generic decomposition framework for dataset distillation. Unlike previous methods, we consider the entire dataset as a high-dimensional observation that is low-rank across all…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Shaolei Yang , Shen Cheng , Mingbo Hong , Haoqiang Fan , Xing Wei , Shuaicheng Liu

Image reflection separation aims to disentangle the transmission layer and the reflection layer from a blended image. Existing methods rely on limited information from a single image, tending to confuse the two layers when their contrasts…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Siyan Fang , Long Peng , Yuntao Wang , Ruonan Wei , Yuehuan Wang

Both accuracy and efficiency are of significant importance to the task of semantic segmentation. Existing deep FCNs suffer from heavy computations due to a series of high-resolution feature maps for preserving the detailed knowledge in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Tong He , Chunhua Shen , Zhi Tian , Dong Gong , Changming Sun , Youliang Yan

We propose a network architecture to perform efficient scene understanding. This work presents three main novelties: the first is an Improved Guided Upsampling Module that can replace in toto the decoder part in common semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Davide Mazzini , Raimondo Schettini

Learning discriminative image feature embeddings is of great importance to visual recognition. To achieve better feature embeddings, most current methods focus on designing different network structures or loss functions, and the estimated…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Suichan Li , Dapeng Chen , Bin Liu , Nenghai Yu , Rui Zhao

Referring image segmentation (RIS) is a fundamental vision-language task that intends to segment a desired object from an image based on a given natural language expression. Due to the essentially distinct data properties between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Wenxuan Wang , Jing Liu , Xingjian He , Yisi Zhang , Chen Chen , Jiachen Shen , Yan Zhang , Jiangyun Li

The recent studies of knowledge distillation have discovered that ensembling the "dark knowledge" from multiple teachers or students contributes to creating better soft targets for training, but at the cost of significantly more…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Yixiao Ge , Xiao Zhang , Ching Lam Choi , Ka Chun Cheung , Peipei Zhao , Feng Zhu , Xiaogang Wang , Rui Zhao , Hongsheng Li

Semantic segmentation is a computer vision task that associates a label with each pixel in an image. Modern approaches tend to introduce class embeddings into semantic segmentation for deeply utilizing category semantics, and regard…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yuhe Liu , Chuanjian Liu , Kai Han , Quan Tang , Zengchang Qin

Underwater fish detection (UFD) remains a challenging task in computer vision due to low object resolution, significant background interference, and high visual similarity between targets and surroundings. Existing approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Jinsong Yang , Zeyuan Hu , Yichen Li