English
Related papers

Related papers: ReMaX: Relaxing for Better Training on Efficient P…

200 papers

It has been observed in practical applications and in theoretical analysis that over-parametrization helps to find good minima in neural network training. Similarly, in this article we study widening and deepening neural networks by a…

Numerical Analysis · Mathematics 2020-02-06 G. Welper

In this work, we propose to progressively increase the training difficulty during learning a neural network model via a novel strategy which we call mini-batch trimming. This strategy makes sure that the optimizer puts its focus in the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Hannes Fassold

We introduce Dynamic Dropout, a novel regularization technique designed to enhance the training efficiency of Transformer models by dynamically adjusting the dropout rate based on training epochs or validation loss improvements. This…

Machine Learning · Computer Science 2024-11-06 Hanrui Yan , Dan Shao

Recently, pre-trained vision-language models have been increasingly used to tackle the challenging zero-shot segmentation task. Typical solutions follow the paradigm of first generating mask proposals and then adopting CLIP to classify…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Siyu Jiao , Yunchao Wei , Yaowei Wang , Yao Zhao , Humphrey Shi

Pre-training with random masked inputs has emerged as a novel trend in self-supervised training. However, supervised learning still faces a challenge in adopting masking augmentations, primarily due to unstable training. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Byeongho Heo , Taekyung Kim , Sangdoo Yun , Dongyoon Han

In recent years, self-supervised learning has attracted widespread academic debate and addressed many of the key issues of computer vision. The present research focus is on how to construct a good agent task that allows for improved network…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Zhijie Xiao , Zhicheng Dong , Hao Xiang

Tensor decomposition methods have proven effective in various applications, including compression and acceleration of neural networks. At the same time, the problem of determining optimal decomposition ranks, which present the crucial…

Machine Learning · Computer Science 2023-04-05 Maxim Kodryan , Dmitry Kropotov , Dmitry Vetrov

Undersampling is a common method in Magnetic Resonance Imaging (MRI) to subsample the number of data points in k-space, reducing acquisition times at the cost of decreased image quality. A popular approach is to employ undersampling…

Image and Video Processing · Electrical Eng. & Systems 2023-08-23 Tobias Weber , Michael Ingrisch , Bernd Bischl , David Rügamer

We are considering in this paper the task of label-efficient fine-tuning of segmentation models: We assume that a large labeled dataset is available and allows to train an accurate segmentation model in one domain, and that we have to adapt…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Bruno Sauvalle , Mathieu Salzmann

Semantic segmentation is the task of classifying each pixel in an image. Training a segmentation model achieves best results using annotated images, where each pixel is annotated with the corresponding class. When obtaining fine annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Jort de Jong , Mike Holenderski

Remote sensing image change description represents an innovative multimodal task within the realm of remote sensing processing.This task not only facilitates the detection of alterations in surface conditions, but also provides…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Dongwei Sun , Jing Yao , Wu Xue , Changsheng Zhou , Pedram Ghamisi , Xiangyong Cao

To better support retrieval applications such as web search and question answering, growing effort is made to develop retrieval-oriented language models. Most of the existing works focus on improving the semantic representation capability…

Computation and Language · Computer Science 2022-11-17 Shitao Xiao , Zheng Liu

Many automated processes such as auto-piloting rely on a good semantic segmentation as a critical component. To speed up performance, it is common to downsample the input frame. However, this comes at the cost of missed small objects and…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Dmitrii Marin , Zijian He , Peter Vajda , Priyam Chatterjee , Sam Tsai , Fei Yang , Yuri Boykov

Due to the optical properties, transparent objects often lead depth cameras to generate incomplete or invalid depth data, which in turn reduces the accuracy and reliability of robotic grasping. Existing approaches typically input the RGB-D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yaofeng Cheng , Xinkai Gao , Sen Zhang , Chao Zeng , Fusheng Zha , Lining Sun , Chenguang Yang

Panoptic segmentation assigns semantic and instance ID labels to every pixel of an image. As permutations of instance IDs are also valid solutions, the task requires learning of high-dimensional one-to-many mapping. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Ting Chen , Lala Li , Saurabh Saxena , Geoffrey Hinton , David J. Fleet

This paper presents a new framework for open-vocabulary semantic segmentation with the pre-trained vision-language model, named Side Adapter Network (SAN). Our approach models the semantic segmentation task as a region recognition problem.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Mengde Xu , Zheng Zhang , Fangyun Wei , Han Hu , Xiang Bai

Open-vocabulary image segmentation is attracting increasing attention due to its critical applications in the real world. Traditional closed-vocabulary segmentation methods are not able to characterize novel objects, whereas several recent…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Xi Chen , Shuang Li , Ser-Nam Lim , Antonio Torralba , Hengshuang Zhao

Most machine vision tasks (e.g., semantic segmentation) are based on images encoded and decoded by image compression algorithms (e.g., JPEG). However, these decoded images in the pixel domain introduce distortion, and they are optimized for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Jinming Liu , Heming Sun , Jiro Katto

For deep reinforcement learning (RL) from pixels, learning effective state representations is crucial for achieving high performance. However, in practice, limited experience and high-dimensional inputs prevent effective representation…

Machine Learning · Computer Science 2022-10-11 Tao Yu , Zhizheng Zhang , Cuiling Lan , Yan Lu , Zhibo Chen

Object segmentation is a key component in the visual system of a robot that performs tasks like grasping and object manipulation, especially in presence of occlusions. Like many other computer vision tasks, the adoption of deep…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Federico Ceola , Elisa Maiettini , Giulia Pasquale , Lorenzo Rosasco , Lorenzo Natale
‹ Prev 1 8 9 10 Next ›