English
Related papers

Related papers: AMF: Adaptable Weighting Fusion with Multiple Fine…

200 papers

In real-world scenarios, multi-view cameras are typically employed for fine-grained manipulation tasks. Existing approaches (e.g., ACT) tend to treat multi-view features equally and directly concatenate them for policy learning. However, it…

Robotics · Computer Science 2025-07-01 Zihan Lan , Weixin Mao , Haosheng Li , Le Wang , Tiancai Wang , Haoqiang Fan , Osamu Yoshie

When training a neural network for a desired task, one may prefer to adapt a pre-trained network rather than starting from randomly initialized weights. Adaptation can be useful in cases when training data is scarce, when a single learner…

Machine Learning · Computer Science 2020-08-03 Jeffrey O Zhang , Alexander Sax , Amir Zamir , Leonidas Guibas , Jitendra Malik

Convolutional neural networks require numerous data for training. Considering the difficulties in data collection and labeling in some specific tasks, existing approaches generally use models pre-trained on a large source domain (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Zhichen Zhao , Bowen Zhang , Yuning Jiang , Li Xu , Lei Li , Wei-Ying Ma

While fine-grained object recognition is an important problem in computer vision, current models are unlikely to accurately classify objects in the wild. These fully supervised models need additional annotated images to classify objects in…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Timnit Gebru , Judy Hoffman , Li Fei-Fei

Recently, foundation models based on Vision Transformers (ViTs) have become widely available. However, their fine-tuning process is highly resource-intensive, and it hinders their adoption in several edge or low-energy applications. To this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Alessio Devoto , Federico Alvetreti , Jary Pomponi , Paolo Di Lorenzo , Pasquale Minervini , Simone Scardapane

Foundational vision transformer models have shown impressive few shot performance on many vision tasks. This research presents a novel investigation into the application of parameter efficient fine-tuning methods within an active learning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Athmanarayanan Lakshmi Narayanan , Ranganath Krishnan , Amrutha Machireddy , Mahesh Subedar

Deep convolutional neural networks have achieved remarkable success in face recognition (FR), partly due to the abundant data availability. However, the current training benchmarks exhibit an imbalanced quality distribution; most images are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sahar Rahimi Malakshan , Mohammad Saeed Ebrahimi Saadabadi , Nima Najafzadeh , Nasser M. Nasrabadi

Recommender systems are often asked to serve multiple recommendation scenarios or domains. Fine-tuning a pre-trained CTR model from source domains and adapting it to a target domain allows knowledge transferring. However, optimizing all the…

Information Retrieval · Computer Science 2021-06-10 Xiangli Yang , Qing Liu , Rong Su , Ruiming Tang , Zhirong Liu , Xiuqiang He

Self-supervised pre-training of a speech foundation model, followed by supervised fine-tuning, has shown impressive quality improvements on automatic speech recognition (ASR) tasks. Fine-tuning separate foundation models for many downstream…

Machine Learning · Computer Science 2022-11-08 Zhouyuan Huo , Khe Chai Sim , Bo Li , Dongseong Hwang , Tara N. Sainath , Trevor Strohman

Multi-label classification (MLC) requires predicting multiple labels per sample, often under heavy class imbalance and noisy conditions. Traditional approaches apply fixed thresholds or treat labels independently, overlooking context and…

Machine Learning · Computer Science 2025-05-07 Dmytro Shamatrin

Many studies have been conducted so far on image restoration, the problem of restoring a clean image from its distorted version. There are many different types of distortion which affect image quality. Previous studies have focused on…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Masanori Suganuma , Xing Liu , Takayuki Okatani

Foundation models have significantly advanced medical image analysis through the pre-train fine-tune paradigm. Among various fine-tuning algorithms, Parameter-Efficient Fine-Tuning (PEFT) is increasingly utilized for knowledge transfer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Raman Dutt , Linus Ericsson , Pedro Sanchez , Sotirios A. Tsaftaris , Timothy Hospedales

This paper studies deep network architectures to address the problem of video classification. A multi-stream framework is proposed to fully utilize the rich multimodal information in videos. Specifically, we first train three Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2015-11-12 Zuxuan Wu , Yu-Gang Jiang , Xi Wang , Hao Ye , Xiangyang Xue , Jun Wang

This paper presents an automatic network adaptation method that finds a ConvNet structure well-suited to a given target task, e.g., image classification, for efficiency as well as accuracy in transfer learning. We call the concept…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Yang Zhong , Vladimir Li , Ryuzo Okada , Atsuto Maki

Training an object detector on a data-rich domain and applying it to a data-poor one with limited performance drop is highly attractive in industry, because it saves huge annotation cost. Recent research on unsupervised domain adaptive…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Chenfan Zhuang , Xintong Han , Weilin Huang , Matthew R. Scott

An ensemble method that fuses the output decision vectors of multiple feedforward-designed convolutional neural networks (FF-CNNs) to solve the image classification problem is proposed in this work. To enhance the performance of the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Yueru Chen , Yijing Yang , Wei Wang , C. -C. Jay Kuo

Deep learning based models are used regularly in every applications nowadays. Generally we train a single model on a single task. However, we can train multiple tasks on a single model under multi-task learning settings. This provides us…

Machine Learning · Computer Science 2023-03-14 Aminul Huq , Mst Tasnim Pervin

Learning multi-view data is an emerging problem in machine learning research, and nonnegative matrix factorization (NMF) is a popular dimensionality-reduction method for integrating information from multiple views. These views often provide…

Machine Learning · Statistics 2023-04-26 Shuo Shuo Liu , Lin Lin

Underwater image enhancement is an important low-level computer vision task for autonomous underwater vehicles and remotely operated vehicles to explore and understand the underwater environments. Recently, deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Hao-Hsiang Yang , Kuan-Chih Huang , Wei-Ting Chen

Adapter tuning, which updates only a few parameters, has become a mainstream method for fine-tuning pretrained language models to downstream tasks. However, it often yields subpar results in few-shot learning. AdapterFusion, which assembles…

Computation and Language · Computer Science 2023-08-31 Shwai He , Run-Ze Fan , Liang Ding , Li Shen , Tianyi Zhou , Dacheng Tao