English
Related papers

Related papers: Structured Gradient Guidance for Few-Shot Adaptati…

200 papers

Instruction tuning is a pivotal technique for aligning large language models (LLMs) with human intentions, safety constraints, and domain-specific requirements. This survey provides a comprehensive overview of the full pipeline,…

Computation and Language · Computer Science 2025-11-20 Xudong Han , Junjie Yang , Tianyang Wang , Ziqian Bi , Xinyuan Song , Junfeng Hao , Junhao Song

Multilingual models jointly pretrained on multiple languages have achieved remarkable performance on various multilingual downstream tasks. Moreover, models finetuned on a single monolingual downstream task have shown to generalize to…

Computation and Language · Computer Science 2022-03-01 Seanie Lee , Hae Beom Lee , Juho Lee , Sung Ju Hwang

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion model towards…

Machine Learning · Statistics 2024-10-17 Yingqing Guo , Hui Yuan , Yukang Yang , Minshuo Chen , Mengdi Wang

A promising paradigm for adapting instruction-tuned language models is to learn task-specific updates on a pretrained base model and subsequently merge them into the instruction-tuned model. However, existing approaches typically treat the…

Computation and Language · Computer Science 2026-05-05 Zhiwen Ruan , Yichao Du , Jianjie Zheng , Longyue Wang , Yun Chen , Peng Li , Jinsong Su , Yang Liu , Guanhua Chen

Deep learning networks are typically trained by Stochastic Gradient Descent (SGD) methods that iteratively improve the model parameters by estimating a gradient on a very small fraction of the training data. A major roadblock faced when…

Machine Learning · Computer Science 2020-06-11 Tao Lin , Lingjing Kong , Sebastian U. Stich , Martin Jaggi

Fine-tuning is a promising technique for leveraging Transformer-based language models in downstream tasks. As model sizes continue to grow, updating all model parameters becomes increasingly costly. Parameter-efficient fine-tuning methods…

Computation and Language · Computer Science 2025-06-27 Xiaoshuang Ji , Zhendong Zhao , Xiaojun Chen , Xin Zhao , Zeyao Liu

There are two primary ways of incorporating new information into a language model (LM): changing its prompt or changing its parameters, e.g. via fine-tuning. Parameter updates incur no long-term storage cost for model changes. However, for…

Computation and Language · Computer Science 2025-06-27 Eric Zhang , Leshem Choshen , Jacob Andreas

Gradient-based iterative optimization methods are the workhorse of modern machine learning. They crucially rely on careful tuning of parameters like learning rate and momentum. However, one typically sets them using heuristic approaches…

Machine Learning · Computer Science 2025-12-05 Dravyansh Sharma

Although recent years have witnessed significant advancements in medical image segmentation, the pervasive issue of domain shift among medical images from diverse centres hinders the effective deployment of pre-trained models. Many…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Ziyang Chen , Yiwen Ye , Yongsheng Pan , Yong Xia

Learning an efficient update rule from data that promotes rapid learning of new tasks from the same distribution remains an open problem in meta-learning. Typically, previous works have approached this issue either by attempting to train a…

Machine Learning · Computer Science 2020-02-19 Sebastian Flennerhag , Andrei A. Rusu , Razvan Pascanu , Francesco Visin , Hujun Yin , Raia Hadsell

Gradient dynamics play a central role in determining the stability and generalization of deep neural networks. In this work, we provide an empirical analysis of how variance and standard deviation of gradients evolve during training,…

Machine Learning · Computer Science 2025-09-09 Vincent-Daniel Yun

Deep multitask networks, in which one neural network produces multiple predictive outputs, can offer better speed and performance than their single-task counterparts but are challenging to train properly. We present a gradient normalization…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Zhao Chen , Vijay Badrinarayanan , Chen-Yu Lee , Andrew Rabinovich

The current state-of-the-art for few-shot cross-lingual transfer learning first trains on abundant labeled data in the source language and then fine-tunes with a few examples on the target language, termed target-adapting. Though this has…

Computation and Language · Computer Science 2022-05-02 Haoran Xu , Kenton Murray

Large language models (LLMs) are a promising avenue for machine translation (MT). However, current LLM-based MT systems are brittle: their effectiveness highly depends on the choice of few-shot examples and they often require extra…

Few-shot segmentation (FSS) expects models trained on base classes to work on novel classes with the help of a few support images. However, when there exists a domain gap between the base and novel classes, the state-of-the-art FSS methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yuhang Lu , Xinyi Wu , Zhenyao Wu , Song Wang

To mitigate the negative effect of low quality training data on the performance of neural machine translation models, most existing strategies focus on filtering out harmful data before training starts. In this paper, we explore strategies…

Computation and Language · Computer Science 2021-03-01 Xinyi Wang , Ankur Bapna , Melvin Johnson , Orhan Firat

In scientific machine learning, regression networks have been recently applied to approximate solution maps (e.g., potential-ground state map of Schr\"odinger equation). In this paper, we aim to reduce the generalization error without…

Numerical Analysis · Mathematics 2021-02-16 Zhihan Li , Yuwei Fan , Lexing Ying

Recent studies have revealed the intriguing few-shot learning ability of pretrained language models (PLMs): They can quickly adapt to a new task when fine-tuned on a small amount of labeled data formulated as prompts, without requiring…

Computation and Language · Computer Science 2023-05-15 Yu Meng , Martin Michalski , Jiaxin Huang , Yu Zhang , Tarek Abdelzaher , Jiawei Han

Few-shot object detection, the problem of modelling novel object detection categories with few training instances, is an emerging topic in the area of few-shot learning and object detection. Contemporary techniques can be divided into two…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Berkan Demirel , Orhun Buğra Baran , Ramazan Gokberk Cinbis

Configuration optimization remains a critical bottleneck in machine learning, requiring coordinated tuning across model architecture, training strategy, feature engineering, and hyperparameters. Traditional approaches treat these dimensions…

Artificial Intelligence · Computer Science 2025-08-22 Yuxing Lu , Yucheng Hu , Nan Sun , Xukai Zhao