English
Related papers

Related papers: Balancing Effect of Training Dataset Distribution …

200 papers

Transfer learning can significantly improve the sample efficiency of neural networks, by exploiting the relatedness between a data-scarce target task and a data-abundant source task. Despite years of successful applications, transfer…

Machine Learning · Computer Science 2023-06-06 Federica Gerace , Luca Saglietti , Stefano Sarao Mannelli , Andrew Saxe , Lenka Zdeborová

With the rise of deep learning, large datasets and complex models have become common, requiring significant computing power. To address this, data distillation has emerged as a technique to quickly train models with lower memory and time…

Computation and Language · Computer Science 2023-08-10 Shivam Sahni , Harsh Patel

Having a sufficient quantity of quality data is a critical enabler of training effective machine learning models. Being able to effectively determine the adequacy of a dataset prior to training and evaluating a model's performance would be…

Machine Learning · Computer Science 2026-04-28 Arya Hatamian , Lionel Levine , Haniyeh Ehsani Oskouie , Majid Sarrafzadeh

With the development of diffusion models, text-guided image style transfer has demonstrated high-quality controllable synthesis results. However, the utilization of text for diverse music style transfer poses significant challenges,…

Sound · Computer Science 2024-02-22 Sifei Li , Yuxin Zhang , Fan Tang , Chongyang Ma , Weiming dong , Changsheng Xu

The performance of machine learning models relies heavily on the quality of input data, yet real-world applications often face significant data-related challenges. A common issue arises when curating training data or deploying models: two…

Machine Learning · Computer Science 2025-09-24 Varun Babbar , Zhicheng Guo , Cynthia Rudin

Cross-speaker style transfer aims to extract the speech style of the given reference speech, which can be reproduced in the timbre of arbitrary target speakers. Existing methods on this topic have explored utilizing utterance-level style…

Sound · Computer Science 2022-08-22 Xiang Li , Changhe Song , Xianhao Wei , Zhiyong Wu , Jia Jia , Helen Meng

Recently, the multimedia community has witnessed the rise of diffusion models trained on large-scale multi-modal data for visual content creation, particularly in the field of text-to-image generation. In this paper, we propose a new task…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jingwen Chen , Yingwei Pan , Ting Yao , Tao Mei

Despite the impressive generative capabilities of diffusion models, existing diffusion model-based style transfer methods require inference-stage optimization (e.g. fine-tuning or textual inversion of style) which is time-consuming, or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jiwoo Chung , Sangeek Hyun , Jae-Pil Heo

Deep generative models are now able to synthesize high-quality audio signals, shifting the critical aspect in their development from audio quality to control capabilities. Although text-to-music generation is getting largely adopted by the…

Sound · Computer Science 2024-08-02 Nils Demerlé , Philippe Esling , Guillaume Doras , David Genova

Expressing in language is subjective. Everyone has a different style of reading and writing, apparently it all boil downs to the way their mind understands things (in a specific format). Language style transfer is a way to preserve the…

Computation and Language · Computer Science 2018-04-12 Ayush Singh , Ritu Palod

In this thesis, we address the data scarcity and limitations of linguistic theory by proposing language-agnostic multi-task training methods. First, we introduce a meta-learning-based approach, meta-transfer learning, in which information…

Computation and Language · Computer Science 2021-04-14 Genta Indra Winata

Formality style transfer is the task of converting informal sentences to grammatically-correct formal sentences, which can be used to improve performance of many downstream NLP tasks. In this work, we propose a semi-supervised formality…

Computation and Language · Computer Science 2020-10-13 Kunal Chawla , Diyi Yang

Classification tasks require a balanced distribution of data to ensure the learner to be trained to generalize over all classes. In real-world datasets, however, the number of instances vary substantially among classes. This typically leads…

Machine Learning · Computer Science 2020-11-24 Joel Jang , Yoonjeon Kim , Kyoungho Choi , Sungho Suh

Transferring the style from one image onto another is a popular and widely studied task in computer vision. Yet, style transfer in the 3D setting remains a largely unexplored problem. To our knowledge, we propose the first learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Mattia Segu , Margarita Grinvald , Roland Siegwart , Federico Tombari

Digital audio effects are widely used by audio engineers to alter the acoustic and temporal qualities of audio data. However, these effects can have a large number of parameters which can make them difficult to learn for beginners and…

Machine Learning · Computer Science 2023-10-02 Kieran Grant

The dissemination of online hate speech can have serious negative consequences for individuals, online communities, and entire societies. This and the large volume of hateful online content prompted both practitioners', i.e., in content…

Computation and Language · Computer Science 2025-04-14 Julian Bäumler , Louis Blöcher , Lars-Joel Frey , Xian Chen , Markus Bayer , Christian Reuter

In low-resource settings, model transfer can help to overcome a lack of labeled data for many tasks and domains. However, predicting useful transfer sources is a challenging problem, as even the most similar sources might lead to unexpected…

Computation and Language · Computer Science 2021-11-01 Lukas Lange , Jannik Strötgen , Heike Adel , Dietrich Klakow

When training multilingual machine translation (MT) models that can translate to/from multiple languages, we are faced with imbalanced training sets: some languages have much more training data than others. Standard practice is to up-sample…

Computation and Language · Computer Science 2020-09-08 Xinyi Wang , Yulia Tsvetkov , Graham Neubig

Training machine learning models from data with weak supervision and dataset shifts is still challenging. Designing algorithms when these two situations arise has not been explored much, and existing algorithms cannot always handle the most…

Machine Learning · Computer Science 2023-08-30 Pierre Nodet , Vincent Lemaire , Alexis Bondu , Antoine Cornuéjols

Recent research has investigated the shape and texture biases of deep neural networks (DNNs) in image classification which influence their generalization capabilities and robustness. It has been shown that, in comparison to regular DNN…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Ben Hamscher , Edgar Heinert , Annika Mütze , Kira Maag , Matthias Rottmann