English
Related papers

Related papers: Synthetic Feature Augmentation Improves Generaliza…

200 papers

This study investigates the automation of meta-analysis in scientific documents using large language models (LLMs). Meta-analysis is a robust statistical method that synthesizes the findings of multiple studies support articles to provide a…

Computation and Language · Computer Science 2024-11-19 Jawad Ibn Ahad , Rafeed Mohammad Sultan , Abraham Kaikobad , Fuad Rahman , Mohammad Ruhul Amin , Nabeel Mohammed , Shafin Rahman

Many capable large language models (LLMs) are developed via self-supervised pre-training followed by a reinforcement-learning fine-tuning phase, often based on human or AI feedback. During this stage, models may be guided by their inductive…

Synthetic data augmentation helps language models learn new knowledge in data-constrained domains. However, naively scaling existing synthetic data methods by training on more synthetic tokens or using stronger generators yields diminishing…

Machine Learning · Computer Science 2026-03-31 Seungju Han , Konwoo Kim , Chanwoo Park , Benjamin Newman , Suhas Kotha , Jaehun Jung , James Zou , Yejin Choi

Deep Learning methods have significantly advanced various data-driven tasks such as regression, classification, and forecasting. However, much of this progress has been predicated on the strong but often unrealistic assumption that training…

Machine Learning · Computer Science 2023-10-12 Josias Moukpe

The integration of high-resolution image features in modern multimodal large language models has demonstrated significant improvements in fine-grained visual understanding tasks, achieving high performance across multiple benchmarks. Since…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Nikitha SR , Aradhya Neeraj Mathur , Tarun Ram Menta , Rishabh Jain , Mausoom Sarkar

Recent years have witnessed a growing academic and industrial interest in deep learning (DL) for medical imaging. To perform well, DL models require very large labeled datasets. However, most medical imaging datasets are small, with a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Minh H. Vu , Lorenzo Tronchin , Tufve Nyholm , Tommy Löfstedt

Learning on synthetic data and transferring the resulting properties to their real counterparts is an important challenge for reducing costs and increasing safety in machine learning. In this work, we focus on autoencoder architectures and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Steve Dias Da Cruz , Bertram Taetz , Thomas Stifter , Didier Stricker

Recommender systems are essential for enhancing user experiences by suggesting items based on individual preferences. However, these systems frequently face the challenge of data imbalance, characterized by a predominance of negative…

Information Retrieval · Computer Science 2024-06-27 Fatih Cihan Taskin , Ilknur Akcay , Muhammed Pesen , Said Aldemir , Ipek Iraz Esin , Furkan Durmus

Recent work has focused on generating synthetic imagery to increase the size and variability of training data for learning visual tasks in urban scenes. This includes increasing the occurrence of occlusions or varying environmental and…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Alexandra Carlson , Katherine A. Skinner , Ram Vasudevan , Matthew Johnson-Roberson

Realistic synthetic image data rendered from 3D models can be used to augment image sets and train image classification semantic segmentation models. In this work, we explore how high quality physically-based rendering and domain…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Jason W. Anderson , Marcin Ziolkowski , Ken Kennedy , Amy W. Apon

The usage of medical image data for the training of large-scale machine learning approaches is particularly challenging due to its scarce availability and the costly generation of data annotations, typically requiring the engagement of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Joshua Niemeijer , Jan Ehrhardt , Hristina Uzunova , Heinz Handels

Fine-tuning Vision-Language Models (VLMs) is a common strategy to improve performance following an ad-hoc data collection and annotation of real-world scenes. However, this process is often prone to biases, errors, and distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Massimo Rizzoli , Simone Alghisi , Seyed Mahed Mousavi , Giuseppe Riccardi

Augmenting large language models (LLMs) with external tools has emerged as a promising approach to solving complex problems. However, traditional methods, which finetune LLMs with tool demonstration data, can be both costly and restricted…

Computation and Language · Computer Science 2024-01-17 Shibo Hao , Tianyang Liu , Zhen Wang , Zhiting Hu

Limited data availability in machine learning significantly impacts performance and generalization. Traditional augmentation methods enhance moderately sufficient datasets. GANs struggle with convergence when generating diverse samples.…

Machine Learning · Computer Science 2024-10-02 Vahid Jebraeeli , Bo Jiang , Hamid Krim , Derya Cansever

Improving the performance on an imbalanced training set is one of the main challenges in nowadays Machine Learning. One way to augment and thus re-balance the image dataset is through existing deep generative models, like class-conditional…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Chenqi Guo , Fabian Benitez-Quiroz , Qianli Feng , Aleix Martinez

Large Language Models (LLMs) exhibit emerging in-context learning abilities through prompt engineering. The recent progress in large-scale generative models has further expanded their use in real-world language applications. However, the…

Computation and Language · Computer Science 2024-04-12 Linyi Yang , Shuibai Zhang , Zhuohao Yu , Guangsheng Bao , Yidong Wang , Jindong Wang , Ruochen Xu , Wei Ye , Xing Xie , Weizhu Chen , Yue Zhang

Feature transformation aims to extract a good representation (feature) space by mathematically transforming existing features. It is crucial to address the curse of dimensionality, enhance model generalization, overcome data sparsity, and…

Machine Learning · Computer Science 2022-12-26 Meng Xiao , Dongjie Wang , Min Wu , Kunpeng Liu , Hui Xiong , Yuanchun Zhou , Yanjie Fu

Reward models (RMs) play a critical role in aligning language models through the process of reinforcement learning from human feedback. RMs are trained to predict a score reflecting human preference, which requires significant time and cost…

Computation and Language · Computer Science 2024-10-21 Zihuiwen Ye , Fraser Greenlee-Scott , Max Bartolo , Phil Blunsom , Jon Ander Campos , Matthias Gallé

Large Language Models (LLMs) have become a milestone in the field of artificial intelligence and natural language processing. However, their large-scale deployment remains constrained by the need for significant computational resources.…

Computation and Language · Computer Science 2025-08-07 Julián Camilo Velandia Gutiérrez

Large language models (LLMs) have transformed natural language processing, yet face challenges in specialized tasks such as simulating opinions on environmental policies. This paper introduces a novel fine-tuning approach that integrates…

Computation and Language · Computer Science 2024-12-10 Haocheng Lin