English
Related papers

Related papers: Kitana: Efficient Data Augmentation Search for Aut…

200 papers

Clinical trials are critical for advancing medical treatments but remain prohibitively expensive and time-consuming. Accurate prediction of clinical trial outcomes can significantly reduce research and development costs and accelerate drug…

Machine Learning · Computer Science 2025-06-06 Fengze Liu , Haoyu Wang , Joonhyuk Cho , Dan Roth , Andrew W. Lo

Missing data is a fundamental obstacle in the practice of data science. This paper surveys a few conventions for imputation as available in the Automunge open source python library platform for tabular data preprocessing, including "ML…

Machine Learning · Computer Science 2022-02-22 Nicholas J. Teague

Data augmentation, the artificial creation of training data for machine learning by transformations, is a widely studied research field across machine learning disciplines. While it is useful for increasing a model's generalization…

Computation and Language · Computer Science 2022-09-09 Markus Bayer , Marc-André Kaufhold , Christian Reuter

The field of AutoML has made remarkable progress in post-hoc model selection, with libraries capable of automatically identifying the most performing models for a given dataset. Nevertheless, these methods often rely on exhaustive…

Machine Learning · Computer Science 2025-10-03 Yannis Belkhiter , Seshu Tirupathi , Giulio Zizzo , Sachin Sharma , John D. Kelleher

Multimodal large language models (MLLMs) have demonstrated strong capabilities in visual understanding, yet they remain limited in complex, multi-step reasoning that requires deep searching and integrating visual evidence with external…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Xiangyu Peng , Can Qin , An Yan , Xinyi Yang , Zeyuan Chen , Ran Xu , Chien-Sheng Wu

Instruction tuning is a standard technique employed to align large language models to end tasks and user preferences after the initial pretraining phase. Recent research indicates the critical role of data engineering in instruction tuning…

Computation and Language · Computer Science 2024-04-17 Wei Liu , Weihao Zeng , Keqing He , Yong Jiang , Junxian He

Data augmentations are widely used in training medical image deep learning models to increase the diversity and size of sparse datasets. However, commonly used augmentation techniques can result in loss of clinically relevant information…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Adrit Rao , Andrea Fisher , Ken Chang , John Christopher Panagides , Katherine McNamara , Joon-Young Lee , Oliver Aalami

Understanding the semantics of columns in relational tables is an important pre-processing step for indexing data lakes in order to provide rich data search. An approach to establishing such understanding is column type annotation (CTA)…

Computation and Language · Computer Science 2025-03-05 Keti Korini , Christian Bizer

Data-Free Meta-Learning (DFML) aims to extract knowledge from a collection of pre-trained models without requiring the original data, presenting practical benefits in contexts constrained by data privacy concerns. Current DFML methods…

Machine Learning · Computer Science 2024-12-10 Yongxian Wei , Zixuan Hu , Zhenyi Wang , Li Shen , Chun Yuan , Dacheng Tao

Efforts to make machine learning more widely accessible have led to a rapid increase in Auto-ML tools that aim to automate the process of training and deploying machine learning. To understand how Auto-ML tools are used in practice today,…

Human-Computer Interaction · Computer Science 2021-01-14 Doris Xin , Eva Yiwei Wu , Doris Jung-Lin Lee , Niloufar Salehi , Aditya Parameswaran

Tool learning with foundation models aims to endow AI systems with the ability to invoke external resources -- such as APIs, computational utilities, and specialized models -- to solve complex tasks beyond the reach of standalone language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Gabriele Mattioli , Evelyn Turri , Sara Sarto , Lorenzo Baraldi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Instruction tuning, a specialized technique to enhance large language model (LLM) performance via instruction datasets, relies heavily on the quality of employed data. Existing quality improvement methods alter instruction data through…

Computation and Language · Computer Science 2023-12-29 Yang Xu , Yongqiang Yao , Yufan Huang , Mengnan Qi , Maoquan Wang , Bin Gu , Neel Sundaresan

Data augmentation aims to enrich training samples for alleviating the overfitting issue in low-resource or class-imbalanced situations. Traditional methods first devise task-specific operations such as Synonym Substitute, then preset the…

Computation and Language · Computer Science 2021-09-03 Shuhuai Ren , Jinchao Zhang , Lei Li , Xu Sun , Jie Zhou

We present AutoBool, a reinforcement learning (RL) framework that trains large language models (LLMs) to generate effective Boolean queries for medical systematic reviews. Boolean queries are the primary mechanism for literature retrieval…

Information Retrieval · Computer Science 2026-02-03 Shuai Wang , Harrisen Scells , Bevan Koopman , Guido Zuccon

Topic modeling is widely used for uncovering thematic structures within text corpora, yet traditional models often struggle with specificity and coherence in domain-focused applications. Guided approaches, such as SeededLDA and CorEx,…

Computation and Language · Computer Science 2025-05-23 Chia-Hsuan Chang , Jui-Tse Tsai , Yi-Hang Tsai , San-Yih Hwang

Data augmentation has been widely used to improve deep neural networks in many research fields, such as computer vision. However, less work has been done in the context of text, partially due to its discrete nature and the complexity of…

Computation and Language · Computer Science 2021-01-12 Ping Yu , Ruiyi Zhang , Yang Zhao , Yizhe Zhang , Chunyuan Li , Changyou Chen

Automated augmentation is an emerging and effective technique to search for data augmentation policies to improve generalizability of deep neural network training. Most existing work focuses on constructing a unified policy applicable to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Mingjun Zhao , Shan Lu , Zixuan Wang , Xiaoli Wang , Di Niu

In recent years, language models (LMs) have made remarkable progress in advancing the field of natural language processing (NLP). However, the impact of data augmentation (DA) techniques on the fine-tuning (FT) performance of these LMs has…

Computation and Language · Computer Science 2023-06-14 Zhengxiang Shi , Aldo Lipani

Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for…

Machine Learning · Computer Science 2021-06-23 Renkun Ni , Micah Goldblum , Amr Sharaf , Kezhi Kong , Tom Goldstein

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke