English
Related papers

Related papers: Coreset Selection via LLM-based Concept Bottleneck…

200 papers

Conformal prediction (CP) offers distribution-free uncertainty quantification for machine learning models, yet its interplay with fairness in downstream decision-making remains underexplored. Moving beyond CP as a standalone operation…

Machine Learning · Statistics 2026-02-20 Pengqi Liu , Zijun Yu , Mouloud Belbahri , Arthur Charpentier , Masoud Asgharian , Jesse C. Cresswell

There has long been debates on how we could interpret neural networks and understand the decisions our models make. Specifically, why deep neural networks tend to be error-prone when dealing with samples that output low softmax scores. We…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Simiao Zuo , Jialin Wu

The remarkable success of contrastive-learning-based multimodal models has been greatly driven by training on ever-larger datasets with expensive compute consumption. Sample selection as an alternative efficient paradigm plays an important…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Zihua Zhao , Feng Hong , Mengxi Chen , Pengyi Chen , Benyuan Liu , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Data selection has emerged as a core issue for large-scale visual-language model pretaining (e.g., CLIP), particularly with noisy web-curated datasets. Three main data selection approaches are: (1) leveraging external non-CLIP models to aid…

Machine Learning · Computer Science 2024-12-23 Yiping Wang , Yifang Chen , Wendan Yan , Alex Fang , Wenjing Zhou , Kevin Jamieson , Simon Shaolei Du

We consider the problem of selecting a small subset of representative variables from a large dataset. In the computer science literature, this dimensionality reduction problem is typically formalized as Column Subset Selection (CSS).…

Methodology · Statistics 2025-05-20 Anav Sood , Trevor Hastie

Given a document in a source language, cross-lingual summarization (CLS) aims at generating a concise summary in a different target language. Unlike monolingual summarization (MS), naturally occurring source-language documents paired with…

Computation and Language · Computer Science 2023-10-11 Jiaan Wang , Fandong Meng , Yunlong Liang , Tingyi Zhang , Jiarong Xu , Zhixu Li , Jie Zhou

Concept Bottleneck Models (CBMs) route predictions exclusively through a clinically grounded concept layer, binding interpretability to concept-label consistency. When a dataset contains concept-level inconsistencies, identical concept…

Machine Learning · Computer Science 2026-04-22 Gonzalo Nápoles , Isel Grau , Yamisleydi Salgueiro

Vision-Language Models (VLMs) have demonstrated great potential in interpreting remote sensing (RS) images through language-guided semantic. However, the effectiveness of these VLMs critically depends on high-quality image-text training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Dilxat Muhtar , Enzhuo Zhang , Zhenshi Li , Feng Gu , Yanglangxing He , Pengfeng Xiao , Xueliang Zhang

Concept bottleneck models (CBM) are a popular way of creating more interpretable neural networks by having hidden layer neurons correspond to human-understandable concepts. However, existing CBMs and their variants have two crucial…

Machine Learning · Computer Science 2023-06-06 Tuomas Oikarinen , Subhro Das , Lam M. Nguyen , Tsui-Wei Weng

Concept Bottleneck Models (CBMs) decompose image classification into a process governed by interpretable, human-readable concepts. Recent advances in CBMs have used Large Language Models (LLMs) to generate candidate concepts. However, a…

Computation and Language · Computer Science 2025-06-03 Yiwen Jiang , Deval Mehta , Wei Feng , Zongyuan Ge

There are a number of studies about extraction of bottleneck (BN) features from deep neural networks (DNNs)trained to discriminate speakers, pass-phrases and triphone states for improving the performance of text-dependent speaker…

Sound · Computer Science 2019-05-14 Achintya kr. Sarkar , Zheng-Hua Tan , Hao Tang , Suwon Shon , James Glass

Feature selection aims to identify the most pattern-discriminative feature subset. In prior literature, filter (e.g., backward elimination) and embedded (e.g., Lasso) methods have hyperparameters (e.g., top-K, score thresholding) and tie to…

Machine Learning · Computer Science 2024-03-07 Wangyang Ying , Dongjie Wang , Haifeng Chen , Yanjie Fu

Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP, establish the correlation between texts and images, achieving remarkable success on various downstream tasks with fine-tuning. In existing fine-tuning methods, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yi Zhang , Ce Zhang , Yushun Tang , Zhihai He

Machine Learning (ML) techniques are employed to analyze and process big Remote Sensing (RS) data, and one well-known ML technique is a Support Vector Machine (SVM). An SVM is a quadratic programming (QP) problem, and a D-Wave quantum…

Quantum Physics · Physics 2022-04-13 Soronzonbold Otgonbaatar , Mihai Datcu , Begüm Demir

Accurate medical image segmentation is often hindered by noisy labels in training data, due to the challenges of annotating medical images. Prior research works addressing noisy labels tend to make class-dependent assumptions, overlooking…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Erjian Guo , Zicheng Wang , Zhen Zhao , Luping Zhou

We study the problem of fine-tuning a language model (LM) for a target task by optimally using the information from $n$ auxiliary tasks. This problem has broad applications in NLP, such as targeted instruction tuning and data selection in…

Computation and Language · Computer Science 2025-06-03 Dongyue Li , Ziniu Zhang , Lu Wang , Hongyang R. Zhang

Deep learning models have proven to be effective on medical datasets for accurate diagnostic predictions from images. However, medical datasets often contain noisy, mislabeled, or poorly generalizable images, particularly for edge cases and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ruhaan Singh , Sreelekha Guggilam

Developing high-performing, yet interpretable models remains a critical challenge in modern AI. Concept-based models (CBMs) attempt to address this by extracting human-understandable concepts from a global encoding (e.g., image encoding)…

Machine Learning · Computer Science 2025-10-08 David Steinmann , Wolfgang Stammer , Antonia Wüst , Kristian Kersting

Large vision-language models (VLMs) commonly process images at native or high resolution to remain effective across tasks. This inflates visual tokens ofter to 97-99% of total tokens, resulting in high compute and latency, even when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Moshe Kimhi , Nimrod Shabtay , Raja Giryes , Chaim Baskin , Eli Schwartz

Deep networks are frequently tuned to novel tasks and continue learning from ongoing data streams. Such sequential training requires consolidation of new and past information, a challenge predominantly addressed by retaining the most…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Subarnaduti Paul , Manuel Brack , Patrick Schramowski , Kristian Kersting , Martin Mundt