English
Related papers

Related papers: The Alignment Bottleneck in Decomposition-Based Cl…

200 papers

Counterfactual explanations (CFEs) exemplify how to minimally modify a feature vector to achieve a different prediction for an instance. CFEs can enhance informational fairness and trustworthiness, and provide suggestions for users who…

Machine Learning · Computer Science 2023-09-12 Yongjie Wang , Hangwei Qian , Yongjie Liu , Wei Guo , Chunyan Miao

Supervised contrastive learning (SupCon) has proven to be a powerful alternative to the standard cross-entropy loss for classification of multi-class balanced datasets. However, it struggles to learn well-conditioned representations of…

Machine Learning · Computer Science 2025-03-24 David Mildenberger , Paul Hager , Daniel Rueckert , Martin J Menten

Contrastive Language-Image Pre-training (CLIP) delivers strong cross modal generalization by aligning images and texts in a shared embedding space, yet it persistently fails at compositional reasoning over objects, attributes, and relations…

Machine Learning · Computer Science 2025-10-31 Ziliang Chen , Tianang Xiao , Jusheng Zhang , Yongsen Zheng , Xipeng Chen

Accurate decision making in medical imaging requires reasoning over subtle visual differences between confusable conditions, yet most existing approaches rely on nearest neighbor retrieval that returns redundant evidence and reinforces a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Daivik Patel , Shrenik Patel

Deep neural networks are notoriously sensitive to spurious correlations - where a model learns a shortcut that fails out-of-distribution. Existing work on spurious correlations has often focused on incomplete correlations,leveraging access…

We present a novel semi-supervised learning framework that intelligently leverages the consistency regularization between the model's predictions from two strongly-augmented views of an image, weighted by a confidence of pseudo-label,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Jiwon Kim , Youngjo Min , Daehwan Kim , Gyuseong Lee , Junyoung Seo , Kwangrok Ryoo , Seungryong Kim

Standard fine-tuning of pre-trained audio models couples representation learning with classifier training, which can obscure the true quality of the learned representations. In this work, we advocate for a disentangled two-stage framework…

Sound · Computer Science 2025-09-23 Yang Wang , Qibin Liang , Chenghao Xiao , Yizhi Li , Noura Al Moubayed , Chenghua Lin

Contrastive losses have been extensively used as a tool for multimodal representation learning. However, it has been empirically observed that their use is not effective to learn an aligned representation space. In this paper, we argue that…

Machine Learning · Computer Science 2025-06-06 Antonio Almudévar , José Miguel Hernández-Lobato , Sameer Khurana , Ricard Marxer , Alfonso Ortega

While increasingly complex approaches to question answering (QA) have been proposed, the true gain of these systems, particularly with respect to their expensive training requirements, can be inflated when they are not compared to adequate…

Information Retrieval · Computer Science 2018-07-06 Vikas Yadav , Rebecca Sharp , Mihai Surdeanu

Large Language Models (LLMs) augmented with retrieval mechanisms have demonstrated significant potential in fact-checking tasks by integrating external knowledge. However, their reliability decreases when confronted with conflicting…

Computation and Language · Computer Science 2025-05-26 Ziyu Ge , Yuhao Wu , Daniel Wai Kit Chin , Roy Ka-Wei Lee , Rui Cao

Classical learning theory suggests that the optimal generalization performance of a machine learning model should occur at an intermediate model complexity, with simpler models exhibiting high bias and more complex models exhibiting high…

Machine Learning · Statistics 2020-11-09 Ben Adlam , Jeffrey Pennington

A significant part of modern topological data analysis is concerned with the design and study of algebraic invariants of poset representations -- often referred to as multi-parameter persistence modules. One such invariant is the minimal…

Algebraic Topology · Mathematics 2024-09-02 Magnus Bakke Botnan , Steffen Oppermann , Steve Oudot , Luis Scoccola

The Context-Compliance Regime in Retrieval-Augmented Generation (RAG) occurs when retrieved context dominates the final answer even when it conflicts with the model's parametric knowledge. Accuracy alone does not reveal how retrieved…

Computation and Language · Computer Science 2026-05-27 Yihang Chen , Pin Qian , Su Wang , Sipeng Zhang , Huan Xu , Shuhuai Lin , Xinpeng Wei

Scientific practice typically involves repeatedly studying a system, each time trying to unravel a different perspective. In each study, the scientist may take measurements under different experimental conditions (interventions,…

Machine Learning · Statistics 2014-03-11 Sofia Triantafillou , Ioannis Tsamardinos

Learning disentangled representations that correspond to factors of variation in real-world data is critical to interpretable and human-controllable machine learning. Recently, concerns about the viability of learning disentangled…

Machine Learning · Computer Science 2020-04-14 Rui Shu , Yining Chen , Abhishek Kumar , Stefano Ermon , Ben Poole

Cross-modal alignment is a crucial task in multimodal learning aimed at achieving semantic consistency between vision and language. This requires that image-text pairs exhibit similar semantics. Traditional algorithms pursue embedding…

Machine Learning · Computer Science 2026-03-09 Xiang Ma , Lexin Fang , Litian Xu , Caiming Zhang

Fine-tuning LLMs for classification typically maps inputs directly to labels. We ask whether attaching brief explanations to each label during fine-tuning yields better models. We evaluate conversational response quality along three axes:…

Machine Learning · Computer Science 2026-03-03 Vivswan Shah , Randy Cogill , Hanwei Yue , Gopinath Chennupati , Rinat Khaziev

Semi-supervised learning has become a dominant paradigm for reducing annotation costs. However, we argue that the current progress is clouded by a twofold overconfidence problem. Algorithmically, mainstream pseudo-labeling frameworks often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jun Li , Ziwei Qin

Software engineering agents are increasingly deployed in evaluable engineering environments, yet post-failure recovery remains costly, manual, and ad hoc. Existing systems expose traces or generate follow-up feedback, but they do not…

Software Engineering · Computer Science 2026-05-12 Chenyu Zhao , Shenglin Zhang , Yihang Lin , Wenwei Gu , Zhimin Chen , Yongqian Sun , Dan Pei , Chetan Bansal , Saravan Rajmohan , Minghua Ma

Causal analyses derived from observational data underpin high-stakes decisions in domains such as healthcare, public policy, and economics. Yet such conclusions can be surprisingly fragile: even minor data errors - duplicate records, or…

Databases · Computer Science 2025-12-18 Yarden Gabbay , Haoquan Guan , Shaull Almagor , El Kindi Rezig , Brit Youngmann , Babak Salimi