English
Related papers

Related papers: Strengthening Interpretability: An Investigative S…

200 papers

Multiple regression has been the go-to method for data analysis for generations of scholars due to its transparency, interpretability, and desirable theoretical properties. However, the method's simplicity precludes the discovery of complex…

Machine Learning · Statistics 2021-02-02 Marc Ratkovic , Dustin Tingley

Explainable Artificial Intelligence (XAI) methods are increasingly used in safety-critical domains, yet there is no unified framework to jointly evaluate fidelity, interpretability, robustness, fairness, and completeness. We address this…

Artificial Intelligence · Computer Science 2026-04-10 Md. Ariful Islam , Md Abrar Jahin , M. F. Mridha , Nilanjan Dey

Many recent applications in machine learning and data fitting call for the algorithmic solution of structured smooth convex optimization problems. Although the gradient descent method is a natural choice for this task, it requires exact…

Optimization and Control · Mathematics 2013-09-03 Anthony Man-Cho So

Magnetic fields are ubiquitous in the interstellar medium but are notoriously difficult to study through observation. Making use of the advances in our understanding of MHD turbulence and turbulent reconnection, the Velocity Gradient…

Astrophysics of Galaxies · Physics 2020-01-08 Yue Hu , Ka Ho Yuen , Alex Lazarian

Interpretability methods are valuable only if their explanations faithfully describe the explained model. In this work, we consider neural networks whose predictions are invariant under a specific symmetry group. This includes popular…

Machine Learning · Computer Science 2023-10-06 Jonathan Crabbé , Mihaela van der Schaar

To assist humans in efficiently validating RAG-generated content, developing a fine-grained attribution mechanism that provides supporting evidence from retrieved documents for every answer span is essential. Existing fine-grained…

Computation and Language · Computer Science 2024-12-17 Qiang Ding , Lvzhou Luo , Yixuan Cao , Ping Luo

A key challenge in neural architecture search (NAS) is quickly inferring the predictive performance of a broad spectrum of networks to discover statistically accurate and computationally efficient ones. We refer to this task as model…

Machine Learning · Computer Science 2022-06-22 Zhihao Zhang , Zhihao Jia

Gradient-based analysis methods, such as saliency map visualizations and adversarial input perturbations, have found widespread use in interpreting neural NLP models due to their simplicity, flexibility, and most importantly, their…

Computation and Language · Computer Science 2020-10-13 Junlin Wang , Jens Tuyls , Eric Wallace , Sameer Singh

IRGAN is an information retrieval (IR) modeling approach that uses a theoretical minimax game between a generative and a discriminative model to iteratively optimize both of them, hence unifying the generative and discriminative approaches.…

Information Retrieval · Computer Science 2019-10-02 Moksh Jain , Sowmya Kamath S

Gradient coding is a technique for straggler mitigation in distributed learning. In this paper we design novel gradient codes using tools from classical coding theory, namely, cyclic MDS codes, which compare favorably with existing…

Information Theory · Computer Science 2019-07-09 Netanel Raviv , Itzhak Tamo , Rashish Tandon , Alexandros G. Dimakis

Accurate depth estimation is crucial for many fields, including robotics, navigation, and medical imaging. However, conventional depth sensors often produce low-resolution (LR) depth maps, making detailed scene perception challenging. To…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Athanasios Tragakis , Chaitanya Kaul , Kevin J. Mitchell , Hang Dai , Roderick Murray-Smith , Daniele Faccio

A constrained optimization problem is primal infeasible if its constraints cannot be satisfied, and dual infeasible if the constraints of its dual problem cannot be satisfied. We propose a novel iterative method, named proportional-integral…

Optimization and Control · Mathematics 2021-09-14 Yue Yu , Ufuk Topcu

We develop methods for parameter estimation in settings with large-scale data sets, where traditional methods are no longer tenable. Our methods rely on stochastic approximations, which are computationally efficient as they maintain one…

Computation · Statistics 2015-09-23 Dustin Tran , Panos Toulis , Edoardo M. Airoldi

Self-consistency-based approaches, which involve repeatedly sampling multiple outputs and selecting the most consistent one as the final response, prove to be remarkably effective in improving the factual accuracy of large language models.…

Computation and Language · Computer Science 2025-01-24 Yi Cheng , Xiao Liang , Yeyun Gong , Wen Xiao , Song Wang , Yuji Zhang , Wenjun Hou , Kaishuai Xu , Wenge Liu , Wenjie Li , Jian Jiao , Qi Chen , Peng Cheng , Wayne Xiong

While there is increasing concern about the interpretability of neural models, the evaluation of interpretability remains an open problem, due to the lack of proper evaluation datasets and metrics. In this paper, we present a novel…

Computation and Language · Computer Science 2022-11-16 Lijie Wang , Yaozong Shen , Shuyuan Peng , Shuai Zhang , Xinyan Xiao , Hao Liu , Hongxuan Tang , Ying Chen , Hua Wu , Haifeng Wang

In real-world scenarios, providing user queries with visually enhanced responses can considerably benefit understanding and memory, underscoring the great value of interleaved image-text generation. Despite recent progress, like the visual…

Information Retrieval · Computer Science 2025-12-08 Rongyang Zhang , Yuqing Huang , Chengqiang Lu , Qimeng Wang , Yan Gao , Yi Wu , Yao Hu , Yin Xu , Wei Wang , Hao Wang , Enhong Chen

Designing models that produce accurate predictions is the fundamental objective of machine learning (ML). This work presents methods demonstrating that when the derivatives of target variables (outputs) with respect to inputs can be…

Machine Learning · Computer Science 2022-01-17 Chris McDonagh , Xi Chen

We present IBR, an Iterative Backward Reasoning model to solve the proof generation tasks on rule-based Question Answering (QA), where models are required to reason over a series of textual rules and facts to find out the related proof path…

Computation and Language · Computer Science 2022-05-25 Hanhao Qu , Yu Cao , Jun Gao , Liang Ding , Ruifeng Xu

A major obstacle to achieving global convergence in distributed and federated learning is the misalignment of gradients across clients, or mini-batches due to heterogeneity and stochasticity of the distributed data. In this work, we show…

Machine Learning · Computer Science 2021-12-14 Yatin Dandi , Luis Barba , Martin Jaggi

Generative models have recently gained increasing attention in image generation and editing tasks. However, they often lack a direct connection to object geometry, which is crucial in sensitive domains such as computational anatomy,…

Graphics · Computer Science 2025-04-14 Nian Wu , Nivetha Jayakumar , Jiarui Xing , Miaomiao Zhang