English
Related papers

Related papers: Improving Attribution Methods by Learning Submodul…

200 papers

Many prediction domains, such as ad placement, recommendation, trajectory prediction, and document summarization, require predicting a set or list of options. Such lists are often evaluated using submodular reward functions that measure…

Machine Learning · Computer Science 2013-05-14 Stephane Ross , Jiaji Zhou , Yisong Yue , Debadeepta Dey , J. Andrew Bagnell

The sheer scale of modern datasets has resulted in a dire need for summarization techniques that identify representative elements in a dataset. Fortunately, the vast majority of data summarization tasks satisfy an intuitive diminishing…

Machine Learning · Computer Science 2018-06-08 Marko Mitrovic , Ehsan Kazemi , Morteza Zadimoghaddam , Amin Karbasi

Feature selection is crucial for pinpointing relevant features in high-dimensional datasets, mitigating the 'curse of dimensionality,' and enhancing machine learning performance. Traditional feature selection methods for classification use…

Machine Learning · Computer Science 2025-04-08 Rittwika Kansabanik , Adrian Barbu

Discrete-time diffusion-based generative models and score matching methods have shown promising results in modeling high-dimensional image data. Recently, Song et al. (2021) show that diffusion processes that transform data into noise can…

Machine Learning · Computer Science 2021-10-01 Chin-Wei Huang , Jae Hyun Lim , Aaron Courville

The proposed method, Discriminator Guidance, aims to improve sample generation of pre-trained diffusion models. The approach introduces a discriminator that gives explicit supervision to a denoising sample path whether it is realistic or…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Dongjun Kim , Yeongmin Kim , Se Jung Kwon , Wanmo Kang , Il-Chul Moon

Submodular functions play a key role in the area of optimization as they allow to model many real-world problems that face diminishing returns. Evolutionary algorithms have been shown to obtain strong theoretical performance guarantees for…

Preference-based reward learning is a popular technique for teaching robots and autonomous systems how a human user wants them to perform a task. Previous works have shown that actively synthesizing preference queries to maximize…

Robotics · Computer Science 2024-03-12 Evan Ellis , Gaurav R. Ghosal , Stuart J. Russell , Anca Dragan , Erdem Bıyık

While diffusion models excel at image generation, their growing adoption raises critical concerns about copyright issues and model transparency. Existing attribution methods identify training examples influencing an entire image, but fall…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yonghyun Park , Chieh-Hsin Lai , Satoshi Hayakawa , Yuhta Takida , Naoki Murata , Wei-Hsiang Liao , Woosung Choi , Kin Wai Cheuk , Junghyun Koo , Yuki Mitsufuji

Submodular functions describe a variety of discrete problems in machine learning, signal processing, and computer vision. However, minimizing submodular functions poses a number of algorithmic challenges. Recent work introduced an…

Optimization and Control · Mathematics 2014-11-06 Robert Nishihara , Stefanie Jegelka , Michael I. Jordan

Attribution methods reveal which input features a neural network uses for a prediction, adding transparency to their decisions. A common problem is that these attributions seem unspecific, highlighting both important and irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Nils Philipp Walter , Jilles Vreeken , Jonas Fischer

Modern datasets span billions of samples, making training on all available data infeasible. Selecting a high quality subset helps in reducing training costs and enhancing model quality. Submodularity, a discrete analogue of convexity, is…

Machine Learning · Computer Science 2025-04-04 Maximilian Böther , Abraham Sebastian , Pranjal Awasthi , Ana Klimovic , Srikumar Ramalingam

Recent semi-supervised learning methods have shown to achieve comparable results to their supervised counterparts while using only a small portion of labels in image classification tasks thanks to their regularization strategies. In this…

Machine Learning · Computer Science 2020-09-25 Wei-Hong Li , Chuan-Sheng Foo , Hakan Bilen

In this article, we describe a new method of extracting information from signals, called functional dissipation, that proves to be very effective for enhancing classification of high resolution, texture-rich data. Our algorithm bypasses to…

Data Analysis, Statistics and Probability · Physics 2012-06-15 D. Napoletani , D. C. Struppa , T. Sauer , V. Morozov , N. Vsevolodov , C. Bailey

Data attribution has become an important component of pricing, auditing, and governance in machine learning pipelines, yet most attribution methods implicitly assume that attribution values faithfully reflect participants' contributions. We…

Machine Learning · Computer Science 2026-05-18 Xian Gao , Bo Hui , Min-Te Sun , Wei-Shinn Ku

Attribution methods provide an insight into the decision-making process of machine learning models, especially deep neural networks, by assigning contribution scores to each individual feature. However, the attribution problem has not been…

Machine Learning · Computer Science 2023-02-28 Huiqi Deng , Na Zou , Mengnan Du , Weifu Chen , Guocan Feng , Xia Hu

The proliferation of complex, black-box AI models has intensified the need for techniques that can explain their decisions. Feature attribution methods have become a popular solution for providing post-hoc explanations, yet the field has…

Machine Learning · Computer Science 2025-11-13 Xinpeng Li , Kai Ming Ting

The goal of Feature Selection - comprising filter, wrapper, and embedded approaches - is to find the optimal feature subset for designated downstream tasks. Nevertheless, current feature selection methods are limited by: 1) the selection…

Machine Learning · Computer Science 2023-09-18 Meng Xiao , Dongjie Wang , Min Wu , Pengfei Wang , Yuanchun Zhou , Yanjie Fu

Attributing the output of a neural network to the contribution of given input elements is a way of shedding light on the black-box nature of neural networks. Due to the complexity of current network architectures, current gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Ashkan Khakzar , Soroosh Baselizadeh , Saurabh Khanduja , Christian Rupprecht , Seong Tae Kim , Nassir Navab

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

The ability to collect and store ever more massive databases has been accompanied by the need to process them efficiently. In many cases, most observations have the same behavior, while a probable small proportion of these observations are…

Statistics Theory · Mathematics 2021-09-21 Myrto Limnios , Nathan Noiry , Stéphan Clémençon