English
Related papers

Related papers: Fixed-point algorithms for learning determinantal …

200 papers

Denoising Diffusion Probabilistic Models (DDPMs) are a very popular class of deep generative model that have been successfully applied to a diverse range of problems including image and video generation, protein and material synthesis,…

We propose a deep learning approach for discovering kernels tailored to identifying clusters over sample data. Our neural network produces sample embeddings that are motivated by--and are at least as expressive as--spectral clustering. Our…

Machine Learning · Computer Science 2020-01-03 Chieh Wu , Zulqarnain Khan , Yale Chang , Stratis Ioannidis , Jennifer Dy

The complexity-precision trade-off of an object detector is a critical problem for resource constrained vision tasks. Previous works have emphasized detectors implemented with efficient backbones. The impact on this trade-off of proposal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Yunsheng Li , Yinpeng Chen , Xiyang Dai , Dongdong Chen , Mengchen Liu , Pei Yu , Jing Yin , Lu Yuan , Zicheng Liu , Nuno Vasconcelos

Recently, various convolutions based on continuous or discrete kernels for point cloud processing have been widely studied, and achieve impressive performance in many applications, such as shape classification, scene segmentation and so on.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Dengsheng Chen , Haowen Deng , Jun Li , Duo Li , Yao Duan , Kai Xu

The article proposes formulating and codifying a set of applied numerical methods, coined as Deep Learning Discrete Calculus (DLDC), that uses the knowledge from discrete numerical methods to interpret the deep learning algorithms through…

Numerical Analysis · Mathematics 2022-12-01 Sourav Saha , Chanwook Park , Stefan Knapik , Jiachen Guo , Owen Huang , Wing Kam Liu

Most algorithms for solving optimization problems or finding saddle points of convex-concave functions are fixed-point algorithms. In this work we consider the generic problem of finding a fixed point of an average of operators, or an…

Machine Learning · Computer Science 2020-06-17 Grigory Malinovsky , Dmitry Kovalev , Elnur Gasanov , Laurent Condat , Peter Richtárik

Motivated by the need for a robust policy in the face of environment shifts between training and deployment, we contribute to the theoretical foundation of distributionally robust reinforcement learning (DRRL). This is accomplished through…

Machine Learning · Computer Science 2025-08-26 Shengbo Wang , Nian Si , Jose Blanchet , Zhengyuan Zhou

This paper introduces a novel Differential Dynamic Programming (DDP) algorithm for solving discrete-time finite-horizon optimal control problems with inequality constraints. Two variants, namely Feasible- and Infeasible-IPDDP algorithms,…

Systems and Control · Electrical Eng. & Systems 2020-10-21 Andrei Pavlov , Iman Shames , Chris Manzie

Semidefinite programming (SDP) is a powerful framework from convex optimization that has striking potential for data science applications. This paper develops a provably correct randomized algorithm for solving large, weakly constrained SDP…

Optimization and Control · Mathematics 2021-03-26 Alp Yurtsever , Joel A. Tropp , Olivier Fercoq , Madeleine Udell , Volkan Cevher

In this study, we propose a novel deep spatio-temporal point process model, Deep Kernel Mixture Point Processes (DKMPP), that incorporates multimodal covariate information. DKMPP is an enhanced version of Deep Mixture Point Processes…

Machine Learning · Computer Science 2023-10-10 Yixuan Zhang , Quyu Kong , Feng Zhou

We propose a new class of structured methods for Monte Carlo (MC) sampling, called DPPMC, designed for high-dimensional nonisotropic distributions where samples are correlated to reduce the variance of the estimator via determinantal point…

Machine Learning · Computer Science 2019-05-31 Krzysztof Choromanski , Aldo Pacchiano , Jack Parker-Holder , Yunhao Tang

We present a new algorithm which is named the Dynamical Functional Particle Method, DFPM. It is based on the idea of formulating a finite dimensional damped dynamical system whose stationary points are the solution to the original…

Numerical Analysis · Mathematics 2013-03-25 Mårten Gulliksson , Sverker Edvardsson , Andreas Lind

Probabilistic circuits (PCs) represent a probability distribution as a computational graph. Enforcing structural properties on these graphs guarantees that several inference scenarios become tractable. Among these properties, structured…

Machine Learning · Computer Science 2020-09-03 Meihua Dang , Antonio Vergari , Guy Van den Broeck

We propose a new class of algorithms for randomly scheduling network transmissions. The idea is to use (discrete) determinantal point processes (subsets) to randomly assign medium access to various {\em repulsive} subsets of potential…

Networking and Internet Architecture · Computer Science 2020-06-11 Bartek Błaszczyszyn , Antoine Brochard , H. Paul Keeler

We study the Gibbs sampling algorithm for continuous determinantal point processes. We show that, given a warm start, the Gibbs sampler generates a random sample from a continuous $k$-DPP defined on a $d$-dimensional domain by only taking…

Machine Learning · Computer Science 2018-10-23 Shayan Oveis Gharan , Alireza Rezaei

Recurrent neural networks are widely used in speech and language processing. Due to dependency on the past, standard algorithms for training these models, such as back-propagation through time (BPTT), cannot be efficiently parallelised.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-07 Zhengxiong Wang , Anton Ragni

We introduce new smoothing estimators for complex signals on graphs, based on a recently studied Determinantal Point Process (DPP). These estimators are built from subsets of edges and nodes drawn according to this DPP, making up trees and…

Most convolutional neural networks use some method for gradually downscaling the size of the hidden layers. This is commonly referred to as pooling, and is applied to reduce the number of parameters, improve invariance to certain…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Faraz Saeedan , Nicolas Weber , Michael Goesele , Stefan Roth

Discriminative pattern mining is an essential task of data mining. This task aims to discover patterns which occur more frequently in a class than other classes in a class-labeled dataset. This type of patterns is valuable in various…

Machine Learning · Computer Science 2019-06-05 Hoang Son Pham , Gwendal Virlet , Dominique Lavenier , Alexandre Termier

We formalise the widespread idea of interpreting neural network decisions as an explicit optimisation problem in a rate-distortion framework. A set of input features is deemed relevant for a classification decision if the expected…

Machine Learning · Computer Science 2019-05-28 Jan Macdonald , Stephan Wäldchen , Sascha Hauch , Gitta Kutyniok