English
Related papers

Related papers: Efficient and Robust Carath\'{e}odory-Steinitz Pru…

200 papers

A systematic digital-discrete method for obtaining continuous functions with smoothness to a certain order (C^(n)) from sample data is designed. This method is based on gradually varied functions and the classical finite difference method.…

Numerical Analysis · Mathematics 2010-10-19 Li Chen

Discretizing an analytic function on a uniform real-space grid is often done via a straightforward collocation method. This is ubiquitous in all areas of computational physics and quantum chemistry. An example in Density Functional Theory…

Computational Physics · Physics 2016-01-20 Luigi Genovese , Thierry Deutsch

Lloyd's algorithm is an iterative method that solves the quantization problem, i.e. the approximation of a target probability measure by a discrete one, and is particularly used in digital applications. This algorithm can be interpreted as…

Optimization and Control · Mathematics 2026-05-14 Léo Portales , Elsa Cazelles , Edouard Pauwels

We present a systematic computational framework for generating positive quadrature rules in multiple dimensions on general geometries. A direct moment-matching formulation that enforces exact integration on polynomial subspaces yields…

Numerical Analysis · Computer Science 2018-09-03 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

We present joint multi-dimension pruning (abbreviated as JointPruning), an effective method of pruning a network on three crucial aspects: spatial, depth and channel simultaneously. To tackle these three naturally different dimensions, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Zechun Liu , Xiangyu Zhang , Zhiqiang Shen , Zhe Li , Yichen Wei , Kwang-Ting Cheng , Jian Sun

We present an algorithm for minimizing a sum of functions that combines the computational efficiency of stochastic gradient descent (SGD) with the second order curvature information leveraged by quasi-Newton methods. We unify these…

Machine Learning · Computer Science 2014-12-02 Jascha Sohl-Dickstein , Ben Poole , Surya Ganguli

Pruning aims to reduce the number of parameters while maintaining performance close to the original network. This work proposes a novel \emph{self-distillation} based pruning strategy, whereby the representational similarity between the…

Machine Learning · Computer Science 2021-10-01 James O' Neill , Sourav Dutta , Haytham Assem

The deployment of several large scale arrays is envisioned to study astroparticles at ultra-high energies. In order to circumvent the heavy computational costs of exploring and optimizing their layouts, we have developed a pruning method.…

Instrumentation and Methods for Astrophysics · Physics 2024-01-03 A , Benoit-Lévy , K. Kotera , M. Tueros

We propose a computationally efficient algorithm that achieves anytime regret of order $\mathcal{O}(\sqrt{t})$, with explicit dependence on the system dimensions and on the solution of the Discrete Algebraic Riccati Equation (DARE). Our…

Machine Learning · Statistics 2026-01-06 Jafar Abbaszadeh Chekan , Cedric Langbort

For the purpose of uncertainty quantification with collocation, a method is proposed for generating families of one-dimensional nested quadrature rules with positive weights and symmetric nodes. This is achieved through a reduction…

Numerical Analysis · Mathematics 2020-04-20 L. M. M. van den Bos , B. Koren , R. P. Dwight

We give a deterministic nearly-linear time algorithm for approximating any point inside a convex polytope with a sparse convex combination of the polytope's vertices. Our result provides a constructive proof for the Approximate…

Data Structures and Algorithms · Computer Science 2015-12-31 Vahab Mirrokni , Renato Paes Leme , Adrian Vladu , Sam Chiu-wai Wong

We study unconstrained Online Linear Optimization with Lipschitz losses. Motivated by the pursuit of instance optimality, we propose a new algorithm that simultaneously achieves ($i$) the AdaGrad-style second order gradient adaptivity; and…

Machine Learning · Computer Science 2024-02-23 Zhiyu Zhang , Heng Yang , Ashok Cutkosky , Ioannis Ch. Paschalidis

The numerical method of Kahan applied to quadratic differential equations is known to often generate integrable maps in low dimensions and can in more general situations exhibit preserved measures and integrals. Computerized methods based…

Numerical Analysis · Mathematics 2023-10-13 Geir Bogfjellmo , Elena Celledoni , Robert McLachlan , Brynjulf Owren , Reinout Quispel

We consider a fractional plasticity model based on linear isotropic and kinematic hardening as well as a standard von-Mises yield function, where the flow rule is replaced by a Riesz--Caputo fractional derivative. The resulting mathematical…

Numerical Analysis · Mathematics 2025-04-14 Michael Feischl , David Niederkofler , Barbara Wohlmuth

Deep neural networks have dramatically achieved great success on a variety of challenging tasks. However, most successful DNNs have an extremely complex structure, leading to extensive research on model compression.As a significant area of…

Machine Learning · Computer Science 2020-04-13 Haipeng Jia , Xueshuang Xiang , Da Fan , Meiyu Huang , Changhao Sun , Yang He

We study numerical integration of smooth functions defined over the $s$-dimensional unit cube. A recent work by Dick et al. (2019) has introduced so-called extrapolated polynomial lattice rules, which achieve the almost optimal rate of…

Numerical Analysis · Mathematics 2020-07-15 Takashi Goda

Stochastic gradient methods have been a popular and powerful choice of optimization methods, aimed at minimizing functions. Their advantage lies in the fact that that one approximates the gradient as opposed to using the full Jacobian…

Numerical Analysis · Mathematics 2025-09-26 Neil K. Chada , Philip J. Herbert

Unstructured pruning remains a powerful strategy for compressing deep neural networks, yet it often demands iterative train-prune-retrain cycles, resulting in significant computational overhead. To address this challenge, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Md. Samiul Alim , Sharjil Khan , Amrijit Biswas , Fuad Rahman , Shafin Rahman , Nabeel Mohammed

In recent years, numerous real-time stereo matching methods have been introduced, but they often lack accuracy. These methods attempt to improve accuracy by introducing new modules or integrating traditional methods. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Baiyu Pan , Jichao Jiao , Jianxing Pang , Jun Cheng

We consider the problem of minimizing the average of a large number of smooth but possibly non-convex functions. In the context of most machine learning applications, each loss function is non-negative and thus can be expressed as the…

Optimization and Control · Mathematics 2024-07-08 Antonio Orvieto , Lin Xiao