English
Related papers

Related papers: Revisiting Atomic Norm Minimization: A Sequential …

200 papers

Sharpness-Aware Minimization (SAM) has emerged as a powerful method for improving generalization in machine learning models by minimizing the sharpness of the loss landscape. However, despite its success, several important questions…

Optimization and Control · Mathematics 2025-03-05 Dimitris Oikonomou , Nicolas Loizou

Image-level weakly supervised semantic segmentation (WSSS) is a fundamental yet challenging computer vision task facilitating scene understanding and automatic driving. Most existing methods resort to classification-based Class Activation…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Jie Qin , Jie Wu , Xuefeng Xiao , Lujun Li , Xingang Wang

Despite the numerous uses of semidefinite programming (SDP) and its universal solvability via interior point methods (IPMs), it is rarely applied to practical large-scale problems. This mainly owes to the computational cost of IPMs that…

Optimization and Control · Mathematics 2024-03-19 Yifan Ran , Stefan Vlaski , Wei Dai

Deep neural networks (DNNs) have made great progress in various fields. In particular, the quantized neural network is a promising technique making DNNs compatible on resource-limited devices for memory and computation saving. In this…

Optimization and Control · Mathematics 2022-04-26 Fengmiao Bian , Ren Liu , Xiaoqun Zhang

Network estimation from multi-variate point process or time series data is a problem of fundamental importance. Prior work has focused on parametric approaches that require a known parametric model, which makes estimation procedures less…

Machine Learning · Statistics 2021-06-30 Yue Gao , Garvesh Raskutti

Deep neural networks often suffer from poor generalization due to complex and non-convex loss landscapes. Sharpness-Aware Minimization (SAM) is a popular solution that smooths the loss landscape by minimizing the maximized change of…

Artificial Intelligence · Computer Science 2023-07-03 Peng Mi , Li Shen , Tianhe Ren , Yiyi Zhou , Tianshuo Xu , Xiaoshuai Sun , Tongliang Liu , Rongrong Ji , Dacheng Tao

Sharpness-Aware Minimization (SAM) is a recent training method that relies on worst-case weight perturbations which significantly improves generalization in various settings. We argue that the existing justifications for the success of SAM…

Machine Learning · Computer Science 2022-06-14 Maksym Andriushchenko , Nicolas Flammarion

Genome sequence analysis is a powerful tool in medical and scientific research. Considering the inevitable sequencing errors and genetic variations, approximate string matching (ASM) has been adopted in practice for genome sequencing.…

Association Rule Mining (ARM) is the task of learning associations among data features in the form of logical rules. Mining association rules from high-dimensional numerical data, for example, time series data from a large number of sensors…

Machine Learning · Computer Science 2024-03-28 Erkan Karabulut , Victoria Degeler , Paul Groth

Abstract Meaning Representation (AMR) is a recently designed semantic representation language intended to capture the meaning of a sentence, which may be represented as a single-rooted directed acyclic graph with labeled nodes and edges.…

Computation and Language · Computer Science 2019-05-30 Rafael T. Anchieta , Marco A. S. Cabezudo , Thiago A. S. Pardo

Inspired by the adaptation phenomenon of neuronal firing, we propose the regularity normalization (RN) as an unsupervised attention mechanism (UAM) which computes the statistical regularity in the implicit space of neural networks under the…

Machine Learning · Computer Science 2021-12-30 Baihan Lin

This paper is concerned with estimating unknown multi-dimensional frequencies from linear compressive measurements. This is accomplished by employing the recently proposed atomic norm minimization framework to recover these frequencies…

Signal Processing · Electrical Eng. & Systems 2018-11-07 Sebastian Semper , Florian Römer

Dictionary Learning (DL) is one of the leading sparsity promoting techniques in the context of image classification, where the "dictionary" matrix D of images and the sparse matrix X are determined so as to represent a redundant image…

Numerical Analysis · Mathematics 2022-03-10 Domitilla Brandoni , Margherita Porcelli , Valeria Simoncini

Quantization is the process of mapping an input signal from an infinite continuous set to a countable set with a finite number of elements. It is a non-linear irreversible process, which makes the traditional methods of system…

Systems and Control · Electrical Eng. & Systems 2023-01-31 Omar M. Sleem , Constantino M. Lagoa

Spiking Neural Networks (SNNs) offer an energy efficient alternative to conventional Artificial Neural Networks (ANNs) but typically still require a large number of parameters. This work introduces Linearized Bregman Iterations (LBI) as an…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Daniel Windhager , Bernhard A. Moser , Michael Lunglmayr

Answer set programming (ASP) is a paradigm for modeling knowledge intensive domains and solving challenging reasoning problems. In ASP solving, a typical strategy is to preprocess problem instances by rewriting complex rules into simpler…

Logic in Computer Science · Computer Science 2020-11-09 Jori Bomanson , Tomi Janhunen

Nuclei instance segmentation is critical in computational pathology for cancer diagnosis and prognosis. Recently, the Segment Anything Model has demonstrated exceptional performance in various segmentation tasks, leveraging its rich priors…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jingze Su , Tianle Zhu , Jiaxin Cai , Zhiyi Wang , Qi Li , Xiao Zhang , Tong Tong , Shu Wang , Wenxi Liu

Motion planning under uncertainty is essential for reliable robot operation. Despite substantial advances over the past decade, the problem remains difficult for systems with complex dynamics. Most state-of-the-art methods perform search…

Robotics · Computer Science 2020-06-01 Marcus Hoerger , Hanna Kurniawati , Alberto Elfes

Optimization approaches based on operator splitting are becoming popular for solving sparsity regularized statistical machine learning models. While many have proposed fast algorithms to solve these problems for a single regularization…

Methodology · Statistics 2015-04-28 Yue Hu , Eric Chi , Genevera I. Allen

An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a…

Optimization and Control · Mathematics 2020-10-27 Jianchao Bai , William W. Hager , Hongchao Zhang