English
Related papers

Related papers: Doubly-Adaptive Artificial Compression Methods for…

200 papers

The alternating direction method of multipliers (ADMM) is commonly used for distributed model fitting problems, but its performance and reliability depend strongly on user-defined penalty parameters. We study distributed ADMM methods that…

Machine Learning · Computer Science 2017-06-21 Zheng Xu , Gavin Taylor , Hao Li , Mario Figueiredo , Xiaoming Yuan , Tom Goldstein

Adaptive gradient-based optimizers such as Adagrad and Adam are crucial for achieving state-of-the-art performance in machine translation and language modeling. However, these methods maintain second-order statistics for each parameter,…

Machine Learning · Computer Science 2019-09-13 Rohan Anil , Vineet Gupta , Tomer Koren , Yoram Singer

In this work, we present a positivity-preserving entropy-based adaptive filtering method for shock capturing in discontinuous spectral element methods. By adapting the filter strength to enforce positivity and a local discrete minimum…

Numerical Analysis · Mathematics 2022-07-29 Tarik Dzanic , Freddie D. Witherden

Molecular Dynamics (MD) simulations are fundamental computational tools for the study of proteins and their free energy landscapes. However, sampling protein conformational changes through MD simulations is challenging due to the relatively…

Biomolecules · Quantitative Biology 2023-07-20 Diego E. Kleiman , Hassan Nadeem , Diwakar Shukla

In this paper, we develop a self-adaptive ADMM that updates the penalty parameter adaptively. When one part of the objective function is strongly convex i.e., the problem is semi-strongly convex, our algorithm can update the penalty…

Optimization and Control · Mathematics 2023-10-03 Tianyun Tang , Kim-Chuan Toh

We discuss hybrid atomistic-continuum methods for multiscale hydrodynamic applications. Both dense fluid and dilute gas formulations are considered. The choice of coupling method and its relation to the fluid physics is discussed. The…

Computational Physics · Physics 2007-05-23 Hettithanthrige S. Wijesinghe , Nicolas G. Hadjiconstantinou

We propose a spectral method for the 1D-1V Vlasov-Poisson system where the discretization in velocity space is based on asymmetrically-weighted Hermite functions, dynamically adapted via a scaling $\alpha$ and shifting $u$ of the velocity…

Numerical Analysis · Mathematics 2023-06-02 Cecilia Pagliantini , Gian Luca Delzanno , Stefano Markidis

In this article we describe a stable partitioned algorithm that overcomes the added mass instability arising in fluid-structure interactions of light rigid bodies and inviscid compressible flow. The new algorithm is stable even for bodies…

Numerical Analysis · Mathematics 2015-06-11 J. W. Banks , W. D. Henshaw , B. Sjogreen

We present multi-adaptive versions of the standard continuous and discontinuous Galerkin methods for ODEs. Taking adaptivity one step further, we allow for individual time-steps, order and quadrature, so that in particular each individual…

Numerical Analysis · Mathematics 2012-05-15 Anders Logg

The power flow equations are fundamental to power system planning, analysis, and control. However, the inherent non-linearity and non-convexity of these equations present formidable obstacles in problem-solving processes. To mitigate these…

Optimization and Control · Mathematics 2024-11-15 Paprapee Buason , Sidhant Misra , Jean-Paul Watson , Daniel K. Molzahn

We propose a new sampling algorithm combining two quite powerful ideas in the Markov chain Monte Carlo literature -- adaptive Metropolis sampler and two-stage Metropolis-Hastings sampler. The proposed sampling method will be particularly…

Computation · Statistics 2021-01-05 Anirban Mondal , Kai Yin , Abhijit Mandal

We present data streaming algorithms for the $k$-median problem in high-dimensional dynamic geometric data streams, i.e. streams allowing both insertions and deletions of points from a discrete Euclidean space $\{1, 2, \ldots \Delta\}^d$.…

Data Structures and Algorithms · Computer Science 2017-06-14 Vladimir Braverman , Gereon Frahling , Harry Lang , Christian Sohler , Lin F. Yang

High-dimensional and incomplete (HDI) data, characterized by massive node interactions, have become ubiquitous across various real-world applications. Second-order latent factor models have shown promising performance in modeling this type…

Machine Learning · Computer Science 2025-07-08 Jialiang Wang , Junzhou Wang , Xin Liao

The light damping hypothesis is usually assumed in structural dynamics since dissipative forces are in general weak with respect to inertial and elastic forces. In this paper a novel numerical method of time integration based on the…

Numerical Analysis · Mathematics 2025-04-01 Mario Lázaro

Vertical equilibrium models have proven to be well suited for simulating fluid flow in subsurface porous media such as saline aquifers with caprocks. However, in most cases the dimensionally reduced model lacks the accuracy to capture the…

Fluid Dynamics · Physics 2024-05-29 Ivan Buntic , Martin Schneider , Bernd Flemisch , Rainer Helmig

This paper develops an adaptive proximal alternating direction method of multipliers (ADMM) for solving linearly constrained, composite optimization problems under the assumption that the smooth component of the objective is weakly convex,…

Optimization and Control · Mathematics 2026-05-04 Leandro Farias Maia , David H. Gutman , Renato D. C. Monteiro , Gilson N. Silva

While learning based compression techniques for images have outperformed traditional methods, they have not been widely adopted in machine learning pipelines. This is largely due to lack of standardization and lack of retention of salient…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Kartik Gupta , Kimberley Faria , Vikas Mehta

In characterization of quantum systems, adapting measurement settings based on data while it is collected can generally outperform in efficiency conventional measurements that are carried out independently of data. The existing methods for…

Quantum Physics · Physics 2016-11-21 Markku P. V. Stenberg , Frank K. Wilhelm

How can we compress language models without sacrificing accuracy? The number of compression algorithms for language models is rapidly growing to benefit from remarkable advances of recent language models without side effects due to the…

Computation and Language · Computer Science 2024-01-30 Seungcheol Park , Jaehyeon Choi , Sojin Lee , U Kang

Entropy stable methods have become increasingly popular in the field of computational fluid dynamics. They often work by satisfying some form of a discrete entropy inequality: a discrete form of the 2nd law of thermodynamics. Schemes which…

Numerical Analysis · Mathematics 2025-09-08 Brian Christner , Jesse Chan