English
Related papers

Related papers: Tensor Train accelerated solvers for nonsmooth rig…

200 papers

In this paper a special semi-smooth equation associated to the second order cone is studied. It is shown that, under mild assumptions, the semi-smooth Newton method applied to this equation is well-defined and the generated sequence is…

Optimization and Control · Mathematics 2016-10-17 Jose Yunier Bello Cruz , O. P. Ferreira , S. Z. Nemeth , L. F. Prudente

The nonequilibrium Green's function (NEGF) formalism is a powerful tool to study the nonequilibrium dynamics of correlated lattice systems, but its applicability to realistic system sizes and long timescales is limited by unfavorable memory…

Strongly Correlated Electrons · Physics 2025-09-29 Maksymilian Środa , Ken Inayoshi , Michael Schüler , Hiroshi Shinaoka , Philipp Werner

We present successive convexification, a real-time-capable solution method for nonconvex trajectory optimization, with continuous-time constraint satisfaction and guaranteed convergence, that only requires first-order information. The…

Optimization and Control · Mathematics 2024-04-26 Purnanand Elango , Dayou Luo , Abhinav G. Kamath , Samet Uzun , Taewan Kim , Behçet Açıkmeşe

Approximating a tensor in the tensor train (TT) format has many important applications in scientific computing. Rounding a TT tensor involves further compressing a tensor that is already in the TT format. This paper proposes new randomized…

The era of exascale computing opens new venues for innovations and discoveries in many scientific, engineering, and commercial fields. However, with the exaflops also come the extra-large high-dimensional data generated by high-performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-05 Manish Bhattarai , Gopinath Chennupati , Erik Skau , Raviteja Vangara , Hirsto Djidjev , Boian Alexandrov

Attempts of studying implicit regularization associated to gradient descent (GD) have identified matrix completion as a suitable test-bed. Late findings suggest that this phenomenon cannot be phrased as a minimization-norm problem, implying…

Artificial Intelligence · Computer Science 2021-05-05 Paolo Milanesi , Hachem Kadri , Stéphane Ayache , Thierry Artières

The modern convolutional neural networks although achieve great results in solving complex computer vision tasks still cannot be effectively used in mobile and embedded devices due to the strict requirements for computational complexity,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Nikolay Kozyrskiy , Anh-Huy Phan

In this paper, we propose a unified two-phase scheme to accelerate any high-order regularized tensor approximation approach on the smooth part of a composite convex optimization model. The proposed scheme has the advantage of not needing to…

Optimization and Control · Mathematics 2020-07-06 Bo Jiang , Tianyi Lin , Shuzhong Zhang

In this paper, we propose new proximal Newton-type methods for convex optimization problems in composite form. The applications include model predictive control (MPC) and embedded MPC. Our new methods are computationally attractive since…

Optimization and Control · Mathematics 2020-07-21 Ilan Adler , Zhiyue Tom Hu , Tianyi Lin

Nearest-neighbor search in large vector databases is crucial for various machine learning applications. This paper introduces a novel method using tensor-train (TT) low-rank tensor decomposition to efficiently represent point clouds and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Georgii Novikov , Alexander Gneushev , Alexey Kadeishvili , Ivan Oseledets

We develop new adaptive algorithms for temporal integration of nonlinear evolution equations on tensor manifolds. These algorithms, which we call step-truncation methods, are based on performing one time step with a conventional…

Numerical Analysis · Mathematics 2022-03-09 Abram Rodgers , Alec Dektor , Daniele Venturi

This work links optimization approaches from hierarchical least-squares programming to instantaneous prioritized whole-body robot control. Concretely, we formulate the hierarchical Newton's method which solves prioritized non-linear…

Robotics · Computer Science 2023-03-09 Kai Pfeiffer , Adrien Escande , Pierre Gergondet , Abderrahmane Kheddar

Finding a Z-eigenpair of a symmetric tensor is equivalent to finding a KKT point of a sphere constrained minimization problem. Based on this equivalency, in this paper, we first propose a class of iterative methods to get a Z-eigenpair of a…

Optimization and Control · Mathematics 2022-03-15 Dong-hui Li , Xueli Bai , Jiefeng Xu

A robust and efficient time integrator for dynamical tensor approximation in the tensor train or matrix product state format is presented. The method is based on splitting the projector onto the tangent space of the tensor manifold. The…

Numerical Analysis · Mathematics 2015-05-27 Christian Lubich , Ivan Oseledets , Bart Vandereycken

In this paper, we explore the role of tensor algebra in balanced truncation (BT) based model reduction/identification for high-dimensional multilinear/linear time invariant systems. In particular, we employ tensor train decomposition (TTD),…

Systems and Control · Electrical Eng. & Systems 2020-01-28 Can Chen , Amit Surana , Anthony Bloch , Indika Rajapakse

Low-rank methods for kinetic equations have attracted increasing attention due to their effectiveness in reducing the high dimensionality of phase space. In our previous work [G. Wang & J. Hu, J. Comput. Phys. 558 (2026) 114884], we…

Numerical Analysis · Mathematics 2026-05-18 Geshuo Wang , Jingwei Hu

An adaptive regularization strategy for stabilizing Newton-like iterations on a coarse mesh is developed in the context of adaptive finite element methods for nonlinear PDE. Existence, uniqueness and approximation properties are known for…

Numerical Analysis · Mathematics 2015-01-27 Sara Pollock

Recently, a tensor-on-tensor (ToT) regression model has been proposed to generalize tensor recovery, encompassing scenarios like scalar-on-tensor regression and tensor-on-vector regression. However, the exponential growth in tensor…

Machine Learning · Computer Science 2025-05-02 Zhen Qin , Zhihui Zhu

We propose inertial versions of block coordinate descent methods for solving non-convex non-smooth composite optimization problems. Our methods possess three main advantages compared to current state-of-the-art accelerated first-order…

Optimization and Control · Mathematics 2020-06-03 Le Thi Khanh Hien , Nicolas Gillis , Panagiotis Patrinos

Recent advances in deep learning have allowed neural networks (NNs) to successfully replace traditional numerical solvers in many applications, thus enabling impressive computing gains. One such application is time domain simulation, which…

Machine Learning · Computer Science 2021-12-09 Samuel Chevalier , Jochen Stiasny , Spyros Chatzivasileiadis