English
Related papers

Related papers: Generalized Non-orthogonal Joint Diagonalization w…

200 papers

For the high dimensional data representation, nonnegative tensor ring (NTR) decomposition equipped with manifold learning has become a promising model to exploit the multi-dimensional structure and extract the feature from tensor data.…

Machine Learning · Computer Science 2021-09-07 Xinhai Zhao , Yuyuan Yu , Guoxu Zhou , Qibin Zhao , Weijun Sun

Despite perfectly interpolating the training data, deep neural networks (DNNs) can often generalize fairly well, in part due to the "implicit regularization" induced by the learning algorithm. Nonetheless, various forms of regularization,…

Machine Learning · Computer Science 2022-02-23 Navid Azizan , Sahin Lale , Babak Hassibi

The nested off-diagonal Bethe ansatz method is proposed to diagonalize multi-component integrable models with generic integrable boundaries. As an example, the exact solutions of the su(n)-invariant spin chain model with both periodic and…

High Energy Physics - Theory · Physics 2015-06-18 Junpeng Cao , Wen-Li Yang , Kangjie Shi , Yupeng Wang

Multi-modal image registration is a challenging problem that is also an important clinical task for many real applications and scenarios. As a first step in analysis, deformable registration among different image modalities is often…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Fengze Liu , Jinzheng Cai , Yuankai Huo , Chi-Tung Cheng , Ashwin Raju , Dakai Jin , Jing Xiao , Alan Yuille , Le Lu , ChienHung Liao , Adam P Harrison

Tensor decomposition is an effective tool for learning multi-way structures and heterogeneous features from high-dimensional data, such as the multi-view images and multichannel electroencephalography (EEG) signals, are often represented by…

Machine Learning · Computer Science 2022-06-29 Wanguang Yin , Youzhi Qu , Zhengming Ma , Quanying Liu

Agglomeration techniques can be successfully employed to reduce the computational costs of numerical simulations and stand at the basis of multilevel algebraic solvers. To automatically perform mesh agglomeration, we propose a novel…

Numerical Analysis · Mathematics 2025-08-08 Paola F. Antonietti , Mattia Corti , Gabriele Martinelli

This paper presents a new generalization error analysis for Decentralized Stochastic Gradient Descent (D-SGD) based on algorithmic stability. The obtained results overhaul a series of recent works that suggested an increased instability due…

Machine Learning · Computer Science 2024-06-14 Batiste Le Bars , Aurélien Bellet , Marc Tommasi , Kevin Scaman , Giovanni Neglia

A commonly used heuristic in non-convex optimization is Normalized Gradient Descent (NGD) - a variant of gradient descent in which only the direction of the gradient is taken into account and its magnitude ignored. We analyze this heuristic…

Machine Learning · Computer Science 2016-11-22 Kfir Y. Levy

Nowadays, analysing data from different classes or over a temporal grid has attracted a great deal of interest. As a result, various multiple graphical models for learning a collection of graphical models simultaneously have been derived by…

Optimization and Control · Mathematics 2021-04-23 Ning Zhang , Yangjing Zhang , Defeng Sun , Kim-Chuan Toh

Multimodal imaging has transformed neuroscience research. While it presents unprecedented opportunities, it also imposes serious challenges. Particularly, it is difficult to combine the merits of the interpretability attributed to a simple…

Methodology · Statistics 2021-11-25 Xiaowu Dai , Lexin Li

The generalized alternating direction method of multipliers (ADMM) of Xiao et al. [{\tt Math. Prog. Comput., 2018}] aims at the two-block linearly constrained composite convex programming problem, in which each block is in the form of…

Optimization and Control · Mathematics 2022-04-05 Hongwu Li , Haibin Zhang , Yunhai Xiao

Purpose: To improve the image quality of highly accelerated multi-channel MRI data by learning a joint variational network that reconstructs multiple clinical contrasts jointly. Methods: Data from our multi-contrast acquisition was embedded…

Image and Video Processing · Electrical Eng. & Systems 2019-10-09 Daniel Polak , Stephen Cauley , Berkin Bilgic , Enhao Gong , Peter Bachert , Elfar Adalsteinsson , Kawin Setsompop

A mixture of joint generalized hyperbolic distributions (MJGHD) is introduced for asymmetric clustering for high-dimensional data. The MJGHD approach takes into account the cluster-specific subspace, thereby limiting the number of…

Methodology · Statistics 2018-11-02 Yang Tang , Ryan P. Browne , Paul D. McNicholas

In this paper, we introduce the algorithms of Orthogonal Deep Neural Networks (OrthDNNs) to connect with recent interest of spectrally regularized deep learning methods. OrthDNNs are theoretically motivated by generalization analysis of…

Machine Learning · Computer Science 2019-10-16 Kui Jia , Shuai Li , Yuxin Wen , Tongliang Liu , Dacheng Tao

Nonlinear acceleration methods are powerful techniques to speed up fixed-point iterations. However, many acceleration methods require storing a large number of previous iterates and this can become impractical if computational resources are…

Machine Learning · Computer Science 2022-10-25 Huan He , Shifan Zhao , Ziyuan Tang , Joyce C Ho , Yousef Saad , Yuanzhe Xi

Motivated by the goal of achieving long-term drift-free camera pose estimation in complex scenarios, we propose a global positioning framework fusing visual, inertial and Global Navigation Satellite System (GNSS) measurements in multiple…

Robotics · Computer Science 2022-01-06 Bing Han , Zhongyang Xiao , Shuai Huang , Tao Zhang

Despite the success of deep functional maps in non-rigid 3D shape matching, there exists no learning framework that models both self-symmetry and shape matching simultaneously. This is despite the fact that errors due to symmetry mismatch…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Abhishek Sharma , Maks Ovsjanikov

In this paper, we propose a new covering technique localized for the trajectories of SGD. This localization provides an algorithm-specific complexity measured by the covering number, which can have dimension-independent cardinality in…

Machine Learning · Statistics 2022-09-20 Sejun Park , Umut Şimşekli , Murat A. Erdogdu

The recently proposed neural network joint model (NNJM) (Devlin et al., 2014) augments the n-gram target language model with a heuristically chosen source context window, achieving state-of-the-art performance in SMT. In this paper, we give…

Computation and Language · Computer Science 2015-06-09 Fandong Meng , Zhengdong Lu , Mingxuan Wang , Hang Li , Wenbin Jiang , Qun Liu

We propose a hybrid reinforcement and self-supervised learning framework for accelerating generalized Benders decomposition (GBD). In this framework, a graph based reinforcement learning agent operates on a bipartite representation of the…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Bernard T. Agyeman , Zhe Li , Ilias Mitrai , Prodromos Daoutidis