English
Related papers

Related papers: Dataless Weight Disentanglement in Task Arithmetic…

200 papers

In intelligent transportation systems, traffic data imputation, estimating the missing value from partially observed data is an inevitable and challenging task. Previous studies have not fully considered traffic data's multidimensionality…

Machine Learning · Statistics 2023-11-01 Wenwu Gong , Zhejun Huang , Lili Yang

The challenge of learning disentangled representation has recently attracted much attention and boils down to a competition using a new real world disentanglement dataset (Gondal et al., 2019). Various methods based on variational…

Machine Learning · Computer Science 2019-12-03 Jie Qiao , Zijian Li , Boyan Xu , Ruichu Cai , Kun Zhang

Task arithmetic provides an efficient, training-free way to edit pre-trained models, yet lacks a fundamental theoretical explanation for its success. The existing concept of ``weight disentanglement" describes the ideal outcome of…

Artificial Intelligence · Computer Science 2026-04-21 Shangge Liu , Yuehan Yin , Lei Wang , Qi Fan , Yinghuan Shi , Wenbin Li , Yang Gao , Dacheng Tao

This paper presents a family of algorithms for decentralized convex composite problems. We consider the setting of a network of agents that cooperatively minimize a global objective function composed of a sum of local functions plus a…

Optimization and Control · Mathematics 2023-02-14 Yichuan Li , Petros G. Voulgaris , Dusan M. Stipanovic , Nikolaos M. Freris

Covariance estimation for matrix-valued data has received an increasing interest in applications. Unlike previous works that rely heavily on matrix normal distribution assumption and the requirement of fixed matrix size, we propose a class…

Methodology · Statistics 2022-04-20 Yichi Zhang , Weining Shen , Dehan Kong

In this work, we present an algorithmically tractable safe approximation of distributionally robust optimization (DRO) problems that contain univariate indicator functions. The latter appear in different applications, but render the model…

Optimization and Control · Mathematics 2026-01-22 Jana Dienstbier , Frauke Liers , Florian Rösel , Jan Rolfes

We propose a quadratic penalty method for continual learning of neural networks that contain batch normalization (BN) layers. The Hessian of a loss function represents the curvature of the quadratic penalty function, and a…

Machine Learning · Computer Science 2020-04-17 Janghyeon Lee , Hyeong Gwon Hong , Donggyu Joo , Junmo Kim

In this article, we propose an algorithm for approximating the action of $\varphi-$functions of matrices against vectors, which is a key operation in exponential time integrators. In particular, we consider matrices with Kronecker sum…

Numerical Analysis · Mathematics 2022-11-03 Matteo Croci , Judit Muñoz-Matute

In recent years, there has been a growing interest in mathematical models leading to the minimization, in a symmetric matrix space, of a Bregman divergence coupled with a regularization term. We address problems of this type within a…

Optimization and Control · Mathematics 2022-06-10 A. Benfenati , E. Chouzenoux , J. -C. Pesquet

Achieving high-performance in multi-object tracking algorithms heavily relies on modeling spatio-temporal relationships during the data association stage. Mainstream approaches encompass rule-based and deep learning-based methods for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhonglin Liu , Shujie Chen , Jianfeng Dong , Xun Wang , Di Zhou

We present an adaptive regularization scheme for optimizing composite energy functionals arising in image analysis problems. The scheme automatically trades off data fidelity and regularization depending on the current data fit during the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Byung-Woo Hong , Ja-Keoung Koo , Martin Burger , Stefano Soatto

We introduce and study a mathematical framework for a broad class of regularization functionals for ill-posed inverse problems: Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear…

Optimization and Control · Mathematics 2022-09-28 Kristian Bredies , Marcello Carioni , Martin Holler

Low-rank tensor completion problem aims to recover a tensor from limited observations, which has many real-world applications. Due to the easy optimization, the convex overlapping nuclear norm has been popularly used for tensor completion.…

Machine Learning · Computer Science 2019-01-24 Quanming Yao , James T Kwok , Bo Han

Minimization of boundary curvature is a classic regularization technique for image segmentation in the presence of noisy image data. Techniques for minimizing curvature have historically been derived from descent methods which could be…

Computer Vision and Pattern Recognition · Computer Science 2010-06-23 Noha El-Zehiry , Leo Grady

Disentangled visual representations have largely been studied with generative models such as Variational AutoEncoders (VAEs). While prior work has focused on generative methods for disentangled representation learning, these approaches do…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Andrea Burns , Aaron Sarna , Dilip Krishnan , Aaron Maschinot

The kernel trick concept, formulated as an inner product in a feature space, facilitates powerful extensions to many well-known algorithms. While the kernel matrix involves inner products in the feature space, the sample covariance matrix…

Computation · Statistics 2017-07-20 Tomer Lancewicki

We consider curvature depending variational models for image regularization, such as Euler's elastica. These models are known to provide strong priors for the continuity of edges and hence have important applications in shape-and image…

Numerical Analysis · Mathematics 2018-07-31 Antonin Chambolle , Thomas Pock

In machine learning it is common to interpret each data point as a vector in Euclidean space. However the data may actually be functional i.e.\ each data point is a function of some variable such as time and the function is discretely…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Stephen Tierney , Junbin Gao , Yi Guo , Zheng Zhang

Joint space trajectory optimization under end-effector task constraints leads to a challenging non-convex problem. Thus, a real-time adaptation of prior computed trajectories to perturbation in task constraints often becomes intractable.…

Multiple rotation averaging plays a crucial role in computer vision and robotics domains. The conventional optimization-based methods optimize a nonlinear cost function based on certain noise assumptions, while most previous learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Shiqi Li , Jihua Zhu , Yifan Xie , Naiwen Hu , Mingchen Zhu , Zhongyu Li , Di Wang