English
Related papers

Related papers: Multi-Gradient Descent for Multi-Objective Recomme…

200 papers

Multi-label learning studies the problem where an instance is associated with a set of labels. By treating single-label learning problem as one task, the multi-label learning problem can be casted as solving multiple related tasks…

Machine Learning · Computer Science 2019-11-20 Lu Bai , Yew-Soon Ong , Tiantian He , Abhishek Gupta

The surge in multimedia content has led to the development of Multi-Modal Recommender Systems (MMRecs), which use diverse modalities such as text, images, videos, and audio for more personalized recommendations. However, MMRecs struggle…

Information Retrieval · Computer Science 2025-04-22 Hongji Li , Hanwen Du , Youhua Li , Junchen Fu , Chunxiao Li , Ziyi Zhuang , Jiakang Li , Yongxin Ni

Sequential recommendations have drawn significant attention in modeling the user's historical behaviors to predict the next item. With the booming development of multimodal data (e.g., image, text) on internet platforms, sequential…

Information Retrieval · Computer Science 2024-12-12 Changhong Li , Zhiqiang Guo

This paper introduces and examines numerical approximation schemes for computing risk budgeting portfolios associated to positive homogeneous and sub-additive risk measures. We employ Mirror Descent algorithms to determine the optimal risk…

Portfolio Management · Quantitative Finance 2024-11-20 Martin Arnaiz Iglesias , Adil Rengim Cetingoz , Noufel Frikha

In this paper, we present a multilevel Monte Carlo (MLMC) version of the Stochastic Gradient (SG) method for optimization under uncertainty, in order to tackle Optimal Control Problems (OCP) where the constraints are described in the form…

Optimization and Control · Mathematics 2019-12-30 Matthieu Martin , Fabio Nobile , Panagiotis Tsilifis

Implicit bias induced by gradient-based algorithms is essential to the generalization of overparameterized models, yet its mechanisms can be subtle. This work leverages the Normalized Steepest Descent} (NSD) framework to investigate how…

Machine Learning · Computer Science 2026-03-25 Shengping Xie , Zekun Wu , Quan Chen , Kaixu Tang

Composite convex optimization models arise in several applications, and are especially prevalent in inverse problems with a sparsity inducing norm and in general convex optimization with simple constraints. The most widely used algorithms…

Optimization and Control · Mathematics 2016-07-15 Vahan Hovhannisyan , Panos Parpas , Stefanos Zafeiriou

Current state-of-the-art multi-objective optimization solvers, by computing gradients of all $m$ objective functions per iteration, produce after $k$ iterations a measure of proximity to critical conditions that is upper-bounded by…

Optimization and Control · Mathematics 2021-05-26 I. F. D. Oliveira , R. H. C. Takahashi

We consider the problem of minimization of a convex function on a simple set with convex non-smooth inequality constraint and describe first-order methods to solve such problems in different situations: smooth or non-smooth objective…

Optimization and Control · Mathematics 2018-01-30 Anastasia Bayandina , Pavel Dvurechensky , Alexander Gasnikov , Fedor Stonyakin , Alexander Titov

Modern recommender systems trained on domain-specific data often struggle to generalize across multiple domains. Cross-domain sequential recommendation has emerged as a promising research direction to address this challenge; however,…

Information Retrieval · Computer Science 2026-01-06 Hyunsoo Kim , Jaewan Moon , Seongmin Park , Jongwuk Lee

Distributionally robust optimization (DRO) problems are increasingly seen as a viable method to train machine learning models for improved model generalization. These min-max formulations, however, are more difficult to solve. We therefore…

Machine Learning · Statistics 2020-11-03 Soumyadip Ghosh , Mark Squillante , Ebisa Wollega

Seeking to improve model generalization, we consider a new approach based on distributionally robust learning (DRL) that applies stochastic gradient descent to the outer minimization problem. Our algorithm efficiently estimates the gradient…

Machine Learning · Statistics 2020-12-24 Soumyadip Ghosh , Mark Squillante

Stochastic optimization problems with unknown decision-dependent distributions have attracted increasing attention in recent years due to its importance in applications. Since the gradient of the objective function is inaccessible as a…

Optimization and Control · Mathematics 2025-10-30 Yuya Hikima , Akiko Takeda

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

In nonsmooth optimization, a negative subgradient is not necessarily a descent direction, making the design of convergent descent methods based on zeroth-order and first-order information a challenging task. The well-studied bundle methods…

Optimization and Control · Mathematics 2025-05-13 Hanyang Li , Ying Cui

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion model towards…

Machine Learning · Statistics 2024-10-17 Yingqing Guo , Hui Yuan , Yukang Yang , Minshuo Chen , Mengdi Wang

Many relevant problems in the area of systems and control, such as controller synthesis, observer design and model reduction, can be viewed as optimization problems involving dynamical systems: for instance, maximizing performance in the…

Optimization and Control · Mathematics 2023-11-15 Pascal Den Boef , Jos Maubach , Wil Schilders , Nathan van de Wouw

This paper considers stochastic optimization problems for a large class of objective functions, including convex and continuous submodular. Stochastic proximal gradient methods have been widely used to solve such problems; however, their…

Optimization and Control · Mathematics 2018-11-13 Aryan Mokhtari , Hamed Hassani , Amin Karbasi

Arising in semi-parametric statistics, control applications, and as sub-problems in global optimization methods, certain optimization problems can have objective functions requiring numerical integration to evaluate, yet gradient function…

Optimization and Control · Mathematics 2025-03-06 Christian Varner , Vivak Patel

We consider the task of enforcing individual fairness in gradient boosting. Gradient boosting is a popular method for machine learning from tabular data, which arise often in applications where algorithmic fairness is a concern. At a high…

Machine Learning · Computer Science 2021-04-01 Alexander Vargo , Fan Zhang , Mikhail Yurochkin , Yuekai Sun