English
Related papers

Related papers: Amortizing Maximum Inner Product Search with Learn…

200 papers

The inner-product navigable small world graph (ip-NSW) represents the state-of-the-art method for approximate maximum inner product search (MIPS) and it can achieve an order of magnitude speedup over the fastest baseline. However, to date…

Information Retrieval · Computer Science 2019-12-10 Jie Liu , Xiao Yan , Xinyan Dai , Zhirong Li , James Cheng , Ming-Chang Yang

This work introduces a framework to address the computational complexity inherent in Mixed-Integer Programming (MIP) models by harnessing the potential of deep learning. By employing deep learning, we construct problem-specific heuristics…

Optimization and Control · Mathematics 2024-05-13 Niki Triantafyllou , Maria M. Papathanasiou

Piecewise regression is a versatile approach used in various disciplines to approximate complex functions from limited, potentially noisy data points. In control, piecewise regression is, e.g., used to approximate the optimal control law of…

Optimization and Control · Mathematics 2024-07-10 Dieter Teichrib , Moritz Schulze Darup

Several recent publications report advances in training optimal decision trees (ODT) using mixed-integer programs (MIP), due to algorithmic advances in integer programming and a growing interest in addressing the inherent suboptimality of…

Machine Learning · Computer Science 2020-11-09 Haoran Zhu , Pavankumar Murali , Dzung T. Phan , Lam M. Nguyen , Jayant R. Kalagnanam

Online imitation learning is the problem of how best to mimic expert demonstrations, given access to the environment or an accurate simulator. Prior work has shown that in the infinite sample regime, exact moment matching achieves value…

Creating impact in real-world settings requires artificial intelligence techniques to span the full pipeline from data, to predictive models, to decisions. These components are typically approached separately: a machine learning model is…

Machine Learning · Computer Science 2018-11-22 Bryan Wilder , Bistra Dilkina , Milind Tambe

Learning similarity functions between image pairs with deep neural networks yields highly correlated activations of embeddings. In this work, we show how to improve the robustness of such embeddings by exploiting the independence within…

Computer Vision and Pattern Recognition · Computer Science 2018-01-16 Michael Opitz , Georg Waltner , Horst Possegger , Horst Bischof

Modern deep learning heavily relies on large labeled datasets, which often comse with high costs in terms of both manual labeling and computational resources. To mitigate these challenges, researchers have explored the use of informative…

Machine Learning · Statistics 2023-09-07 Yong Lin , Chen Liu , Chenlu Ye , Qing Lian , Yuan Yao , Tong Zhang

Maximum inner product search (MIPS) over dense and sparse vectors have progressed independently in a bifurcated literature for decades; the latter is better known as top-$k$ retrieval in Information Retrieval. This duality exists because…

Information Retrieval · Computer Science 2024-05-20 Sebastian Bruch , Franco Maria Nardini , Amir Ingber , Edo Liberty

Choosing appropriate step sizes is critical for reducing the computational cost of training large-scale neural network models. Mini-batch sub-sampling (MBSS) is often employed for computational tractability. However, MBSS introduces a…

Machine Learning · Statistics 2019-09-17 Younghwan Chae , Daniel N. Wilke

We introduce a learning-based algorithm to obtain a measurement matrix for compressive sensing related recovery problems. The focus lies on matrices with a constant modulus constraint which typically represent a network of analog phase…

Signal Processing · Electrical Eng. & Systems 2021-10-15 Michael Koller , Wolfgang Utschick

This paper investigates a new yet challenging problem called Reverse $k$-Maximum Inner Product Search (R$k$MIPS). Given a query (item) vector, a set of item vectors, and a set of user vectors, the problem of R$k$MIPS aims to find a set of…

Information Retrieval · Computer Science 2023-06-30 Qiang Huang , Yanhao Wang , Anthony K. H. Tung

In this paper we study the problem of content-based image retrieval. In this problem, the most popular performance measure is the top precision measure, and the most important component of a retrieval system is the similarity function used…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Ru-Ze Liang , Lihui Shi , Haoxiang Wang , Jiandong Meng , Jim Jing-Yan Wang , Qingquan Sun , Yi Gu

Mixed-integer linear programs (MILPs) are extensively used to model practical problems such as planning and scheduling. A prominent method for solving MILPs is large neighborhood search (LNS), which iteratively seeks improved solutions…

Optimization and Control · Mathematics 2024-12-12 Wenbo Liu , Akang Wang , Wenguo Yang , Qingjiang Shi

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

Machine Learning · Computer Science 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

A plain well-trained deep learning model often does not have the ability to learn new knowledge without forgetting the previously learned knowledge, which is known as catastrophic forgetting. Here we propose a novel method, SupportNet, to…

Neural and Evolutionary Computing · Computer Science 2018-12-31 Yu Li , Zhongxiao Li , Lizhong Ding , Yijie Pan , Chao Huang , Yuhui Hu , Wei Chen , Xin Gao

As a key task in machine learning, data classification is essentially to find a suitable coordinate system to represent data features of different classes of samples. This paper proposes the mutual-energy inner product optimization method…

Machine Learning · Computer Science 2024-11-12 Yuanxiu Wang

Providing natural language-based explanations to justify recommendations helps to improve users' satisfaction and gain users' trust. However, as current explanation generation methods are commonly trained with an objective to mimic existing…

Information Retrieval · Computer Science 2024-08-22 Yurou Zhao , Yiding Sun , Ruidong Han , Fei Jiang , Lu Guan , Xiang Li , Wei Lin , Weizhi Ma , Jiaxin Mao

Designing faster algorithms for solving Mixed-Integer Linear Programming (MILP) problems is highly desired across numerous practical domains, as a vast array of complex real-world challenges can be effectively modeled as MILP formulations.…

Artificial Intelligence · Computer Science 2026-01-23 Ruizhi Liu , Liming Xu , Xulin Huang , Jingyan Sui , Shizhe Ding , Boyang Xia , Chungong Yu , Dongbo Bu

Guided policy search algorithms can be used to optimize complex nonlinear policies, such as deep neural networks, without directly computing policy gradients in the high-dimensional parameter space. Instead, these methods use supervised…

Machine Learning · Computer Science 2016-07-18 William Montgomery , Sergey Levine