English
Related papers

Related papers: Modeling Choice via Self-Attention

200 papers

We present a mixed multinomial logit (MNL) model, which leverages the truncated stick-breaking process representation of the Dirichlet process as a flexible nonparametric mixing distribution. The proposed model is a Dirichlet process…

Applications · Statistics 2018-01-22 Rico Krueger , Akshay Vij , Taha H. Rashidi

Discrete-choice models are a powerful framework for analyzing decision-making behavior to provide valuable insights for policymakers and businesses. Multinomial logit models (MNLs) with linear utility functions have been used in practice…

Artificial Intelligence · Computer Science 2024-10-22 Tomoki Nishi , Yusuke Hara

This paper is concerned with learning decision makers' preferences using data on observed choices from a finite set of risky alternatives. We propose a discrete choice model with unobserved heterogeneity in consideration sets and in…

Econometrics · Economics 2021-01-07 Levon Barseghyan , Francesca Molinari , Matthew Thirkettle

Attention mechanism has become the dominant module in natural language processing models. It is computationally intensive and depends on massive power-hungry multiplications. In this paper, we rethink variants of attention mechanism from…

Computation and Language · Computer Science 2022-10-20 Yu Wan , Baosong Yang , Dayiheng Liu , Rong Xiao , Derek F. Wong , Haibo Zhang , Boxing Chen , Lidia S. Chao

The neural attention mechanism has been incorporated into deep neural networks to achieve state-of-the-art performance in various domains. Most such models use multi-head self-attention which is appealing for the ability to attend to…

Machine Learning · Computer Science 2021-10-26 Shujian Zhang , Xinjie Fan , Huangjie Zheng , Korawat Tanwisuth , Mingyuan Zhou

The study of network formation is pervasive in economics, sociology, and many other fields. In this paper, we model network formation as a `choice' that is made by nodes in a network to connect to other nodes. We study these `choices' using…

Social and Information Networks · Computer Science 2022-08-30 Harsh Gupta , Mason A. Porter

We study a stylized dynamic assortment planning problem during a selling season of finite length $T$. At each time period, the seller offers an arriving customer an assortment of substitutable products and the customer makes the purchase…

Machine Learning · Statistics 2021-02-22 Xi Chen , Chao Shi , Yining Wang , Yuan Zhou

We propose a novel model for learned query optimization which provides query hints leading to better execution plans. The model addresses the three key challenges in learned hint-based query optimization: reliable hint recommendation…

Databases · Computer Science 2024-12-06 Sergey Zinchenko , Sergey Iazov

This paper proposes a data-driven systematic, consistent and non-exhaustive approach to Model Selection, that is an extension of the classical agnostic PAC learning model. In this approach, learning problems are modeled not only by a…

Machine Learning · Statistics 2021-10-12 Diego Marcondes , Adilson Simonis , Junior Barrera

Multimodal Large Language Models (MLLMs) have shown strong performance in multi-image cross-modal retrieval, yet suffer from severe position bias, where predictions are dominated by input order rather than semantic relevance. Through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Mingtao Xian , Yifeng Yang , Qinying Gu , Xinbing Wang , Nanyang Ye

This paper presents a novel deep learning-based travel behaviour choice model.Our proposed Residual Logit (ResLogit) model formulation seamlessly integrates a Deep Neural Network (DNN) architecture into a multinomial logit model. Recently,…

Econometrics · Economics 2021-02-17 Melvin Wong , Bilal Farooq

Multinomial Logit (MNL) is one of the most popular discrete choice models and has been widely used to model ranking data. However, there is a long-standing technical challenge of learning MNL from many real-world ranking data: exact…

Machine Learning · Computer Science 2022-01-03 Jiaqi Ma , Xingjian Zhang , Qiaozhu Mei

In this paper, we study the assortment optimization problem under the mixed-logit customer choice model. While assortment optimization has been a major topic in revenue management for decades, the mixed-logit model is considered one of the…

Optimization and Control · Mathematics 2024-07-29 Hoang Giang Pham , Tien Mai

Choice modeling is at the core of understanding how changes to the competitive landscape affect consumer choices and reshape market equilibria. In this paper, we propose a fundamental characterization of choice functions that encompasses a…

Econometrics · Economics 2024-02-21 Amandeep Singh , Ye Liu , Hema Yoganarasimhan

Attention models are typically learned by optimizing one of three standard loss functions that are variously called -- soft attention, hard attention, and latent variable marginal likelihood (LVML) attention. All three paradigms are…

Machine Learning · Computer Science 2023-10-16 Rahul Vashisht , Harish G. Ramaswamy

The multicommodity capacitated fixed-charge network design problem has been extensively studied in the literature due to its wide range of applications. Despite the fact that many sophisticated solution methods exist today, finding…

Optimization and Control · Mathematics 2024-09-10 Charly Robinson La Rocca , Jean-François Cordeau , Emma Frejinger

Object-centric understanding is fundamental to human vision and required for complex reasoning. Traditional methods define slot-based bottlenecks to learn object properties explicitly, while recent self-supervised vision models like DINO…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Stefan Sylvius Wagner , Stefan Harmeling

Sequence-to-sequence (encoder-decoder) models with attention constitute a cornerstone of deep learning research, as they have enabled unprecedented sequential data modeling capabilities. This effectiveness largely stems from the capacity of…

Artificial Intelligence · Computer Science 2018-10-31 Aristotelis Charalampous , Sotirios Chatzis

Active learning is of great interest for many practical applications, especially in industry and the physical sciences, where there is a strong need to minimize the number of costly experiments necessary to train predictive models. However,…

Machine Learning · Computer Science 2021-12-23 Maryam Pardakhti , Nila Mandal , Anson W. K. Ma , Qian Yang

This paper presents a comprehensive study on stock price prediction, leveragingadvanced machine learning (ML) and deep learning (DL) techniques to improve financial forecasting accuracy. The research evaluates the performance of various…

Statistical Finance · Quantitative Finance 2025-02-25 Daksh Dave , Gauransh Sawhney , Vikhyat Chauhan