English
Related papers

Related papers: Diffusion Approximations for a Class of Sequential…

200 papers

We consider the problem of sequential evaluation, in which an evaluator observes candidates in a sequence and assigns scores to these candidates in an online, irrevocable fashion. Motivated by the psychology literature that has studied…

Machine Learning · Statistics 2023-11-20 Jingyan Wang , Ashwin Pananjady

Stochastic choice-based discrete planning is a broad class of decision-making problems characterized by a sequential decision-making process involving a planner and a group of customers. The firm or planner first decides a subset of options…

Optimization and Control · Mathematics 2024-09-20 Jiajie Zhang , Yun Hui Lin , Gerardo Berbeglia

Motivated by real-world machine learning applications, we consider a statistical classification task in a sequential setting where test samples arrive sequentially. In addition, the generating distributions are unknown and only a set of…

Machine Learning · Statistics 2021-02-11 Mahdi Haghifam , Vincent Y. F. Tan , Ashish Khisti

Model-based reinforcement learning methods often use learning only for the purpose of estimating an approximate dynamics model, offloading the rest of the decision-making work to classical trajectory optimizers. While conceptually simple,…

Machine Learning · Computer Science 2022-12-22 Michael Janner , Yilun Du , Joshua B. Tenenbaum , Sergey Levine

The note studies the problem of selecting a good enough subset out of a finite number of alternatives under a fixed simulation budget. Our work aims to maximize the posterior probability of correctly selecting a good subset. We formulate…

Optimization and Control · Mathematics 2023-05-09 Gongbo Zhang , Bin Chen , Qing-shan Jia , Yijie Peng

Sampling from the posterior is a key technical problem in Bayesian statistics. Rigorous guarantees are difficult to obtain for Markov Chain Monte Carlo algorithms of common use. In this paper, we study an alternative class of algorithms…

Statistics Theory · Mathematics 2024-08-26 Andrea Montanari , Yuchen Wu

We model the joint distribution of choice probabilities and decision times in binary choice tasks as the solution to a problem of optimal sequential sampling, where the agent is uncertain of the utility of each action and pays a constant…

Neurons and Cognition · Quantitative Biology 2015-05-14 Drew Fudenberg , Philipp Strack , Tomasz Strzalecki

Adapting pretrained diffusion models to downstream objectives such as inverse problems often requires expensive test-time guidance or optimization. We propose a principled framework for generating high-quality reward-aligned samples at…

Machine Learning · Computer Science 2026-05-22 Kushagra Pandey , Farrin Marouf Sofian , Jan Niklas Groeneveld , Felix Draxler , Stephan Mandt

To make decisions organisms often accumulate information across multiple timescales. However, most experimental and modeling studies of decision-making focus on sequences of independent trials. On the other hand, natural environments are…

Neurons and Cognition · Quantitative Biology 2018-06-12 Khanh P Nguyen , Kresimir Josic , Zachary P Kilpatrick

This work investigates the sequential hypothesis testing problem with online sensor selection and sensor usage constraints. That is, in a sensor network, the fusion center sequentially acquires samples by selecting one "most informative"…

Applications · Statistics 2016-01-26 Shang Li , Xiaoou Li , Xiaodong Wang , Jingchen Liu

Recent work has framed decision-making as a sequence modeling problem using generative models such as diffusion models. Although promising, these approaches often overlook latent factors that exhibit evolving dynamics, elements that are…

Machine Learning · Computer Science 2026-05-18 Fan Feng , Selena Ge , Minghao Fu , Zijian Li , Yujia Zheng , Zeyu Tang , Yingyao Hu , Biwei Huang , Kun Zhang

Diffusion processes have been widely used for approximations in the queueing theory. There are different types of diffusion approximations. Among them, we are interested in those obtained through limits of a sequence of models which…

Probability · Mathematics 2015-01-20 Masakiyo Miyazawa

Generative models such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have shown promise in sequential recommendation tasks. However, they face challenges, including posterior collapse and limited…

Machine Learning · Computer Science 2024-10-28 Sharare Zolghadr , Ole Winther , Paul Jeha

Mainstream solutions to Sequential Recommendation (SR) represent items with fixed vectors. These vectors have limited capability in capturing items' latent aspects and users' diverse preferences. As a new generative paradigm, Diffusion…

Information Retrieval · Computer Science 2023-10-31 Zihao Li , Aixin Sun , Chenliang Li

We use a deterministic particle method to produce numerical approximations to the solutions of an evolution cross-diffusion problem for two populations. According to the values of the diffusion parameters related to the intra and…

Numerical Analysis · Mathematics 2024-01-29 Gonzalo Galiano , Virginia Selgas

The problem of sequentially maximizing the expectation of a function seeks to maximize the expected value of a function of interest without having direct control on its features. Instead, the distribution of such features depends on a given…

Machine Learning · Statistics 2022-10-26 Diego Martinez-Taboada , Dino Sejdinovic

The remarkable performance of deep neural networks depends on the availability of massive labeled data. To alleviate the load of data annotation, active deep learning aims to select a minimal set of training points to be labelled which…

Machine Learning · Computer Science 2020-03-24 Dan Kushnir , Luca Venturi

Generative models, such as Variational Auto-Encoder (VAE) and Generative Adversarial Network (GAN), have been successfully applied in sequential recommendation. These methods require sampling from probability distributions and adopt…

Information Retrieval · Computer Science 2023-06-23 Hanwen Du , Huanhuan Yuan , Zhen Huang , Pengpeng Zhao , Xiaofang Zhou

We study the problem of a decision maker who must provide the best possible treatment recommendation based on an experiment. The desirability of the outcome distribution resulting from the policy recommendation is measured through a…

Econometrics · Economics 2022-04-06 Anders Bredahl Kock , David Preinerstorfer , Bezirgen Veliyev

The recommendation methods based on network diffusion have been shown to perform well in both recommendation accuracy and diversity. Nowdays, numerous extensions have been made to further improve the performance of such methods. However, to…

Physics and Society · Physics 2019-08-13 Peng Zhang , Leyang Xue , An Zeng
‹ Prev 1 2 3 10 Next ›