Related papers: Consumption processes and positively homogeneous p…
We use the martingale-theoretic approach of game-theoretic probability to incorporate imprecision into the study of randomness. In particular, we define a notion of computable randomness associated with interval, rather than precise,…
Stochastic production planning problems were studied in several works; the model with one production good was discussed in [3]. The extension to several economic goods is not a trivial issue as one can see from the recent works [4], [5] and…
Consumption Markov Decision Processes (CMDPs) are probabilistic decision-making models of resource-constrained systems. In a CMDP, the controller possesses a certain amount of a critical resource, such as electric power. Each action of the…
We prove a robust super-hedging duality result for path-dependent options on assets with jumps, in a continuous time setting. It requires that the collection of martingale measures is rich enough and that the payoff function satisfies some…
We study infinite-horizon Markov decision processes (MDPs) where the decision maker evaluates each of her strategies by aggregating the infinite stream of expected stage-rewards. The crucial feature of our approach is that the aggregation…
We establish a rigorous duality theory, under No Unbounded Profit with Bounded Risk, for an infinite horizon problem of optimal consumption in the presence of an income stream that can terminate randomly at an exponentially distributed…
This paper studies an optimal consumption problem for a loss-averse agent with reference to past consumption maximum. To account for loss aversion on relative consumption, an S-shaped utility is adopted that measures the difference between…
We consider the problem of utility maximization for small traders on incomplete financial markets. As opposed to most of the papers dealing with this subject, the investors' trading strategies we allow underly constraints described by…
Determinantal point processes (DPPs) are probabilistic models for repulsion. When used to represent the occurrence of random subsets of a finite base set, DPPs allow to model global negative associations in a mathematically elegant and…
We consider a discounted reward control problem in continuous time stochastic environment where the discount rate might be an unbounded function of the control process. We provide a set of general assumptions to ensure that there exists a…
A succesful method to describe the asymptotic behavior of a discrete time stochastic process governed by some recursive formula is to relate it to the limit sets of a well chosen mean differential equation. Under an attainability condition,…
We study an approximation method for partially observed Markov decision processes (POMDPs) with continuous spaces. Belief MDP reduction, which has been the standard approach to study POMDPs requires rigorous approximation methods for…
A well known result in stochastic analysis reads as follows: for an $\mathbb{R}$-valued super-martingale $X = (X_t)_{0\leq t \leq T}$ such that the terminal value $X_T$ is non-negative, we have that the entire process $X$ is non-negative.…
This paper presents a learning dynamic with almost sure convergence guarantee for any stochastic game with turn-based controllers (on state transitions) as long as stage-payoffs induce a zero-sum or identical-interest game. Stage-payoffs…
This paper studies an optimal consumption-investment problem for an investor whose instantaneous utility depends on both consumption and wealth, and the investor faces a general borrowing constraint that the investment amount in the risky…
We consider a model of optimal investment and consumption with both habit formation and partial observations in incomplete It\^{o} processes market. The investor chooses his consumption under the addictive habits constraint while only…
The paper introduces a novel algorithm for computing the output admissible set of linear discrete-time systems subject to input saturation. The proposed method takes advantage of the piecewise-affine dynamics to propagate the output…
In this short paper we define the wealth process in a spin model for market microstructure, for individual agents and in aggregate. The agents in our model try to balance their desire to belong to the local majority (herding behavior),…
This paper investigates risk measures derived from the expected maximum deficit in a continuous-time framework and develops optimal reserve allocation strategies across multiple lines of business. We formalize the expected maximum deficit…
We show that a trader, who starts with no initial wealth and is not allowed to borrow money or short sell assets, is theoretically able to attain positive wealth by continuous trading, provided that she has perfect foresight of future asset…