English
Related papers

Related papers: A Markov Reward Process-Based Approach to Spatial …

200 papers

Large language models (LLMs) have shown promise in performing complex multi-step reasoning, yet they continue to struggle with mathematical reasoning, often making systematic errors. A promising solution is reinforcement learning (RL)…

Machine Learning · Computer Science 2025-09-22 Hanning Zhang , Pengcheng Wang , Shizhe Diao , Yong Lin , Rui Pan , Hanze Dong , Dylan Zhang , Pavlo Molchanov , Tong Zhang

In interpretation of remote sensing images, it is possible that some images which are supplied by different sensors become incomprehensible. For better visual perception of these images, it is essential to operate series of pre-processing…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Mohammad Reza Khosravi , Mohammad Sharif-Yazd , Mohammad Kazem Moghimi , Ahmad Keshavarz , Habib Rostami , Suleiman Mansouri

Linear reduced-order modeling (ROM) is widely used for efficient simulation of deformation dynamics, but its accuracy is often limited by the fixed linearization of the reduced mapping. We propose a new adaptive strategy for linear ROM that…

Graphics · Computer Science 2025-10-01 Yutian Tao , Maurizio Chiaramonte , Pablo Fernandez

Interpolation methodologies have been widely used within the domain of indoor positioning systems. However, existing indoor positioning interpolation algorithms exhibit several inherent limitations, including reliance on complex…

Machine Learning · Computer Science 2023-11-28 Suorong Yang , Geng Zhang , Jian Zhao , Furao Shen

This paper portrays the method of UAV magnetometry survey data interpolation. The method accommodates the fact that this kind of data has a spatial distribution of the samples along a series of straight lines (similar to maritime tacks),…

Geophysics · Physics 2022-12-12 Igor Aleshin , Kirill Kholodkov , Ivan Malygin , Roman Shevchuk , Roman Sidorov

Recent research in multi-robot exploration and mapping has focused on sampling environmental fields, which are typically modeled using the Gaussian process (GP). Existing information-theoretic exploration strategies for learning GP-based…

Machine Learning · Computer Science 2011-02-01 Kian Hsiang Low , John M. Dolan , Pradeep Khosla

A Spartan random process (SRP) is used to estimate the correlation structure of time series and to predict (extrapolate) the data values. SRP's are motivated from statistical physics, and they can be viewed as Ginzburg-Landau models. The…

Physics and Society · Physics 2012-12-24 M. Zukovic , D. T. Hristopulos

Factorizing low-rank matrices is a problem with many applications in machine learning and statistics, ranging from sparse PCA to community detection and sub-matrix localization. For probabilistic models in the Bayes optimal setting, general…

Information Theory · Computer Science 2018-12-07 Jean Barbier , Mohamad Dia , Nicolas Macris , Florent Krzakala , Lenka Zdeborová

Invariant risk minimization (IRM) aims to enable out-of-distribution (OOD) generalization in deep learning by learning invariant representations. As IRM poses an inherently challenging bi-level optimization problem, most existing approaches…

Machine Learning · Computer Science 2025-05-26 Kotaro Yoshida , Konstantinos Slavakis

While fusing heterogeneous open-source LLMs with varying architectures and sizes can potentially integrate the strengths of different models, existing fusion methods face significant challenges, such as vocabulary alignment and merging…

Computation and Language · Computer Science 2025-02-27 Ziyi Yang , Fanqi Wan , Longguang Zhong , Tianyuan Shi , Xiaojun Quan

An algorithm for non-stationary spatial modelling using multiple secondary variables is developed. It combines Geostatistics with Quantile Random Forests to give a new interpolation and stochastic simulation algorithm. This paper introduces…

Methodology · Statistics 2022-01-13 Colin Daly

Partially observable Markov decision processes (POMDPs) provide an elegant mathematical framework for modeling complex decision and planning problems in stochastic domains in which states of the system are observable only indirectly, via a…

Artificial Intelligence · Computer Science 2011-06-02 M. Hauskrecht

The aim of this paper is to show that spatial coupling can be viewed not only as a means to build better graphical models, but also as a tool to better understand uncoupled models. The starting point is the observation that some asymptotic…

Information Theory · Computer Science 2015-08-27 Andrei Giurgiu , Nicolas Macris , Rüdiger Urbanke

The modified Rodrigues parameters (MRP) consist of two numerically different triplets that, by switching between them, yield a minimal globally non-singular attitude description with advantageous properties. The MRP space results from the…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Luís Martins , Carlos Cardeira , Paulo Oliveira

The online Markov decision process (MDP) is a generalization of the classical Markov decision process that incorporates changing reward functions. In this paper, we propose practical online MDP algorithms with policy iteration and…

Machine Learning · Computer Science 2015-10-16 Yao Ma , Hao Zhang , Masashi Sugiyama

We study methods based on reproducing kernel Hilbert spaces for estimating the value function of an infinite-horizon discounted Markov reward process (MRP). We study a regularized form of the kernel least-squares temporal difference (LSTD)…

Machine Learning · Statistics 2021-09-27 Yaqi Duan , Mengdi Wang , Martin J. Wainwright

Space-time adaptive processing (STAP) is an effective tool for detecting a moving target in spaceborne or airborne radar systems. Statistical-based STAP methods generally need sufficient statistically independent and identically distributed…

Information Theory · Computer Science 2010-08-26 Ke Sun , Hao Zhang , Gang Li , Huadong Meng , Xiqin Wang

Space-time adaptive processing (STAP) is one of the most effective approaches to suppressing ground clutters in airborne radar systems. It basically takes two forms, i.e., full-dimension STAP (FD-STAP) and reduced-dimension STAP (RD-STAP).…

Information Theory · Computer Science 2022-02-11 Di Song , Shengyao Chen , Feng Xi , Zhong Liu

The labeled MRPP (Multi-Robot Path Planning) problem involves routing robots from start to goal configurations efficiently while avoiding collisions. Despite progress in solution quality and runtime, its complexity and industrial relevance…

Robotics · Computer Science 2025-06-12 Teng Guo

We study episodic reinforcement learning (RL) in non-stationary linear kernel Markov decision processes (MDPs). In this setting, both the reward function and the transition kernel are linear with respect to the given feature maps and are…

Machine Learning · Computer Science 2024-12-24 Han Zhong , Zhongren Chen , Zhuoran Yang , Zhaoran Wang , Csaba Szepesvári
‹ Prev 1 3 4 5 6 7 10 Next ›