English
Related papers

Related papers: Compositional Value Iteration with Pareto Caching

200 papers

We study the capability of Video-Language (VidL) models in understanding compositions between objects, attributes, actions and their relations. Composition understanding becomes particularly challenging for video data since the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Chaofan Tao , Gukyeong Kwon , Varad Gunjal , Hao Yang , Zhaowei Cai , Yonatan Dukler , Ashwin Swaminathan , R. Manmatha , Colin Jon Taylor , Stefano Soatto

Symbolic music generation faces a fundamental trade-off between efficiency and quality. Fine-grained tokenizations achieve strong coherence but incur long sequences and high complexity, while compact tokenizations improve efficiency at the…

Machine Learning · Computer Science 2025-09-30 Ting-Kang Wang , Chih-Pin Tan , Yi-Hsuan Yang

Compared to the wide array of advanced Monte Carlo methods supported by modern probabilistic programming languages (PPLs), PPL support for variational inference (VI) is less developed: users are typically limited to a predefined selection…

Programming Languages · Computer Science 2024-06-25 McCoy R. Becker , Alexander K. Lew , Xiaoyan Wang , Matin Ghavami , Mathieu Huot , Martin C. Rinard , Vikash K. Mansinghka

We establish an assume-guarantee (AG) framework for compositional reasoning about multi-objective queries in parametric probabilistic automata (pPA) - an extension to probabilistic automata (PA), where transition probabilities are functions…

Logic in Computer Science · Computer Science 2025-06-11 Hannah Mertens , Tim Quatmann , Joost-Pieter Katoen

Multilevel compositional data are data that are repeatedly measured or clustered within groups and are non-negative and sum to a constant value. These data arise in various settings, such as intensive, longitudinal studies using ecological…

Methodology · Statistics 2025-02-21 Flora Le , Tyman E. Stanford , Dorothea Dumuid , Joshua F. Wiley

This paper addresses the challenge of a particular class of noisy state observations in Markov Decision Processes (MDPs), a common issue in various real-world applications. We focus on modeling this uncertainty through a confusion matrix…

Machine Learning · Computer Science 2023-12-15 Amirhossein Afsharrad , Sanjay Lall

Concurrent separation logic with fractional permissions (CSLPerm) provides a promising reasoning system to verify most complex sequential and concurrent fine-grained programs. The logic with strong and weak separating conjunctions offers a…

Logic in Computer Science · Computer Science 2025-10-07 Quang Loc Le

Model-based testing (MBT) promises a scalable solution to testing large systems, if a model is available. Creating these models for large systems, however, has proven to be difficult. Composing larger models from smaller ones could solve…

Software Engineering · Computer Science 2023-11-16 Gijs van Cuyck , Lars van Arragon , Jan Tretmans

While there is an extensive body of research on the analysis of Value Iteration (VI) for discounted cumulative-reward MDPs, prior work on analyzing VI for (undiscounted) average-reward MDPs has been limited, and most prior results focus on…

Optimization and Control · Mathematics 2026-02-10 Jongmin Lee , Ernest K. Ryu

This paper presents a novel method for extracting the vocal track from a musical mixture. The musical mixture consists of a singing voice and a backing track which may comprise of various instruments. We use a convolutional network with…

Sound · Computer Science 2020-02-13 Pritish Chandna , Merlijn Blaauw , Jordi Bonada , Emilia Gomez

Compositional AI systems, which combine multiple artificial intelligence components together with other application components to solve a larger problem, have no known pattern of development and are often approached in a bespoke and ad hoc…

We propose Composition Sampling, a simple but effective method to generate diverse outputs for conditional generation of higher quality compared to previous stochastic decoding strategies. It builds on recently proposed plan-based neural…

Computation and Language · Computer Science 2022-03-30 Shashi Narayan , Gonçalo Simões , Yao Zhao , Joshua Maynez , Dipanjan Das , Michael Collins , Mirella Lapata

In this work, we propose a compositional scheme for the safety controller synthesis of interconnected discrete-time stochastic systems with Markovian switching signals. Our proposed approach is based on a notion of so-called control storage…

Systems and Control · Electrical Eng. & Systems 2022-08-09 Abolfazl Lavaei , Emilio Frazzoli

In this paper, we provide a modern synthesis of the classic inverse compositional algorithm for dense image alignment. We first discuss the assumptions made by this well-established technique, and subsequently propose to relax these…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Zhaoyang Lv , Frank Dellaert , James M. Rehg , Andreas Geiger

Value iteration is a well-known method of solving Markov Decision Processes (MDPs) that is simple to implement and boasts strong theoretical convergence guarantees. However, the computational cost of value iteration quickly becomes…

Machine Learning · Computer Science 2021-07-26 Guanting Chen , Johann Demetrio Gaebler , Matt Peng , Chunlin Sun , Yinyu Ye

Markov decision processes (MDP) are useful to model optimisation problems in concurrent systems. To verify MDPs with efficient Monte Carlo techniques requires that their nondeterminism be resolved by a scheduler. Recent work has introduced…

Data Structures and Algorithms · Computer Science 2016-11-15 Pedro D'Argenio , Axel Legay , Sean Sedwards , Louis-Marie Traonouez

An algorithm of improving the performance of iterative decoding on perpendicular magnetic recording is presented. This algorithm follows on the authors' previous works on the parallel and serial concatenated turbo codes and low-density…

Information Theory · Computer Science 2007-07-13 E. Papagiannis , C. Tjhai , M. Ahmed , M. Ambroze , M. Tomlinson

Biabduction-based shape analysis is a compositional verification and analysis technique that can prove memory safety in the presence of complex, linked data structures. Despite its usefulness, several open problems persist for this kind of…

Logic in Computer Science · Computer Science 2025-02-17 Florian Sextl , Adam Rogalewicz , Tomáš Vojnar , Florian Zuleger

Continuously learning new classes without catastrophic forgetting is a challenging problem for on-device environmental sound classification given the restrictions on computation resources (e.g., model size, running memory). To address this…

Sound · Computer Science 2022-07-19 Yang Xiao , Xubo Liu , James King , Arshdeep Singh , Eng Siong Chng , Mark D. Plumbley , Wenwu Wang

When the meaning of a phrase cannot be inferred from the individual meanings of its words (e.g., hot dog), that phrase is said to be non-compositional. Automatic compositionality detection in multi-word phrases is critical in any…

Computation and Language · Computer Science 2019-03-21 Dongsheng Wang , Quichi Li , Lucas Chaves Lima , Jakob grue Simonsen , Christina Lioma