Related papers: A Possible Role for Entropy in Creative Cognition
In this paper, we study the technical problem of developing conversational agents that can quickly adapt to unseen tasks, learn task-specific communication tactics, and help listeners finish complex, temporally extended tasks. We find that…
Continual learning aims to acquire new tasks while preserving performance on previously learned ones, but most methods struggle with catastrophic forgetting. Existing approaches typically treat all layers uniformly, often trading stability…
Which factors influence the human assessment of creativity exhibited by a computational system is a core question of computational creativity (CC) research. Recently, the system's embodiment has been put forward as such a factor, but…
Entropy-based confidence signals are increasingly leveraged to improve reasoning in large language models (LLMs), yet existing approaches treat confidence as a static quantity -- typically aggregated over tokens. We show that the…
Selection theory requires multiple, distinct, simultaneously-actualized states. In cognition, each thought or cognitive state changes the 'selection pressure' against which the next is evaluated; they are not simultaneously selected…
Creative processes are widely believed to involve the generation of multiple, discrete, well-defined possibilities followed by exploration and selection. An alternative, inspired by parallel distributed processing models of associative…
Entropy production is a universal measure of irreversibility and energy dissipation in physical, chemical, and biological systems operating far from equilibrium. However, quantifying and spatiotemporally localising it in complex processes…
Student learning in upper division thermal physics has not been studied to the same extent as in other courses like electromagnetism and quantum mechanics. Studies addressing reasoning and learning at the graduate level are even more…
People employ their knowledge to recognize things. This paper is concerned with how to measure people's knowledge for recognition and how it changes. The discussion is based on three assumptions. Firstly, we construct two evolution process…
Recent developments enable the quantification of causal control given a structural causal model (SCM). This has been accomplished by introducing quantities which encode changes in the entropy of one variable when intervening on another.…
Artificial intelligence (AI) systems capable of generating creative outputs are reshaping our understanding of creativity. This shift presents an opportunity for creativity researchers to reevaluate the key components of the creative…
Living systems break detailed balance at small scales, consuming energy and producing entropy in the environment in order to perform molecular and cellular functions. However, it remains unclear how broken detailed balance manifests at…
This paper aims to overcome a major obstacle in scaling RL for reasoning with LLMs, namely the collapse of policy entropy. Such phenomenon is consistently observed across vast RL runs without entropy intervention, where the policy entropy…
In these notes we review emergent phenomena in complex systems, emphasizing ways to identify potential underlying universal mechanisms that generates complexity. The discussion is centered around the emergence of collective behavior in…
Emergent patterns in complex systems are related to many intriguing phenomena in modern science and philosophy. Several conceptions such as weak, strong and robust emergence have been proposed to emphasize different epistemological and…
Creativity, a process that generates novel and meaningful ideas, involves increased association between task-positive (control) and task-negative (default) networks in the human brain. Inspired by this seminal finding, in this study we…
Researchers have argued against deficit-based explanations of students' troubles with mathematical sense-making, pointing instead to factors such as epistemology: students' beliefs about the nature of knowledge and learning can hinder them…
Decoding strategies play a central role in shaping the reasoning ability of large language models (LLMs). Traditional methods such as greedy decoding and beam search often suffer from error propagation, while sampling-based approaches…
Entropy production plays a fundamental role in the study of non-equilibrium systems by offering a quantitative handle on the degree of time-reversal symmetry breaking. It depends crucially on the degree of freedom considered as well as on…
A stream of conscious experience is extremely contextual; it is impacted by sensory stimuli, drives and emotions, and the web of associations that link, directly or indirectly, the subject of experience to other elements of the individual's…