Related papers: Charge Transport in Interband Cascade Lasers: An A…
We propose to improve in-context learning (ICL) by optimizing the continuous embeddings of a fixed few-shot prompt at test time. The key observation is that the log-probabilities a model assigns to its demonstrated…
The current integrated sensing, communication, and computing (ISCC) systems face significant challenges in both efficiency and resource utilization. To tackle these issues, we propose a novel fluid antenna (FA)-enabled ISCC system,…
Recent research has shown that Transformers with linear attention are capable of in-context learning (ICL) by implementing a linear estimator through gradient descent steps. However, the existing results on the optimization landscape apply…
During the course of the last decade, traveling wave accelerating structures for a future Linear Collider have been the object of intense R&D efforts. An important problem is the efficient computation of the long range wakefield with the…
This paper presents a fundamental performance analysis of joint location and velocity estimation in a cell-free (CF) MIMO integrated sensing and communication (ISAC) system. Unlike prior studies that primarily rely on continuous-time signal…
The link between the inversion gain of quantum cascade structures and the Bloch gain in periodic superlattices is presented. The proposed theoretical model based on the density matrix formalism is able to treat the gain mechanism of the…
Starting from a general $N$-band Hamiltonian with weak spatial and temporal variations, we derive a low energy effective theory for transport within one or several overlapping bands. To this end, we use the Wigner representation that allows…
In-Context Learning (ICL) has emerged as an important new paradigm in natural language processing and large language model (LLM) applications. However, the theoretical understanding of the ICL mechanism remains limited. This paper aims to…
The transformer architecture, which processes sequences of input tokens to produce outputs for query tokens, has revolutionized numerous areas of machine learning. A defining feature of transformers is their ability to perform previously…
The simulation of charge transport in ultra-scaled electronic devices requires the knowledge of the atomic configuration and the associated potential. Such "atomistic" device simulation is most commonly handled using a tight-binding…
In-Context Learning (ICL) has been a powerful emergent property of large language models that has attracted increasing attention in recent years. In contrast to regular gradient-based learning, ICL is highly interpretable and does not…
In-context learning (ICL) enables large language models to adapt to new tasks from demonstrations without parameter updates. Despite extensive empirical studies, a principled understanding of ICL emergence at scale remains more elusive. We…
In-context learning (ICL) approaches typically leverage prompting to condition decoder-only language model generation on reference information. Just-in-time processing of a context is inefficient due to the quadratic cost of self-attention…
Intracavity absorption spectroscopy (ICAS) is a well-established technique for detecting weak absorption signals with ultrahigh sensitivity. Here, we extend this concept to magnetometry using nitrogen-vacancy (NV) centers in diamond. We…
Large Language Models (LLMs) have recently gained the In-Context Learning (ICL) ability with the models scaling up, allowing them to quickly adapt to downstream tasks with only a few demonstration examples prepended in the input sequence.…
Coherent Ising Machines (CIMs) have emerged as a hybrid form of quantum computing devices designed to solve NP-complete problems, offering an exciting opportunity for discovering optimal solutions. Despite challenges such as susceptibility…
Large language models (LLMs) have exhibited striking in-context learning (ICL) ability to adapt to target tasks with a few input-output demonstrations. For better ICL, different methods are proposed to select representative demonstrations…
We demonstrate a sensor scheme for nanoscale target displacement that relies on a single Quantum Cascade Laser (QCL) subject to optical feedback. The system combines the inherent sensitivity of QCLs to optical re-injection and their…
This paper proposes an original method for estimating the velocity of a target by leveraging the multiband capabilities of modern Integrated Sensing And Communication (ISAC) systems. Traditional Doppler estimation relies on regular sampling…
Recently it has been shown that an aggregation of Thermostatically Controlled Loads (TCLs) can be utilized to provide fast regulating reserve service for power grids and the behavior of the aggregation can be captured by a stochastic…