English
Related papers

Related papers: Parser-Oriented Structural Refinement for a Stable…

200 papers

Ultrasound imaging faces a trade-off between image quality and hardware complexity caused by dense transducers. Sparse arrays are one popular solution to mitigate this challenge. This work proposes an end-to-end optimization framework that…

Image and Video Processing · Electrical Eng. & Systems 2026-04-01 Sergio Urrea , Adrian Basarab , Hervé Liebgott , Henry Arguello

We develop a divergence-minimization (DM) framework for robust and efficient inference in latent-mixture models. By optimizing a residual-adjusted divergence, the DM approach recovers EM as a special case and yields robust alternatives…

Statistics Theory · Mathematics 2025-11-25 Lei Li , Anand N. Vidyashankar

Constraints are essential for stabilizing reinforcement learning fine-tuning (RFT) and preventing degenerate outputs, yet they inherently conflict with the optimization objective because stronger constraints limit the ability of a…

Machine Learning · Computer Science 2026-03-20 Hao Ma , Zhiqiang Pu , Yang Liu , Xiaolin Ai

Retrieval-augmented generation over semi-structured sources such as HTML is constrained by a mismatch between document structure and the flat, sequence-based interfaces of today's embedding and generative models. Retrieval pipelines often…

Information Retrieval · Computer Science 2026-04-24 Mike Rainey , Umut Acar , Muhammed Sezer

Sparse representations using learned dictionaries are being increasingly used with success in several data processing and machine learning applications. The availability of abundant training data necessitates the development of efficient,…

Computer Vision and Pattern Recognition · Computer Science 2013-09-26 Jayaraman J. Thiagarajan , Karthikeyan Natesan Ramamurthy , Andreas Spanias

Recently, Transformer-based text detection techniques have sought to predict polygons by encoding the coordinates of individual boundary vertices using distinct query features. However, this approach incurs a significant memory overhead and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Xuyang Chen , Dong Wang , Konrad Schindler , Mingwei Sun , Yongliang Wang , Nicolo Savioli , Liqiu Meng

Residual connections are pivotal for deep neural networks, enabling greater depth by mitigating vanishing gradients. However, in standard residual updates, the module's output is directly added to the input stream. This can lead to updates…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Giyeong Oh , Woohyun Cho , Siyeol Kim , Suhwan Choi , Youngjae Yu

We present an extension of sparse PCA, or sparse dictionary learning, where the sparsity patterns of all dictionary elements are structured and constrained to belong to a prespecified set of shapes. This \emph{structured sparse PCA} is…

Machine Learning · Statistics 2009-09-09 Rodolphe Jenatton , Guillaume Obozinski , Francis Bach

Routing has emerged as a promising strategy for balancing performance and cost in large language model (LLM) systems that combine lightweight models with powerful but expensive large models. Recent studies show that \emph{probe routing},…

Artificial Intelligence · Computer Science 2026-03-27 Yaopei Zeng , Congchao Wang , Blake JianHang Chen , Lu Lin

Looped Language Models (LoopLMs) enable efficient latent reasoning through depth recurrence, yet exhibit unreliable test-time scaling behavior: performance often peaks at a certain iteration depth and then collapses with further recurrence.…

Machine Learning · Computer Science 2026-05-27 Xiao-Wen Yang , Ziyu Han , Xi-Hua Zhang , Wen-Da Wei , Jie-Jing Shao , Lan-Zhe Guo , Yu-Feng Li

We consider the problem of creating document representations in which inter-document similarity measurements correspond to semantic similarity. We first present a novel subspace-based framework for formalizing this task. Using this…

Computation and Language · Computer Science 2007-05-23 Rie Kubota Ando , Lillian Lee

Diffusion language models offer a promising alternative to autoregressive models due to their global, non-causal generation process, but their continuous latent dynamics make discrete constraints -- e.g., the output should be a JSON file…

Machine Learning · Computer Science 2026-05-28 Jinwoo Kim , Taylor Berg-Kirkpatrick , Loris D'Antoni

This work studies the recursive robust principal components' analysis(PCA) problem. Here, "robust" refers to robustness to both independent and correlated sparse outliers. If the outlier is the signal-of-interest, this problem can be…

Information Theory · Computer Science 2014-08-20 Chenlu Qiu , Namrata Vaswani , Brian Lois , Leslie Hogben

Linear latent variable models such as principal component analysis (PCA), independent component analysis (ICA), canonical correlation analysis (CCA), and factor analysis (FA) identify latent directions (or loadings) either ordered or…

Machine Learning · Statistics 2023-07-13 Jesse Stevens , Daniel N. Wilke , Itumeleng Setshedi

Transformer-based table retrieval systems flatten structured tables into token sequences, making retrieval sensitive to the choice of serialization even when table semantics remain unchanged. We show that semantically equivalent…

Computation and Language · Computer Science 2026-04-29 Kushal Raj Bhandari , Adarsh Singh , Jianxi Gao , Soham Dan , Vivek Gupta

Token-level sparse attention mechanisms, exemplified by DeepSeek Sparse Attention (DSA), achieve fine-grained key selection by scoring every historical key for each query through a lightweight indexer, then computing attention only on the…

Large language models (LLMs) have advanced general-purpose reasoning, showing strong performance across diverse tasks. However, existing methods often rely on implicit exploration, where the model follows stochastic and unguided reasoning…

Artificial Intelligence · Computer Science 2025-09-09 Jiaxiang Chen , Zhuo Wang , Mingxi Zou , Zhucong Li , Zhijian Zhou , Song Wang , Zenglin Xu

This paper describes a compact and effective model for low-latency passage retrieval in conversational search based on learned dense representations. Prior to our work, the state-of-the-art approach uses a multi-stage pipeline comprising…

Information Retrieval · Computer Science 2021-11-30 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin

Accurate autoregressive prediction of 3D turbulent flows remains challenging for neural PDE solvers, as small errors in fine-scale structures can accumulate rapidly over rollout. In this paper, we propose FlowRefiner, a flow matching-based…

Fluid Dynamics · Physics 2026-04-28 Yilong Dai , Yiming Sun , Yiheng Chen , Shengyu Chen , Xiaowei Jia , Runlong Yu

Evolving data streams induce joint nonstationarity in continual semantic segmentation, where semantic classes, input distributions, and supervision availability change simultaneously over time. This setting reflects practical structured…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Prashant Pandey , Himanshu Kumar , Devineni Sri Venkatraya Chowdary , Brejesh Lall