English
Related papers

Related papers: AG-REPA: Causal Layer Selection for Representation…

200 papers

While error backpropagation (BP) has dominated the training of nearly all modern neural networks for a long time, it suffers from several biological plausibility issues such as the symmetric weight requirement and synchronous updates.…

Neurons and Cognition · Quantitative Biology 2023-04-05 Huzi Cheng , Joshua W. Brown

Large language models have been widely adopted in natural language processing, yet they face the challenge of generating unreliable content. Recent works aim to reduce misinformation and hallucinations by resorting to attribution as a means…

Computation and Language · Computer Science 2024-03-28 Dongfang Li , Zetian Sun , Baotian Hu , Zhenyu Liu , Xinshuo Hu , Xuebo Liu , Min Zhang

Current Vision-Language-Action (VLA) models typically treat the deepest representation of a vision-language backbone as universally optimal for action prediction. However, robotic manipulation is composed of many frequent closed-loop…

Artificial Intelligence · Computer Science 2026-05-12 Boyang Shen , Kaixiang Yang , Hao Wang , Qiuyu Yu , Qiang Xie , Qiang Li , Zhiwei Wang

The learning of interpretable representations from raw data presents significant challenges for time series data like speech. In this work, we propose a relevance weighting scheme that allows the interpretation of the speech representations…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Purvi Agrawal , Sriram Ganapathy

Accurately interpreting cardiac auscultation signals plays a crucial role in diagnosing and managing cardiovascular diseases. However, the paucity of labelled data inhibits classification models' training. Researchers have turned to…

Sound · Computer Science 2025-06-18 Leigh Abbott , Milan Marocchi , Matthew Fynn , Yue Rong , Sven Nordholm

Retrieval-Augmented Generation (RAG) has emerged as a reliable external knowledge augmentation technique to mitigate hallucination issues and parameterized knowledge limitations in Large Language Models (LLMs). Existing adaptive RAG (ARAG)…

Computation and Language · Computer Science 2025-04-08 Qingfei Zhao , Ruobing Wang , Yukuo Cen , Daren Zha , Shicheng Tan , Jie Tang

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding responses in external knowledge during inference. However, conventiona RAG systems under-perform on structured tabular data, largely due to coarse…

Computation and Language · Computer Science 2026-05-05 Zebin Guo , Weidong Geng , Ruichen Mao

Current generative models are able to generate high-quality artefacts but have been shown to struggle with compositional reasoning, which can be defined as the ability to generate complex structures from simpler elements. In this paper, we…

Machine Learning · Computer Science 2024-08-20 Giovanni Bindi , Philippe Esling

Complex image restoration aims to recover high-quality images from inputs affected by multiple degradations such as blur, noise, rain, and compression artifacts. Recent restoration agents, powered by vision-language models and large…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jianglin Lu , Yuanwei Wu , Ziyi Zhao , Hongcheng Wang , Felix Jimenez , Abrar Majeedi , Yun Fu

Multimodal Retrieval-Augmented Generation (RAG) systems have become essential in knowledge-intensive and open-domain tasks. As retrieval complexity increases, ensuring the robustness of these systems is critical. However, current RAG models…

Computation and Language · Computer Science 2025-06-16 Jiayu Yao , Shenghua Liu , Yiwei Wang , Lingrui Mei , Baolong Bi , Yuyao Ge , Zhecheng Li , Xueqi Cheng

Retrieval-augmented generation (RAG) is widely utilized to incorporate external knowledge into large language models, thereby enhancing factuality and reducing hallucinations in question-answering (QA) tasks. A standard RAG pipeline…

Computation and Language · Computer Science 2025-10-08 Yiqun Chen , Lingyong Yan , Weiwei Sun , Xinyu Ma , Yi Zhang , Shuaiqiang Wang , Dawei Yin , Yiming Yang , Jiaxin Mao

Providing timely, consistent, and high-quality feedback in large-scale higher education courses remains a persistent challenge, often constrained by instructor workload and resource limitations. This study presents an LLM-powered, agentic…

Computers and Society · Computer Science 2026-01-13 Reza Vatankhah Barenji , Nazila Salimi , Sina Khoshgoftar

Retrieval-Augmented Generation (RAG) is widely employed to mitigate risks such as hallucinations and knowledge obsolescence in medical question answering, yet its predominantly single-round, static retrieval paradigm misaligns with the…

Computation and Language · Computer Science 2026-05-19 Yongfeng Huang , Ruiying Chen , James Cheng

We present ReCAT, a recursive composition augmented Transformer that is able to explicitly model hierarchical syntactic structures of raw texts without relying on gold trees during both learning and inference. Existing research along this…

Computation and Language · Computer Science 2024-03-13 Xiang Hu , Qingyang Zhu , Kewei Tu , Wei Wu

Incorporating specific knowledge into large language models via retrieval-augmented generation (RAG) is a widespread technique that fuels many of today's industry AI applications. A fundamental problem is to assess if the context retrieved…

Information Retrieval · Computer Science 2026-05-08 Florian Geissler , Francesco Carella , Laura Fieback , Jakob Spiegelberg

Retrieval-augmented generation (RAG) has been extensively employed to mitigate hallucinations in large language models (LLMs). However, existing methods for multi-hop reasoning tasks often lack global planning, increasing the risk of…

Computation and Language · Computer Science 2025-11-14 Yijie Zhu , Haojie Zhou , Wanting Hong , Tailin Liu , Ning Wang

Retrieval-augmented generation (RAG) remains brittle on multi-hop questions in realistic deployment settings, where retrieved evidence may be noisy or redundant and only limited context can be passed to the generator. Existing controllers…

Computation and Language · Computer Science 2026-05-08 Yilin Guo , Yinshan Wang , Yixuan Wang

Feedback Alignment (FA) methods are biologically inspired local learning rules for training neural networks with reduced communication between layers. While FA has potential applications in distributed and privacy-aware ML, limitations in…

Machine Learning · Computer Science 2024-06-05 Zachary Robertson , Oluwasanmi Koyejo

Severe class imbalance is common in real-world tabular learning, where rare but important minority classes are essential for reliable prediction. Existing generative oversampling methods such as GANs, VAEs, and diffusion models can improve…

Machine Learning · Computer Science 2025-11-21 Md. Tawfique Ihsan , Md. Rakibul Hasan Rafi , Ahmed Shoyeb Raihan , Imtiaz Ahmed , Abdullahil Azeem

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for Large Language Models (LLMs) to address knowledge-intensive queries requiring domain-specific or up-to-date information. To handle complex multi-hop questions that…

Computation and Language · Computer Science 2026-01-05 Yuxin Wang , Shicheng Fang , Bo Wang , Qi Luo , Xuanjing Huang , Yining Zheng , Xipeng Qiu