English
Related papers

Related papers: Optimal Brain Iterative Merging: Mitigating Interf…

200 papers

Lip reading has received an increasing research interest in recent years due to the rapid development of deep learning and its widespread potential applications. One key point to obtain good performance for the lip reading task depends…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xing Zhao , Shuang Yang , Shiguang Shan , Xilin Chen

Vision-and-Language Pre-training (VLP) improves model performance for downstream tasks that require image and text inputs. Current VLP approaches differ on (i) model architecture (especially image embedders), (ii) loss functions, and (iii)…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Tarik Arici , Mehmet Saygin Seyfioglu , Tal Neiman , Yi Xu , Son Train , Trishul Chilimbi , Belinda Zeng , Ismail Tutar

Omnimodal large language models (Omni-LLMs) show strong capability in audio-video understanding, but their practical deployment remains limited by high inference cost of long video streams and dense audio sequences. Despite recent progress,…

Artificial Intelligence · Computer Science 2026-05-13 Yuchen Deng , Zidang Cai , Hai-Tao Zheng , Jie Wang , Feidiao Yang , Yuxing Han

In this survey, we analyze the newest machine learning (ML) techniques for optical orthogonal frequency division multiplexing (O-OFDM)-based optical communications. ML has been proposed to mitigate channel and transceiver imperfections. For…

Machine Learning · Computer Science 2021-05-10 Hichem Mrabet , Elias Giaccoumidis , Iyad Dayoub

Large Language Model (LLM) based multi-agent systems (MAS) show remarkable potential in collaborative problem-solving, yet they still face critical challenges: low communication efficiency, poor scalability, and a lack of effective…

Computation and Language · Computer Science 2025-02-19 Weize Chen , Jiarui Yuan , Chen Qian , Cheng Yang , Zhiyuan Liu , Maosong Sun

Large Language Models (LLMs) have attracted extensive attention due to their remarkable performance across various tasks. However, the substantial computational and memory requirements of LLM inference pose challenges for deployment in…

The orthogonal time frequency space with index modulation (OTFS-IM) offers flexible tradeoffs between spectral efficiency (SE) and bit error rate (BER) in doubly selective fading channels. While OTFS-IM schemes demonstrated such potential,…

Signal Processing · Electrical Eng. & Systems 2025-01-15 Kehan Huang , Min Qiu , Jinhong Yuan

Large-batch training has become a cornerstone in accelerating the training of deep neural networks, yet it poses challenges in optimization and generalization. Existing optimizers like AdamW present performance degradation during language…

Machine Learning · Computer Science 2025-08-29 Yang Luo , Zangwei Zheng , Ziheng Qin , Zirui Zhu , Yong Liu , Yang You

Precise spatial modeling in the operating room (OR) is foundational to many clinical tasks, supporting intraoperative awareness, hazard avoidance, and surgical decision-making. While existing approaches leverage large-scale multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Peiqi He , Zhenhao Zhang , Yixiang Zhang , Xiongjun Zhao , Shaoliang Peng

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

Computation and Language · Computer Science 2025-06-12 Yuxin Jiang

Large Language Models (LLMs) demonstrate impressive capabilities in natural language processing but suffer from inaccuracies and logical inconsistencies known as hallucinations. This compromises their reliability, especially in domains…

Artificial Intelligence · Computer Science 2025-12-08 Ruslan Idelfonso Magana Vsevolodovna , Marco Monti

Large Language Models (LLMs) are frequently used for multi-faceted language generation and evaluation tasks that involve satisfying intricate user constraints or taking into account multiple aspects and criteria. However, their performance…

Computation and Language · Computer Science 2024-06-10 Swarnadeep Saha , Omer Levy , Asli Celikyilmaz , Mohit Bansal , Jason Weston , Xian Li

Multiple-input multiple-output orthogonal frequency-division multiplexing (MIMO-OFDM) is a key technology component in the evolution towards cognitive radio (CR) in next-generation communication in which the accuracy of timing and frequency…

Signal Processing · Electrical Eng. & Systems 2022-06-02 Jun Liu , Kai Mei , Xiaochen Zhang , Des McLernon , Dongtang Ma , Jibo Wei , Syed Ali Raza Zaidi

The advent of large language models (LLMs) has revolutionized natural language processing, enabling unprecedented capabilities in understanding and generating human-like text. However, the computational cost and convergence times associated…

Computation and Language · Computer Science 2024-11-26 Kerim Büyükakyüz

Multi-task learning (MTL) concurrently trains a model on diverse task datasets to exploit common features, thereby improving overall performance across the tasks. Recent studies have dedicated efforts to merging multiple independent model…

Machine Learning · Computer Science 2025-06-16 Bingjie Zhang , Hongkang Li , Changlong Shi , Guowei Rong , He Zhao , Dongsheng Wang , Dandan Guo , Meng Wang

The increasing adoption of large language models (LLMs) on heterogeneous computing platforms poses significant challenges to achieving high inference efficiency. To address these efficiency bottlenecks across diverse platforms, this paper…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-06 Yaozheng Zhang , Wei Wang , Jie Kong , Jiehan Zhou , Xianwei Zhang , Huanqing Cui , Han Bao , Yuhai Liu

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

Computation and Language · Computer Science 2025-11-20 Moses Kiprono

The paradigm of large language model (LLM) reasoning is shifting from parameter scaling to test-time compute scaling, yet many existing approaches still rely on uniform brute-force sampling (for example, fixed best-of-N or self-consistency)…

Artificial Intelligence · Computer Science 2026-03-02 Siyuan Ma , Bo Gao , Xiaojun Jia , Simeng Qin , Tianlin Li , Ke Ma , Xiaoshuang Jia , Wenqi Ren , Yang Liu

Sequential recommendation (SR) leverages users' dynamic preferences, with recent advances incorporating multi-interest learning to model diverse user interests. However, most multi-interest SR models rely on noisy, sparse implicit feedback,…

Information Retrieval · Computer Science 2025-05-08 Shutong Qiao , Chen Gao , Wei Yuan , Yong Li , Hongzhi Yin

Optimization problems are pervasive in sectors from manufacturing and distribution to healthcare. However, most such problems are still solved heuristically by hand rather than optimally by state-of-the-art solvers because the expertise…

Artificial Intelligence · Computer Science 2024-02-16 Ali AhmadiTeshnizi , Wenzhi Gao , Madeleine Udell