English
Related papers

Related papers: CAFE: Channel-Autoregressive Factorized Encoding f…

200 papers

Accurate cancer survival prediction requires integration of diverse data modalities that reflect the complex interplay between imaging, clinical parameters, and textual reports. However, existing multimodal approaches suffer from simplistic…

Machine Learning · Computer Science 2025-07-01 Aakash Tripathi , Asim Waqas , Matthew B. Schabath , Yasin Yilmaz , Ghulam Rasool

Long-context inference in decoder-only language models is costly because long prompts are processed during Prefill, cached at every layer, and repeatedly attended to during autoregressive Decode. We introduce \emph{Shallow Prefill, dEEp…

Artificial Intelligence · Computer Science 2026-05-08 Jungsuk Oh , Hyeseo Jeon , Hyunjune Ji , Kyongmin Kong , Jay-Yoon Lee

Deploying pretrained visual models in real-world environments often suffers from significant performance degradation due to the diversity of testing scenarios. Continuous adaptation of learning models on edge devices via unlabeled data…

Neural and Evolutionary Computing · Computer Science 2026-05-08 Jianming Lv , Chengjun Wang , Depin Liang , Qianli Ma , Wei Chen , Xueqi Cheng

Deep learning surrogates for CFD flow-field prediction often rely on large, complex models, which can be slow and fragile when data are noisy or incomplete. We introduce FlowForge, a staged local rollout engine that predicts future flow…

Machine Learning · Computer Science 2026-04-27 Xiaowen Zhang , Ziming Zhou , Fengnian Zhao , David L. S. Hung

Latent generative models are increasingly shifting from traditional VAEs toward representation autoencoders and semantically aligned latent spaces, which lift images into higher-dimensional feature domains where semantic factors become more…

Optimization and Control · Mathematics 2025-12-02 Xu Duan , Dongmei Chen

In recent years, convolutional neural networks (CNNs) with channel-wise feature refining mechanisms have brought noticeable benefits to modelling channel dependencies. However, current attention paradigms fail to infer an optimal channel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Nick Nikzad , Yongsheng Gao , Jun Zhou

Medical imaging is critical for diagnostics, but clinical adoption of advanced AI-driven imaging faces challenges due to patient variability, image artifacts, and limited model generalization. While deep learning has transformed image…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Abdul-mojeed Olabisi Ilyas , Adeleke Maradesa , Jamal Banzi , Jianpan Huang , Henry K. F. Mak , Kannie W. Y. Chan

Humans possess a remarkable ability to integrate auditory and visual information, enabling a deeper understanding of the surrounding environment. This early fusion of audio and visual cues, demonstrated through cognitive psychology and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shentong Mo , Pedro Morgado

A recent study has shown that diffusion models are well-suited for modeling the generative process of user-item interactions in recommender systems due to their denoising nature. However, existing diffusion model-based recommender systems…

Information Retrieval · Computer Science 2024-04-23 Yu Hou , Jin-Duk Park , Won-Yong Shin

Fast spin-echo (FSE) pulse sequences for Magnetic Resonance Imaging (MRI) offer important imaging contrast in clinically feasible scan times. T2-shuffling is widely used to resolve temporal signal dynamics in FSE acquisitions by exploiting…

Image and Video Processing · Electrical Eng. & Systems 2023-03-07 Molin Zhang , Junshen Xu , Yamin Arefeen , Elfar Adalsteinsson

While recent machine learning research has revealed connections between deep generative models such as VAEs and rate-distortion losses used in learned compression, most of this work has focused on images. In a similar spirit, we view…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Ruihan Yang , Yibo Yang , Joseph Marino , Stephan Mandt

Leveraging multimodal information from biosignals is vital for building a comprehensive representation of people's physical and mental states. However, multimodal biosignals often exhibit substantial distributional shifts between…

Machine Learning · Computer Science 2024-04-22 Ran Liu , Ellen L. Zippi , Hadi Pouransari , Chris Sandino , Jingping Nie , Hanlin Goh , Erdrin Azemi , Ali Moin

Purpose: Training auto-encoders on simulated signal evolution and inserting the decoder into the forward model improves reconstructions through more compact, Bloch-equation-based representations of signal in comparison to linear subspaces.…

Signal Processing · Electrical Eng. & Systems 2023-05-02 Yamin Arefeen , Junshen Xu , Molin Zhang , Zijing Dong , Fuyixue Wang , Jacob White , Berkin Bilgic , Elfar Adalsteinsson

Auto-regressive (AR) models, initially successful in language generation, have recently shown promise in visual generation tasks due to their superior sampling efficiency. Unlike image generation, video generation requires a substantially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xuan Shen , Weize Ma , Yufa Zhou , Enhao Tang , Yanyue Xie , Zhengang Li , Yifan Gong , Quanyi Wang , Henghui Ding , Yiwei Wang , Yanzhi Wang , Pu Zhao , Jun Lin , Jiuxiang Gu

With advancements of deep learning techniques, it is now possible to generate super-realistic images and videos, i.e., deepfakes. These deepfakes could reach mass audience and result in adverse impacts on our society. Although lots of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Mengnan Du , Shiva Pentyala , Yuening Li , Xia Hu

Modern Large Language Models (LLMs) rely on Transformer self-attention, which scales quadratically with sequence length. Recent linear-time alternatives, like State Space Models (SSMs), often suffer from signal degradation over extended…

Computation and Language · Computer Science 2026-04-07 Dejan Čugalj , Aleksandar Jevremovic

Modern generative and multimodal models increasingly rely on compact latent representations that trade and balance semantic richness with high-fidelity reconstruction. We introduce SALAD-VAE, a continuous and highly compact semantic Audio…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-10 Sebastian Braun , Hannes Gamper , Dimitra Emmanouilidou

Image-based geometric modeling and novel view synthesis based on sparse, large-baseline samplings are challenging but important tasks for emerging multimedia applications such as virtual reality and immersive telepresence. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Wenpeng Xing , Jie Chen , Zaifeng Yang , Qiang Wang

Image reconstruction and synthesis have witnessed remarkable progress thanks to the development of generative models. Nonetheless, gaps could still exist between the real and generated images, especially in the frequency domain. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Liming Jiang , Bo Dai , Wayne Wu , Chen Change Loy

Massive multiple-input multiple-output (mMIMO) downlink precoding offers high spectral efficiency but remains challenging to deploy in practice because near-optimal algorithms such as the weighted minimum mean squared error (WMMSE) are…

Machine Learning · Computer Science 2026-01-30 Ali Hasanzadeh Karkan , Ahmed Ibrahim , Jean-François Frigon , François Leduc-Primeau