English
Related papers

Related papers: Focus Session: Hardware and Software Techniques fo…

200 papers

Feature Transformation is crucial for classic machine learning that aims to generate feature combinations to enhance the performance of downstream tasks from a data-centric perspective. Current methodologies, such as manual expert-driven…

Machine Learning · Computer Science 2025-03-27 Tianqi He , Xiaohan Huang , Yi Du , Qingqing Long , Ziyue Qiao , Min Wu , Yanjie Fu , Yuanchun Zhou , Meng Xiao

The rapid development of the Transformer-based Large Language Models (LLMs) in recent years has been closely linked to their ever-growing and already enormous sizes. Many LLMs contain hundreds of billions of parameters and require dedicated…

Computation and Language · Computer Science 2025-02-26 Mahsa Salmani , Ilya Soloveychik

The versatility of self-attention mechanism earned transformers great success in almost all data modalities, with limitations on the quadratic complexity and difficulty of training. To apply transformers across different data modalities,…

Machine Learning · Computer Science 2024-08-20 Viet Anh Nguyen , Minh Lenhat , Khoa Nguyen , Duong Duc Hieu , Dao Huu Hung , Truong Son Hy

The incorporation of high-performance optoelectronic devices into photonic neuromorphic processors can substantially accelerate computationally intensive operations in machine learning (ML) algorithms. However, the conventional device…

Emerging Technologies · Computer Science 2022-03-14 Yingheng Tang , Princess Tara Zamani , Ruiyang Chen , Jianzhu Ma , Minghao Qi , Cunxi Yu , Weilu Gao

Although multi-task learning is widely applied in intelligent services, traditional multi-task modeling methods often require customized designs based on specific task combinations, resulting in a cumbersome modeling process. Inspired by…

Machine Learning · Computer Science 2025-04-15 Jingxuan Zhou , Weidong Bao , Ji Wang , Zhengyi Zhong , Dayu Zhang

Recently, Flow Matching models have pushed the boundaries of high-fidelity data generation across a wide range of domains. It typically employs a single large network to learn the entire generative trajectory from noise to data. Despite…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Dogyun Park , Taehoon Lee , Minseok Joo , Hyunwoo J. Kim

Data driven approaches have the potential to make modeling complex, nonlinear physical phenomena significantly more computationally tractable. For example, computational modeling of fracture is a core challenge where machine learning…

Machine Learning · Computer Science 2025-10-01 Erfan Hamdi , Emma Lejeune

Transformers and vision-language models (VLMs) have emerged as dominant architectures in computer vision and multimodal AI, offering state-of-the-art performance in tasks such as image classification, object detection, visual question…

Hardware Architecture · Computer Science 2025-09-05 Safa Mohammed Sali , Mahmoud Meribout , Ashiyana Abdul Majeed

Point cloud foundation models demonstrate strong generalization, yet adapting them to downstream tasks remains challenging in low-data regimes. Full fine-tuning often leads to overfitting and significant drift from pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Sneha Paul , Zachary Patterson , Nizar Bouguila

With the emergence of large model-based agents, widely adopted transformer-based architectures inevitably produce excessively long token embeddings for transmission, which may result in high bandwidth overhead, increased power consumption…

Networking and Internet Architecture · Computer Science 2025-11-04 Junhe Zhang , Wanli Ni , Pengwei Wang , Dongyu Wang

We present a tool flow and results for a model-based hardware design for FPGAs from Simulink descriptions which nicely integrates into existing environments. While current commercial tools do not exploit some high-level optimizations, we…

Hardware Architecture · Computer Science 2015-08-28 Konrad Möller , Martin Kumm , Charles-Frederic Müller , Peter Zipf

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Instead of building…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Deploying pretrained visual models in real-world environments often suffers from significant performance degradation due to the diversity of testing scenarios. Continuous adaptation of learning models on edge devices via unlabeled data…

Neural and Evolutionary Computing · Computer Science 2026-05-08 Jianming Lv , Chengjun Wang , Depin Liang , Qianli Ma , Wei Chen , Xueqi Cheng

In this paper, we propose a methodology for partitioning and mapping computational intensive applications in reconfigurable hardware blocks of different granularity. A generic hybrid reconfigurable architecture is considered so as the…

Hardware Architecture · Computer Science 2011-11-09 M. D. Galanis , A. Milidonis , G. Theodoridis , D. Soudris , C. E. Goutis

Correlation filter (CF) based tracking algorithms have demonstrated favorable performance recently. Nevertheless, the top performance trackers always employ complicated optimization methods which constraint their real-time applications. How…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Yipeng Ma , Chun Yuan , Peng Gao , Fei Wang

We study the problem of efficient generative inference for Transformer models, in one of its most challenging settings: large deep models, with tight latency targets and long sequence lengths. Better understanding of the engineering…

Collaboratively fine-tuning (FT) large language models (LLMs) over heterogeneous mobile devices fosters immense potential applications of personalized intelligence. However, such a vision faces critical system challenges. Conventional…

Machine Learning · Computer Science 2025-08-12 Xingke Yang , Liang Li , Sicong Li , Liwei Guan , Hao Wang , Xiaoqi Qi , Jiang Liu , Xin Fu , Miao Pan

Multi-modal entity alignment (MMEA) is essential for enhancing knowledge graphs and improving information retrieval and question-answering systems. Existing methods often focus on integrating modalities through their complementarity but…

Artificial Intelligence · Computer Science 2024-10-21 Wei Ai , Wen Deng , Hongyi Chen , Jiayi Du , Tao Meng , Yuntao Shou

High complexity in precoding design for frequency division duplex systems necessitates streamlined solutions. Guided by Synesthesia of Machines (SoM), this paper introduces a heterogeneous multi-vehicle, multi-modal sensing aided precoding…

Signal Processing · Electrical Eng. & Systems 2025-03-14 Haotian Zhang , Shijian Gao , Weibo Wen , Xiang Cheng