English
Related papers

Related papers: Architecture-driven Shift: towards a lightweight s…

200 papers

Artificial neural networks (ANNs) require tremendous amount of data to train on. However, in classification models, most data features are often similar which can lead to increase in training time without significant improvement in the…

Machine Learning · Computer Science 2023-03-03 Sreelekha Guggilam , Varun Chandola , Abani Patra

Estimating model accuracy on unseen, unlabeled datasets is crucial for real-world machine learning applications, especially under distribution shifts that can degrade performance. Existing methods often rely on predicted class probabilities…

Machine Learning · Computer Science 2025-08-28 Chenzhi Liu , Mahsa Baktashmotlagh , Yanran Tang , Zi Huang , Ruihong Qiu

Data in the real world tends to exhibit a long-tailed label distribution, which poses great challenges for the training of neural networks in visual recognition. Existing methods tackle this problem mainly from the perspective of data…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Yan Zhao , Weicong Chen , Xu Tan , Kai Huang , Jihong Zhu

The rapid growth of data centers has made large electronic load (LEL) modeling increasingly important for power system analysis. Such loads are characterized by fast workload-driven variability and protection-driven disconnection and…

Machine Learning · Computer Science 2026-02-11 Siyu Lu , Chenhan Xiao , Yang Weng

A discriminatively trained neural net classifier can fit the training data perfectly if all information about its input other than class membership has been discarded prior to the output layer. Surprisingly, past research has discovered…

Machine Learning · Computer Science 2021-07-23 Piotr Teterwak , Chiyuan Zhang , Dilip Krishnan , Michael C. Mozer

Fine-tuning the pre-trained model with active learning holds promise for reducing annotation costs. However, this combination introduces significant computational costs, particularly with the growing scale of pre-trained models. Recent…

Machine Learning · Computer Science 2024-11-19 Ziting Wen , Oscar Pizarro , Stefan Williams

Lifelong learning (LL) aims to continuously acquire new knowledge while retaining previously learned knowledge. A central challenge in LL is the stability-plasticity dilemma, which requires models to balance the preservation of previous…

Machine Learning · Computer Science 2025-03-11 Ruiyu Wang , Sen Wang , Xinxin Zuo , Qiang Sun

The integration of large language models (LLMs) with external tools has significantly expanded the capabilities of AI agents. However, as the diversity of both LLMs and tools increases, selecting the optimal model-tool combination becomes a…

Computation and Language · Computer Science 2026-01-08 Jinyang Wu , Guocheng Zhai , Ruihan Jin , Jiahao Yuan , Yuhao Shen , Shuai Zhang , Zhengqi Wen , Jianhua Tao

Continual Learning (CL) seeks to enable neural networks to incrementally acquire new knowledge (plasticity) while retaining existing knowledge (stability). Although pre-trained models (PTMs) have provided a strong foundation for CL,…

Machine Learning · Computer Science 2026-02-12 Aojun Lu , Tao Feng , Hangjie Yuan , Chunhui Ding , Yanan Sun

Multimodal Large Language Models (MLLMs) have shown strong performance in multi-image cross-modal retrieval, yet suffer from severe position bias, where predictions are dominated by input order rather than semantic relevance. Through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Mingtao Xian , Yifeng Yang , Qinying Gu , Xinbing Wang , Nanyang Ye

In many application domains such as computer vision, Convolutional Layers (CLs) are key to the accuracy of deep learning methods. However, it is often required to assemble a large number of CLs, each containing thousands of parameters, in…

Neural and Evolutionary Computing · Computer Science 2019-05-30 Ghouthi Boukli Hacene , Carlos Lassance , Vincent Gripon , Matthieu Courbariaux , Yoshua Bengio

We present a data-driven framework that extends the predictive capability of classical lifting-line theory (LLT) to a wider aerodynamic regime by incorporating higher-fidelity aerodynamic data from panel method simulations. A neural network…

Fluid Dynamics · Physics 2026-04-01 Arjun Sharma , Jonas A. Actor , Peter A. Bosler

A growing body of work has begun to study intervention design for efficient structure learning of causal directed acyclic graphs (DAGs). A typical setting is a causally sufficient setting, i.e. a system with no latent confounders, selection…

This poster presents the conceptual framework of the Adaptive Learning Guidance System ALGS. The system aims to propose a model for adaptive learning environments where two major concerns arising from past studies are being addressed; the…

Computers and Society · Computer Science 2019-11-19 Ghada El-Hadad , Doaa Shawky , Ashraf Badawi

Adapting Large Language Models in complex technical service domains is constrained by the absence of explicit cognitive chains in human demonstrations and the inherent ambiguity arising from the diversity of valid responses. These…

In the past few years, DRL has become a valuable solution to automatically learn efficient resource management strategies in complex networks with time-varying statistics. However, the increased complexity of 5G and Beyond networks requires…

Networking and Internet Architecture · Computer Science 2023-06-07 Seyyidahmed Lahmer , Federico Mason , Federico Chiariotti , Andrea Zanella

Many automated decision systems (ADS) are designed to solve prediction problems -- where the goal is to learn patterns from a sample of the population and apply them to individuals from the same population. In reality, these prediction…

Previous adversarial training raises model robustness under the compromise of accuracy on natural data. In this paper, we reduce natural accuracy degradation. We use the model logits from one clean model to guide learning of another one…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Jiequan Cui , Shu Liu , Liwei Wang , Jiaya Jia

Deep neural networks and decision trees operate on largely separate paradigms; typically, the former performs representation learning with pre-specified architectures, while the latter is characterised by learning hierarchies over…

Neural and Evolutionary Computing · Computer Science 2019-06-11 Ryutaro Tanno , Kai Arulkumaran , Daniel C. Alexander , Antonio Criminisi , Aditya Nori

Convolutional neural networks have achieved great success in various vision tasks; however, they incur heavy resource costs. By using deeper and wider networks, network accuracy can be improved rapidly. However, in an environment with…

Computer Vision and Pattern Recognition · Computer Science 2018-11-01 Yunho Jeon , Junmo Kim