English
Related papers

Related papers: Redox: Improving I/O Efficiency of Model Training …

200 papers

An online backup system should be quick and reliable in both saving and restoring users' data. To do so in a peer-to-peer implementation, data transfer scheduling and the amount of redundancy must be chosen wisely. We formalize the problem…

Networking and Internet Architecture · Computer Science 2010-09-17 Laszlo Toka , Matteo Dell'Amico , Pietro Michiardi

Training autonomous agents with sparse rewards is a long-standing problem in online reinforcement learning (RL), due to low data efficiency. Prior work overcomes this challenge by extracting useful knowledge from offline data, often…

Machine Learning · Computer Science 2024-06-07 Qianlan Yang , Yu-Xiong Wang

We present Readout Guidance, a method for controlling text-to-image diffusion models with learned signals. Readout Guidance uses readout heads, lightweight networks trained to extract signals from the features of a pre-trained, frozen…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Grace Luo , Trevor Darrell , Oliver Wang , Dan B Goldman , Aleksander Holynski

The applications being developed within the U.S. Exascale Computing Project (ECP) to run on imminent Exascale computers will generate scientific results with unprecedented fidelity and record turn-around time. Many of these codes are based…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-04 Lipeng Wan , Axel Huebl , Junmin Gu , Franz Poeschel , Ana Gainaru , Ruonan Wang , Jieyang Chen , Xin Liang , Dmitry Ganyushin , Todd Munson , Ian Foster , Jean-Luc Vay , Norbert Podhorszki , Kesheng Wu , Scott Klasky

Deep Learning has revolutionized machine learning and artificial intelligence, achieving superhuman performance in several standard benchmarks. It is well-known that deep learning models are inefficient to train; they learn by processing…

Machine Learning · Computer Science 2021-12-03 Fartash Faghri

Robust fine-tuning aims to achieve competitive in-distribution (ID) performance while maintaining the out-of-distribution (OOD) robustness of a pre-trained model when transferring it to a downstream task. Recently, projected gradient…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Junjiao Tian , Yen-Cheng Liu , James Seale Smith , Zsolt Kira

Many existing transfer learning methods rely on leveraging information from source data that closely resembles the target data. However, this approach often overlooks valuable knowledge that may be present in different yet potentially…

Machine Learning · Computer Science 2023-09-14 Xin Xiong , Zijian Guo , Tianxi Cai

Data intensive applications often involve the analysis of large datasets that require large amounts of compute and storage resources. While dedicated compute and/or storage farms offer good task/data throughput, they suffer low resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-08-27 Ioan Raicu , Yong Zhao , Ian Foster , Alex Szalay

The exponential growth of data storage demands has necessitated the evolution of hierarchical storage management strategies [1]. This study explores the application of streaming machine learning [3] to revolutionize data prefetching within…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Chiyu Cheng , Chang Zhou , Yang Zhao , Jin Cao

We study the problem of online model selection in reinforcement learning, where the selector has access to a class of reinforcement learning agents and learns to adaptively select the agent with the right configuration. Our goal is to…

Machine Learning · Computer Science 2025-12-03 Aida Afshar , Aldo Pacchiano

Diffusion models have risen as a promising approach to data-driven planning, and have demonstrated impressive robotic control, reinforcement learning, and video planning performance. Given an effective planner, an important question to…

Robotics · Computer Science 2023-10-17 Siyuan Zhou , Yilun Du , Shun Zhang , Mengdi Xu , Yikang Shen , Wei Xiao , Dit-Yan Yeung , Chuang Gan

Reuse has been proposed as a microarchitecture-level mechanism to reduce the amount of executed instructions, collapsing dependencies and freeing resources for other instructions. Previous works have used reuse domains such as memory…

Hardware Architecture · Computer Science 2017-11-20 Andrey M. Coppieters , Sheila de Oliveira , Felipe M. G. França , Maurício L. Pilla , Amarildo T. da Costa

Federated Learning (FL) allows collaborative training among multiple devices without data sharing, thus enabling privacy-sensitive applications on mobile or Internet of Things (IoT) devices, such as mobile health and asset tracking.…

Machine Learning · Computer Science 2025-06-10 Phung Lai , Xiaopeng Jiang , Hai Phan , Cristian Borcea , Khang Tran , An Chen , Vijaya Datta Mayyuri , Ruoming Jin

Redundant storage maintains the performance of distributed systems under various forms of uncertainty. This paper considers the uncertainty in node access and download service. We consider two access models under two download service…

Information Theory · Computer Science 2021-08-09 Pei Peng , Moslem Noori , Emina Soljanin

Deep neural networks have enabled improved image quality and fast inference times for various inverse problems, including accelerated magnetic resonance imaging (MRI) reconstruction. However, such models require a large number of…

Image and Video Processing · Electrical Eng. & Systems 2022-06-20 Arjun D Desai , Beliz Gunel , Batu M Ozturkler , Harris Beg , Shreyas Vasanawala , Brian A Hargreaves , Christopher Ré , John M Pauly , Akshay S Chaudhari

Data is fundamental to the training of language models (LM). Recent research has been dedicated to data efficiency, which aims to maximize performance by selecting a minimal or optimal subset of training data. Techniques such as data…

Computation and Language · Computer Science 2025-06-30 Yalun Dai , Yangyu Huang , Xin Zhang , Wenshan Wu , Chong Li , Wenhui Lu , Shijie Cao , Li Dong , Scarlett Li

Robust topology optimization (RTO), as a class of topology optimization problems, identifies a design with the best average performance while reducing the response sensitivity to input uncertainties, e.g. load uncertainty. Solving RTO is…

Machine Learning · Computer Science 2024-08-22 Rini Jasmine Gladstone , Mohammad Amin Nabian , Vahid Keshavarzzadeh , Hadi Meidani

The objective of this paper is an efficient training method for video tasks. We make three contributions: (1) We propose Turbo training, a simple and versatile training paradigm for Transformers on multiple video tasks. (2) We illustrate…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Tengda Han , Weidi Xie , Andrew Zisserman

This article aims to provide the information retrieval community with some reflections on recent advances in retrieval learning by analyzing the reproducibility of image-text retrieval models. Due to the increase of multimodal data over the…

Information Retrieval · Computer Science 2022-08-30 Jun Rao , Fei Wang , Liang Ding , Shuhan Qi , Yibing Zhan , Weifeng Liu , Dacheng Tao

With the proliferation of mobile devices, the need for an efficient model to restore any degraded image has become increasingly significant and impactful. Traditional approaches typically involve training dedicated models for each specific…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Bin Ren , Eduard Zamfir , Zongwei Wu , Yawei Li , Yidi Li , Danda Pani Paudel , Radu Timofte , Ming-Hsuan Yang , Nicu Sebe