English
Related papers

Related papers: Deep Nets with Subsampling Layers Unwittingly Disc…

200 papers

Segmentation is essential for medical image analysis tasks such as intervention planning, therapy guidance, diagnosis, treatment decisions. Deep learning is becoming increasingly prominent for segmentation, where the lack of annotations,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Firat Ozdemir , Zixuan Peng , Christine Tanner , Philipp Fuernstahl , Orcun Goksel

Deep neural networks are widely known for their remarkable effectiveness across various tasks, with the consensus that deeper networks implicitly learn more complex data representations. This paper shows that sufficiently deep networks…

Machine Learning · Computer Science 2023-10-31 Wojciech Masarczyk , Mateusz Ostaszewski , Ehsan Imani , Razvan Pascanu , Piotr Miłoś , Tomasz Trzciński

With the success of deep learning, recent efforts have been focused on analyzing how learned networks make their classifications. We are interested in analyzing the network output based on the network structure and information flow through…

Machine Learning · Computer Science 2018-02-13 Sandeep Konam , Ian Quah , Stephanie Rosenthal , Manuela Veloso

Active learning is a branch of machine learning that deals with problems where unlabeled data is abundant yet obtaining labels is expensive. The learning algorithm has the possibility of querying a limited number of samples to obtain the…

Disordered Systems and Neural Networks · Physics 2020-09-04 Hugo Cui , Luca Saglietti , Lenka Zdeborová

Deep learning models offer superior performance compared to other machine learning techniques for a variety of tasks and domains, but pose their own challenges. In particular, deep learning models require larger training times as the depth…

Machine Learning · Computer Science 2023-05-31 Sunitha Basodi , Krishna Pusuluri , Xueli Xiao , Yi Pan

We show how fitting sparse linear models over learned deep feature representations can lead to more debuggable neural networks. These networks remain highly accurate while also being more amenable to human interpretation, as we demonstrate…

Machine Learning · Computer Science 2021-05-12 Eric Wong , Shibani Santurkar , Aleksander Mądry

We present a weakly supervised deep learning method to perform instance segmentation of cells present in microscopy images. Annotation of biomedical images in the lab can be scarce, incomplete, and inaccurate. This is of concern when…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Fidel A. Guerrero-Peña , Pedro D. Marrero Fernandez , Tsang Ing Ren , Alexandre Cunha

Existing deep active learning algorithms achieve impressive sampling efficiency on natural language processing tasks. However, they exhibit several weaknesses in practice, including (a) inability to use uncertainty sampling with black-box…

Computation and Language · Computer Science 2020-07-22 Haw-Shiuan Chang , Shankar Vembu , Sunil Mohan , Rheeya Uppaal , Andrew McCallum

Training large-scale image recognition models is computationally expensive. This raises the question of whether there might be simple ways to improve the test performance of an already trained model without having to re-train or fine-tune…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 A. Emin Orhan

Deep learning models have proven to be exceptionally useful in performing many machine learning tasks. However, for each new dataset, choosing an effective size and structure of the model can be a time-consuming process of trial and error.…

Machine Learning · Computer Science 2019-08-08 Roozbeh Yousefzadeh , Dianne P O'Leary

Interpreting complex deep networks, notably pre-trained vision-language models (VLMs), is a formidable challenge. Current Class Activation Map (CAM) methods highlight regions revealing the model's decision-making basis but lack clear…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Yuguang Yang , Runtang Guo , Sheng Wu , Yimi Wang , Linlin Yang , Bo Fan , Jilong Zhong , Juan Zhang , Baochang Zhang

There is some theoretical evidence that deep neural networks with multiple hidden layers have a potential for more efficient representation of multidimensional mappings than shallow networks with a single hidden layer. The question is…

Machine Learning · Computer Science 2019-10-08 Bernhard Bermeitinger , Tomas Hrycej , Siegfried Handschuh

Metric learning networks are used to compute image embeddings, which are widely used in many applications such as image retrieval and face recognition. In this paper, we propose to use network distillation to efficiently compute image…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Lu Yu , Vacit Oguz Yazici , Xialei Liu , Joost van de Weijer , Yongmei Cheng , Arnau Ramisa

As the request for deep learning solutions increases, the need for explainability is even more fundamental. In this setting, particular attention has been given to visualization techniques, that try to attribute the right relevance to each…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Samuele Poppi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Temporal networks have been increasingly used to model a diversity of systems that evolve in time; for example human contact structures over which dynamic processes such as epidemics take place. A fundamental aspect of real-life networks is…

Physics and Society · Physics 2017-11-08 Luis E C Rocha , Naoki Masuda , Petter Holme

Redundancy in deep neural network (DNN) models has always been one of their most intriguing and important properties. DNNs have been shown to overparameterize, or extract a lot of redundant features. In this work, we explore the impact of…

Machine Learning · Computer Science 2019-01-31 Babajide O. Ayinde , Tamer Inanc , Jacek M. Zurada

Supervised training of neural networks for classification is typically performed with a global loss function. The loss function provides a gradient for the output layer, and this gradient is back-propagated to hidden layers to dictate an…

Machine Learning · Statistics 2019-05-09 Arild Nøkland , Lars Hiller Eidnes

Deep networks realize complex mappings that are often understood by their locally linear behavior at or around points of interest. For example, we use the derivative of the mapping with respect to its inputs for sensitivity analysis, or to…

Machine Learning · Computer Science 2019-07-09 Guang-He Lee , David Alvarez-Melis , Tommi S. Jaakkola

Remote sensing data is crucial for applications ranging from monitoring forest fires and deforestation to tracking urbanization. Most of these tasks require dense pixel-level annotations for the model to parse visual information from…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Shasvat Desai , Debasmita Ghose

Deep neural network architectures have recently produced excellent results in a variety of areas in artificial intelligence and visual recognition, well surpassing traditional shallow architectures trained using hand-designed features. The…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Catalin Ionescu , Orestis Vantzos , Cristian Sminchisescu