English
Related papers

Related papers: Gradient-based Training of Slow Feature Analysis b…

200 papers

We propose SlowFast-LLaVA (or SF-LLaVA for short), a training-free video large language model (LLM) that can jointly capture detailed spatial semantics and long-range temporal context without exceeding the token budget of commonly used…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mingze Xu , Mingfei Gao , Zhe Gan , Hong-You Chen , Zhengfeng Lai , Haiming Gang , Kai Kang , Afshin Dehghan

Face anti-spoofing aims to discriminate the spoofing face images (e.g., printed photos) from live ones. However, adversarial examples greatly challenge its credibility, where adding some perturbation noise can easily change the predictions.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Songlin Yang , Wei Wang , Chenye Xu , Ziwen He , Bo Peng , Jing Dong

Classic feature selection techniques remove those features that are either irrelevant or redundant, achieving a subset of relevant features that help to provide a better knowledge extraction. This allows the creation of compact models that…

Machine Learning · Computer Science 2020-12-16 Brais Cancela , Verónica Bolón-Canedo , Amparo Alonso-Betanzos , João Gama

In this paper, we propose a fast deep learning method for object saliency detection using convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify the input images based on the pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2016-02-02 Hengyue Pan , Hui Jiang

Abstraction is an important aspect of intelligence which enables agents to construct robust representations for effective decision making. In the last decade, deep networks are proven to be effective due to their ability to form…

Robotics · Computer Science 2022-09-28 Alper Ahmetoglu , Emre Ugur , Minoru Asada , Erhan Oztop

Supervised Semantic Differential (SSD) is a mixed quantitative-interpretive method that models how text meaning varies with continuous individual-difference variables by estimating a semantic gradient in an embedding space and interpreting…

Computation and Language · Computer Science 2026-03-16 Hubert Plisiecki , Maria Leniarska , Jan Piotrowski , Marcin Zajenkowski

Sparse Autoencoders (SAEs) are a promising approach for extracting neural network representations by learning a sparse and overcomplete decomposition of the network's internal activations. However, SAEs are traditionally trained considering…

Machine Learning · Computer Science 2025-04-02 Jeffrey Olmo , Jared Wilson , Max Forsey , Bryce Hepner , Thomas Vin Howe , David Wingate

A high-dimensional and incomplete (HDI) matrix can describe the complex interactions among numerous nodes in various big data-related applications. A stochastic gradient descent (SGD)-based latent factor analysis (LFA) model is remarkably…

Systems and Control · Electrical Eng. & Systems 2023-03-08 Li Jinli , Yuan Ye

Deep neural networks often rely on spurious features to make predictions, which makes them brittle under distribution shift and on samples where the spurious correlation does not hold (e.g., minority-group examples). Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Aryan Yazdan Parast , Khawar Islam , Soyoun Won , Basim Azam , Naveed Akhtar

It has been intensively investigated that the local shape, especially flatness, of the loss landscape near a minimum plays an important role for generalization of deep models. We developed a training algorithm called PoF: Post-Training of…

Machine Learning · Computer Science 2022-07-06 Ikuro Sato , Ryota Yamada , Masayuki Tanaka , Nakamasa Inoue , Rei Kawakami

In sparse coding, we attempt to extract features of input vectors, assuming that the data is inherently structured as a sparse superposition of basic building blocks. Similarly, neural networks perform a given task by learning features of…

Machine Learning · Computer Science 2022-02-16 Deborah Pereg , Israel Cohen , Anthony A. Vassiliou

How do computers and intelligent agents view the world around them? Feature extraction and representation constitutes one the basic building blocks towards answering this question. Traditionally, this has been done with carefully engineered…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Jaime Spencer , Richard Bowden , Simon Hadfield

Experimental data is often affected by uncontrolled variables that make analysis and interpretation difficult. For spatiotemporal systems, this problem is further exacerbated by their intricate dynamics. Modern machine learning methods are…

Computational Physics · Physics 2020-09-16 Peter Y. Lu , Samuel Kim , Marin Soljačić

The most effective dimensionality reduction procedures produce interpretable features from the raw input space while also providing good performance for downstream supervised learning tasks. For many methods, this requires optimizing one or…

Machine Learning · Computer Science 2023-02-22 Leland Barnard , Farwa Ali , Hugo Botha , David T. Jones

Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating…

More powerful feature representations derived from deep neural networks benefit visual tracking algorithms widely. However, the lack of exploitation on temporal information prevents tracking algorithms from adapting to appearances changing…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Tao Hu , Lichao Huang , Xianming Liu , Han Shen

Zero-Shot Learning (ZSL) is achieved via aligning the semantic relationships between the global image feature vector and the corresponding class semantic descriptions. However, using the global features to represent fine-grained images may…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Yunlong Yu , Zhong Ji , Yanwei Fu , Jichang Guo , Yanwei Pang , Zhongfei Zhang

In this article we propose feature graph architectures (FGA), which are deep learning systems employing a structured initialisation and training method based on a feature graph which facilitates improved generalisation performance compared…

Machine Learning · Computer Science 2013-12-17 Richard Davis , Sanjay Chawla , Philip Leong

In real-world scenarios, different features have different acquisition costs at test-time which necessitates cost-aware methods to optimize the cost and performance trade-off. This paper introduces a novel and scalable approach for…

Machine Learning · Computer Science 2018-12-10 Mohammad Kachuee , Sajad Darabi , Babak Moatamed , Majid Sarrafzadeh

Despite their continued popularity, categorical approaches to affect recognition have limitations, especially in real-life situations. Dimensional models of affect offer important advantages for the recognition of subtle expressions and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Vassilios Vonikakis , Stefan Winkler