approved
Fuzzy Logic Visual Network (FLVN): A neuro-symbolic approach for visual features matching

Neuro-symbolic integration aims at harnessing the power of symbolic knowledge representation combined with the learning capabilities of deep neural networks. In particular, Logic Tensor Networks (LTNs) allow to incorporate background knowledge in the form of logical axioms by grounding a first order logic language as differentiable operations between real tensors. Yet, few studies have investigated the potential benefits of this approach to improve zero-shot learning (ZSL) classification. In this study, we present the Fuzzy Logic Visual Network (FLVN) that formulates the task of learning a visual-semantic embedding space within a neuro-symbolic LTN framework. FLVN incorporates prior knowledge in the form of class hierarchies (classes and macro-classes) along with robust high-level inductive biases. The latter allow, for instance, to handle exceptions in class-level attributes, and to enforce similarity between images of the same class, preventing premature overfitting to seen classes and improving overall performance. FLVN reaches state of the art performance on the Generalized ZSL (GZSL) benchmarks AWA2 and CUB, improving by 1.3% and 3%, respectively. Overall, it achieves competitive performance to recent ZSL methods with less computational overhead.

Tags
Data and Resources
To access the resources you must log in
  • Fuzzy Logic Visual Network (FLVN): A ...

    Neuro-symbolic integration aims at harnessing the power of symbolic...

    The resource: 'Fuzzy Logic Visual Network ...' is not accessible as guest user. You must login to access it!
Additional Info
Field Value
Accessibility Both
AccessibilityMode Download
Area NeuroSymbolic AI
Associate Project FAIR
Availability On-Site
Basic rights Download
CreationDate 2023-07-29 00:00
Creator francesco, manigrasso, francesco.manigrasso@polito.it, orcid.org/0000-0002-4151-8880
Creator lia,morra, lia.morra@polito.it,orcid.org/0000-0003-2122-7178
Creator fabrizio, lamberti, fabrizio.lamberti@polito.it,orcid.org/0000-0001-7703-1372
External Identifier https://doi.org/10.48550/arXiv.2307.16019
Field/Scope of use Any use
Group Others
License term 2023-07-29 00:00/2029-12-31 00:00
Owner francesco, manigrasso, francesco.manigrasso@polito.it, orcid.org/0000-0002-4151-8880
ProgrammingLanguage python, torch framework
RelatedPaper @inproceedings{Manigrasso2023FuzzyLV, title={Fuzzy Logic Visual Network (FLVN): A neuro-symbolic approach for visual features matching}, author={Francesco Manigrasso and L. Morra and Fabrizio Lamberti}, booktitle={International Conference on Image Analysis and Processing}, year={2023}, url={https://api.semanticscholar.org/CorpusID:260334834} }
SoBigData Node SoBigData EU
Sublicense rights No
Territory of use World Wide
Thematic Cluster Other
input awa2, cub, sun datasets
output classification score
system:type Method
Management Info
Field Value
Author manigrasso francesco
Maintainer manigrasso francesco
Version 1
Last Updated 16 July 2024, 10:54 (CEST)
Created 15 July 2024, 13:26 (CEST)