Towards Light-weight Annotations: Fuzzy Interpolative Reasoning for Zero-shot Image Classification

Long, Yang, Tan, Yao, Organisciak, Daniel, Yang, Longzhi and Shao, Ling (2018) Towards Light-weight Annotations: Fuzzy Interpolative Reasoning for Zero-shot Image Classification. In: BMVC 2018 - British Machine Vision Conference, 3rd - 6th September 2018, Newcastle upon Tyne, UK.

[img]
Preview
Text (Full text)
Long et al - Towards Light-weight Annotations.pdf - Published Version

Download (2MB) | Preview
Official URL: http://bmvc2018.org/programme/BMVC2018.zip

Abstract

Despite the recent popularity of Zero-shot Learning (ZSL) techniques, existing approaches rely on ontological engineering with heavy annotations to supervise the transferable attribute model that can go across seen and unseen classes. Moreover, existing cross-sourcing, expert-based, or data-driven attribute annotations (e.g. Word Embeddings) cannot guarantee sufficient description to the visual features, which leads to significant performance degradation. In order to circumvent the expensive attribute annotations while retaining the reliability, we propose a Fuzzy Interpolative Reasoning (FIR) algorithm that can discover inter-class associations from light-weight Simile annotations based on visual similarities between classes. The inferred representation can better bridge the visual-semantic gap and manifest state-of-the-art experimental results.

Item Type: Conference or Workshop Item (Paper)
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Paul Burns
Date Deposited: 17 Sep 2018 15:34
Last Modified: 11 Oct 2019 17:20
URI: http://nrl.northumbria.ac.uk/id/eprint/35747

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics