Towards Light-weight Annotations: Fuzzy Interpolative Reasoning for Zero-shot Image Classification

Long, Yang, Tan, Yao, Organisciak, Daniel, Yang, Longzhi and Shao, Ling (2018) Towards Light-weight Annotations: Fuzzy Interpolative Reasoning for Zero-shot Image Classification. In: BMVC 2018 - British Machine Vision Conference, 3rd - 6th September 2018, Newcastle upon Tyne, UK.

Preview

Text (Full text) Long et al - Towards Light-weight Annotations.pdf - Published Version Download (2MB) | Preview

Abstract

Despite the recent popularity of Zero-shot Learning (ZSL) techniques, existing approaches rely on ontological engineering with heavy annotations to supervise the transferable attribute model that can go across seen and unseen classes. Moreover, existing cross-sourcing, expert-based, or data-driven attribute annotations (e.g. Word Embeddings) cannot guarantee sufficient description to the visual features, which leads to significant performance degradation. In order to circumvent the expensive attribute annotations while retaining the reliability, we propose a Fuzzy Interpolative Reasoning (FIR) algorithm that can discover inter-class associations from light-weight Simile annotations based on visual similarities between classes. The inferred representation can better bridge the visual-semantic gap and manifest state-of-the-art experimental results.

Actions (login required)

View Item

Downloads