Zhang, Li, Fielding, Ben, Kinghorn, Philip and Mistry, Kamlesh (2016) A vision enriched intelligent agent with image description generation (demonstration). In: AAMAS 2016 - Proceedings of the 2016 International Conference on Autonomous Agents and Multiagent Systems. International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS), pp. 1488-1489. ISBN 9781450342391
Full text not available from this repository.Abstract
In this paper, we present an intelligent conversational agent enriched with automatic image understanding and facial expression recognition using state-of-the-art machine learning techniques for the advancement of autonomous interaction with the elderly or infirm. The agent is developed to conduct health and emotion well-being monitoring for the elderly. It is not only capable of conducting question-answering via speech-based interaction, but also able to provide analysis of the user's surroundings, emotional states, hazards and fall actions via visual data. The agent is accessible from a web browser and can be communicated with via voice or text means, with a webcam required for the visual analysis functionality. The system has been evaluated with diverse real-life images to prove its efficiency.
Item Type: | Book Section |
---|---|
Subjects: | G400 Computer Science |
Department: | Faculties > Engineering and Environment > Computer and Information Sciences |
Depositing User: | Becky Skoyles |
Date Deposited: | 03 Dec 2018 10:07 |
Last Modified: | 11 Oct 2019 18:17 |
URI: | http://nrl.northumbria.ac.uk/id/eprint/37014 |
Downloads
Downloads per month over past year