Transfer Learning for Wearable Long-Term Social Speech Evaluations

Chen, Yuanpeng, Gao, Bin, Jiang, Long, Yin, Kai, Gu, Jun and Woo, Wai Lok (2018) Transfer Learning for Wearable Long-Term Social Speech Evaluations. IEEE Access, 6. pp. 61305-61316. ISSN 2169-3536

08492416.pdf - Published Version

Download (7MB) | Preview
Official URL:


With an increase of stress in work and study environments, mental health issue has become a major subject in current social interaction research. Generally, researchers analyze psychological health states by using the social perception behavior. Speech signal processing is an important research direction, as it can objectively assess the mental health of a person from social sensing through the extraction and analysis of speech features. In this paper, a series of four-week long-term social monitoring experiment study using the proposed wearable device has been conducted. A set of well-being questionnaires among of a group of students is employed to objectively generate a relationship between physical and mental health with segmented speech-social features in completely natural daily situation. In particular, we have developed transfer learning for acoustic classification. By training the model on the TUT Acoustic Scenes 2017 data set, the model learns the basic scene features. Through transfer learning, the model is transferred to the audio segmentation process using only four wearable speech-social features (energy, entropy, brightness, and formant). The obtained results have shown promising results in classifying various acoustic scenes in unconstrained and natural situations using the wearable long-term speech-social data set.

Item Type: Article
Uncontrolled Keywords: Long-term social monitoring, psychological, transfer learning
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Depositing User: Becky Skoyles
Date Deposited: 25 Mar 2019 09:57
Last Modified: 01 Aug 2021 12:23

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics