Efficient Spatial Reasoning for Human Pose Estimation

Huang, Ying, Hu, Shanfeng and Zhang, Zike (2022) Efficient Spatial Reasoning for Human Pose Estimation. In: The 33rd British Machine Vision Conference Proceedings. The British Machine Vision Association and Society for Pattern Recognition, Durham, p. 797.

0797.pdf - Published Version

Download (710kB) | Preview
Official URL: https://bmvc2022.mpi-inf.mpg.de/


Human pose estimation from single images has made significant progress in the past but still faces fundamental challenges from the occlusion and overlapping of joints in many cases. This is partly due to the limitation of the traditional paradigm for this problem, which attempts to locate human body joints solely and as a result can fail to resolve the spatial connections among joints that are critical for the identification of the whole pose. To overcome this shortcoming, we propose to explicitly incorporate spatial reasoning into pose estimation by formulating it as a structured graph learning problem, in which each image pixel is a candidate graph node with every two nodes connected via an edge that captures their affinity. The advantage of this representation is that it allows us to learn feature embeddings for both the nodes and edges, thereby providing a sufficient capacity to delineate correct human body joints and their connecting bones. To facilitate efficient learning and inference, we exploit self-attention transformer architectures that fuse node and edge learning pathways, which can save parameter numbers and permit fast computation. Experiments on the popular MS-COCO Human pose estimation benchmark show that our method outperforms representative methods.

Item Type: Book Section
Additional Information: BMVC2022: The 33rd British Machine Vision Conference, London, 21-24 Nov 2022 : ©2022. The copyright of this document resides with its authors. It may be distributed unchanged freely in print or electronic forms.
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Related URLs:
Depositing User: John Coen
Date Deposited: 21 Feb 2023 08:48
Last Modified: 21 Feb 2023 08:50
URI: https://nrl.northumbria.ac.uk/id/eprint/51452

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics