Efficient Spatial Reasoning for Human Pose Estimation

Huang, Ying, Hu, Shanfeng and Zhang, Zike (2022) Efficient Spatial Reasoning for Human Pose Estimation. In: The 33rd British Machine Vision Conference Proceedings. The British Machine Vision Association and Society for Pattern Recognition, Durham, p. 797.

Preview

Text 0797.pdf - Published Version Download (710kB) | Preview

Abstract

Human pose estimation from single images has made significant progress in the past but still faces fundamental challenges from the occlusion and overlapping of joints in many cases. This is partly due to the limitation of the traditional paradigm for this problem, which attempts to locate human body joints solely and as a result can fail to resolve the spatial connections among joints that are critical for the identification of the whole pose. To overcome this shortcoming, we propose to explicitly incorporate spatial reasoning into pose estimation by formulating it as a structured graph learning problem, in which each image pixel is a candidate graph node with every two nodes connected via an edge that captures their affinity. The advantage of this representation is that it allows us to learn feature embeddings for both the nodes and edges, thereby providing a sufficient capacity to delineate correct human body joints and their connecting bones. To facilitate efficient learning and inference, we exploit self-attention transformer architectures that fuse node and edge learning pathways, which can save parameter numbers and permit fast computation. Experiments on the popular MS-COCO Human pose estimation benchmark show that our method outperforms representative methods.

Actions (login required)

View Item

Downloads