Citation

Wu L, Huang C, Zhao S, Li J, Zhao J, Cui Z, Yu Z, Xu Y, Zhang M. Neural. Netw. 2023; 163: 286-297.

Copyright

(Copyright © 2023, Elsevier Publishing)

DOI

10.1016/j.neunet.2023.03.042

PMID

37086545

Abstract

Fall event detection has been a research hotspot in recent years in the fields of medicine and health. Currently, vision-based fall detection methods have been considered the most promising methods due to their advantages of a non-contact characteristic and easy deployment. However, the existing vision-based fall detection methods mainly use supervised learning in model training and require much time and energy for data annotations. To address these limitations, this work proposes a detection method that uses a weakly supervised learning-based dual-modal network. The proposed method adopts a deep multiple instance learning framework to learn the fall events using weak labels. As a result, the proposed method does not require time-consuming fine-grained annotations. The final detection result of each video is obtained by integrating the information obtained from two streams of the dual-modal network using the proposed dual-modal fusion strategy. Experimental results on two public benchmark datasets and a proposed dataset demonstrate the superiority of the proposed method over the current state-of-the-art methods.

Language: en

Keywords

Dual-modal fusion; Fall detection; Multiple instance learning; Weakly supervised learning