TY - JOUR PY - 2022// TI - SEEM: a sequence entropy energy-based model for pedestrian trajectory all-then-one prediction JO - IEEE transactions on pattern analysis and machine intelligence A1 - Wang, Dafeng A1 - Liu, Hongbo A1 - Wang, Naiyao A1 - Wang, Yiyang A1 - Wang, Hua A1 - Mcloone, Sean SP - ePub EP - ePub VL - ePub IS - ePub N2 - Predicting the future trajectories of pedestrians is of increasing importance for many applications such as autonomous driving and social robots. Nevertheless, current trajectory prediction models suffer from limitations such as lack of diversity in candidate trajectories, poor accuracy, and instability. In this paper, we propose a novel Sequence Entropy Energy-based Model named SEEM, which consists of a generator network and an energy network. Within SEEM we optimize the sequence entropy by taking advantage of the local variational inference of f-divergence estimation to maximize the mutual information across the generator in order to cover all modes of the trajectory distribution, thereby ensuring SEEM achieves full diversity in candidate trajectory generation. Then, we introduce a probability distribution clipping mechanism to draw samples towards regions of high probability in the trajectory latent space, while our energy network determines which trajectory is most representative of the ground truth. This dual approach is our so-called all-then-one strategy. Finally, a zero-centered potential energy regularization is proposed to ensure stability and convergence of the training process. Through experiments on both synthetic and public benchmark datasets, SEEM is shown to substantially outperform the current state-of-the-art approaches in terms of diversity, accuracy and stability of pedestrian trajectory prediction.
Language: en
LA - en SN - 0162-8828 UR - http://dx.doi.org/10.1109/TPAMI.2022.3147639 ID - ref1 ER -