Citation

Mirus F, Blouw P, Stewart TC, Conradt J. Front. Neurorobotics 2019; 13: e84.

Affiliation

Department of Computational Science and Technology, KTH Royal Institute of Technology, Stockholm, Sweden.

Copyright

(Copyright © 2019, Frontiers Research Foundation)

DOI

10.3389/fnbot.2019.00084

PMID

31680925

PMCID

PMC6805696

Abstract

Predicting future behavior and positions of other traffic participants from observations is a key problem that needs to be solved by human drivers and automated vehicles alike to safely navigate their environment and to reach their desired goal. In this paper, we expand on previous work on an automotive environment model based on vector symbolic architectures (VSAs). We investigate a vector-representation to encapsulate spatial information of multiple objects based on a convolutive power encoding. Assuming that future positions of vehicles are influenced not only by their own past positions and dynamics (e.g., velocity and acceleration) but also by the behavior of the other traffic participants in the vehicle's surroundings, our motivation is 3-fold: we hypothesize that our structured vector-representation will be able to capture these relations and mutual influence between multiple traffic participants. Furthermore, the dimension of the encoding vectors remains fixed while being independent of the number of other vehicles encoded in addition to the target vehicle. Finally, a VSA-based encoding allows us to combine symbol-like processing with the advantages of neural network learning. In this work, we use our vector representation as input for a long short-term memory (LSTM) network for sequence to sequence prediction of vehicle positions. In an extensive evaluation, we compare this approach to other LSTM-based benchmark systems using alternative data encoding schemes, simple feed-forward neural networks as well as a simple linear prediction model for reference. We analyze advantages and drawbacks of the presented methods and identify specific driving situations where our approach performs best. We use characteristics specifying such situations as a foundation for an online-learning mixture-of-experts prototype, which chooses at run time between several available predictors depending on the current driving situation to achieve the best possible forecast.

Copyright © 2019 Mirus, Blouw, Stewart and Conradt.

Language: en

Keywords

artificial neural networks; long short-term memories; online learning; spiking neural networks; vector symbolic architectures; vehicle prediction