Pedestrian Trajectory Prediction Based on Deep Convolutional LSTM Network

Pedestrian trajectory prediction is vital for transportation systems. Generally we can divide pedestrian behavior modeling into two categories, i.e., knowledge-driven and data-driven. The former might bring expert bias, and it sometimes generates unrealistic pedestrian movement due to unnecessary repulsive forces. The latter approach is popular nowadays but most existing neural networks, including fully connected long short-term memory (LSTM) networks, use a 1D vector to model their input and state. The shortcoming is that these works cannot learn spatial information about pedestrians, especially in a dense crowd. To tackle this, we propose to use tensors to represent essential environment features of pedestrians. Accordingly, a convolutional LSTM is designed and deepened to predict spatiotemporal trajectory sequences. As the tensor and convolution can learn better spatiotemporal interactions among pedestrians and environments, experimental results show that the proposed network can estimate more realistic trajectories for a dense crowd in evacuation and counterflow.