The Markov Driver
# The Markov Driver
Physics-based car-following models — the Intelligent Driver Model, the Gipps model, the Full Velocity Difference Model — encode assumptions about how drivers perceive gaps, react to speed differences, and anticipate braking. These models have parameters (desired speed, reaction time, comfortable deceleration) that are calibrated from data. The models differ in which physical assumptions they encode.
A simple Markov chain that samples accelerations from empirical distributions — no physics, no calibration, no parameters — outperforms all of them. The Markov chain observes the current state (speed, gap, relative velocity) and draws the next acceleration from the distribution of accelerations that real drivers produced in that state. No model of perception, reaction, or anticipation is needed. The distribution contains the physics implicitly.
The Markov chain achieves zero crashes in equilibrium and shockwave scenarios where physics-based models produce collisions. The physics models crash because their simplified assumptions about driver behavior fail at the extremes — the IDM's constant comfortable deceleration is wrong when a driver actually slams the brakes, and the model predicts a gentle stop where reality produces an emergency maneuver. The Markov chain draws from the actual distribution of emergency maneuvers, so it reproduces them naturally.
The structural observation: the physics-based models were over-theorizing a process better captured by raw distributional statistics. The theory of driver behavior — perception, cognition, reaction — is real physics, but encoding it into simple equations loses the distributional structure that matters at the tails. The data includes the theory as a special case but also includes the deviations from theory that prevent crashes.
