It is partly the remoteness of rallying that appeals. It is down only to the driver/co-driver and the car. No other cars to get in the way.
Also the variation in what they race on. No other motorsport is as diverse.
The dust makes for good photos too
That film of Pikes Peak is just amazing...and only 5 minutes long.