I suppose the one thing to remember about many hilllforts is that they weren't necessarily occupied all the time. More often than not they were for retreating to in times of need and most of the population lived outside.

It's still an interesting question though, because there'd actually be more shit about when people are throwing rocks, arrows and spears at you :-)