I have a bit of a suspicion that in some places where the top soil was thin or rocky, rubble walling was used as an alternative to earthworks in building henge type monuments. One particular example being Woofa Bank on Ilkley Moor, which doesn't feel like a settlement or field division, and is covered in rock art. Just a guess, but it's a hunch.