There is lots of folk lore about farmers removing stones. having bad luck and having to put them back.

The story of the lightning storm while Long Meg at al were being destroyed is a prime example of such tales.