Apparently, at the side of the grotto are some stones moved from a prehistoric site at nearby Tisbury, c1792. (Though according to other accounts, I’ve read, the stones are actually part of the grotto itself.) Josiah Laine, who built the grotto, came from Tisbury, so I guess he was using what he saw to be handy and suitably quaint stones. Supposedly the human remains beneath the stones were placed back under them at their new location. You wouldn’t imagine they’d be best pleased at becoming part of a fashionable garden accessory.
The stones are thought to have come from a neolithic tomb at Place Farm (ST951299) in one of three fields near the junction of the Chicksgrove and Chilmark roads. (wiltshire.gov.uk/community/getcom2.php?id=225)
There is a picture (of the grotto, at least) at the ‘Astoft’ website:
astoft.co.uk/Dscn5986-u2-540-u0.5-q30.jpg
Perhaps that’s one of the stones on the left.