To be honest I don't even think it's ancient. Near the cliff workings to the east of the site there is a vey similar wall but this never gets mentioned in any texts? There are also many millstones scattered on the cliff face of Carl Wark.

This is just my personal opinion though :)