Took me a while to figure that one out.
I'm not sure if it is a sharpening stone or just weathering. And if it is a sharpening stone then it may not be prehistoric
and saying all that.....I kinda like it where it is.
Like yourself I see stone walls as rock art, not very portable though, unless your a down-on your-luck upland farmer selling off your walls to garden centers.