Pure and utter luck - I went out that day to write up field notes on Howick Hillfort and only took the sea path route back because the access path I took too the hillfort was so muddy.

I've stayed at Sea House Farm cottages a few times (highly recommended) so I knew the route and thought the views from near Rumbling Kern would be nice. Only spotted the rock on the way back down.