I always find it easier and more scenic to approach from Abercastle. Take the left hand coastal footpath (When looking out to sea) and walk out with fantastic views through the gap in the cliffs towards Garn Fawr. It is signposted from the coastpath just after the little rocky bay and up the hill. This must be how it was meant to be approached from the water