Guess it all, basically, comes down to the simple symbolism of a sacred/sexual gateway and the passage through or from it.
Anthony Weir did once comment that a lot of the holed stones in Ireland had the holes around waist height ....