"Only putting the avenue stone theory because theres a heavy argument in favour of "altar stone" whereas it could have come from somewhere else"
Yes, but we do have a bit of solid textual evidence linking them with Stonehenge itself - the fact a stone was taken to St James. So I guess that has to be the lead hypothesis doesn't it? "Anywhere else" may well be the truth of it but there's no clues pointing that way.