For me it does vary. Summer is best for peat/heathland sites, because the ground is a bit less squelchy. Most other sites I prefer in Winter, because the bracken etc is low and (unless surrounded by conifers) the views are more open.

However, since hitting a patch of black ice 3 years ago and cutting straight across oncoming traffic I'm a bit wary of early morning set-offs in the Winter.