I suppose you could argue that if the bluestones were so special why aren’t there other circles that use bluestones. The answer is not a new one, but it might be argued that the bluestones at Stonehenge were not quarried for Stonehenge but were already an existing 'special' circle that was dismantled and transported to the new Stonehenge site for religious or social reasons.
We know from examples elsewhere in the world (not to mention the Stone of Scone here) that objects of religious or social importance were transported considerable distances where they then came to symbolise power, continuity, suppression, sacredness or whatever; that would seem to fit in with some of the myths and legends that surround the movement of the bluestones but... who knows...