Actually, a better map says otherwise, for the mound at least...
http://193.129.1.226/planservices/AveburyW.nsf/aveburyWHSmap.htm

There's some text on there that might be illuminating, but I can't make it out.