but it looks like Silbaby is at least 100 m south of a line between the centes of the Sanctuary and Silbury
Not sure what you're looking at but no, its right on the line, you can see it on maps and in the flesh. The only question is by what degree of error, and that looks like a matter of a few feet at most and possibly none.