What makes you think it was white?
The inner layers show it was turfted over at various stages.
If anything it would have been muddy grey when finished if it wasn't also turfted over.
The experimental longbarrow on Fyfield down didn't take long to turn green.
As far as I know there is no tradition or evidence that the hill was scoured to keep it white.