Not necessarily. We Scots often say that when someone leaves Scotland to live in England, it will have the effect of increasing the average IQ in BOTH countries.
Speaking as a "Scot with his brains kicked out" I'm not sure what you are talking about!