Extending his argument about 'aboriginals' being the only 'true' inhabitants of a place, the logical conclusion would be that all people of Anglo descent in the Americas and Australia would have to pack up and head home to the UK.
I doubt very much that's what he has in mind.