It isn't the chalk but the symbolism; when most people see a sawstika they associate it with one thing only, despite its historical provenance.
well it is no ones fault that the vast majority of folks are illeducated dolts!