Afaik, soapy water is the best. However I've never had much more than a small bottle of water with me at a site I've found graffiti-ed so I don't really know. For the record its hard to get off without any water, ime.
Cheers.