Usually it's the lighting. Ideally, a winters day, with low angle sunlight, preferably just after a rain shower to make the little buggers visible.

Also, they do hide if they hear you coming. They can fade in and out of the lichen at will.