The number of complaints does seem odd. I can understand farmers being pissed off when people collapse their walls, though. It takes time to rebuild them and if you have to do it repeatedly I can see how it'd piss you off.
There's also the litigation side of things. I would say that all of us are aware that if we do jump a fence/gate then we do so at our own risk, but there's some out there that would sue the landowner if they had an accident whilst doing so. It's happened in Ireland several times. Stupid, but a sign of the times :-(