From this article, "This rancher, who wants to remain anonymous, sees trucks driving around in his pastures, sometimes well after dusk. Every rifle season, a fleet of trucks is parked on his private driveway. He’s witnessed people shooting deer on his property from the adjacent public land, and he’s caught people shooting deer well within his property. He’s heard shots ring out from the same direction as where his kids are out fixing fences, causing panic. There have been times he’s tried to approach trespassers and they’ve fled the scene, leaving dead or wounded deer behind. Law enforcement in his area is stretched too thin to respond to all the calls."
In my experience, around where I live, people don't generally have an issue with people walking on unimproved paths in the woods. It's people ripping up those paths with all-terrain vehicles and dirt bikes or hunting near farm animals and people on private property.