Well, there is quite appropriate a lot of apprehension among different peoples in Middle-Earth to one another. It's not just a man-thing even, much less a Rohan thing.
Boromir & Faramir voice the beliefs of Gondor, despite all its lore, and where Galadriel spend a goodly part of the Third Age (Edholland).
What we have with Men, however, is the not just the span of distances and other barriers, but also that centuries and generations have gone by. So, at one level memories have faded, and ignorance and superstition and baseless fear as filled the void.
But also there is wisdom in all of it, too. Like Fangorn, Galadriel and Lothlorien are extremely dangerous.
In particular, a world that is unnatural for mortals abides yet in the Golden World. JRRT rues the estrangement between the two kindred, yet at the same time questions the appropriateness of the Men and Elves having much contact in the first place. It's a double-edge sword, and the Rohirrim are not necessarily being stupid, but justifiably prudent.
__________________
The hoes unrecked in the fields were flung, __ and fallen ladders in the long grass lay __ of the lush orchards; every tree there turned __ its tangled head and eyed them secretly, __ and the ears listened of the nodding grasses; __ though noontide glowed on land and leaf, __ their limbs were chilled.
|