I know I do.I mean I have heard hikers warn of camping near trailheads for the threat of people/locals/drunks knowing where you were,and being able to get to you quickly.
When we had our bear encounter we were 1/10 of a mile from a road (Campbell hollow rd,approx 3.5mile hike from 19E/elk ridge access) and I was a little uncomfortable camping there just knowing someone could get to me easily as I was sleeping...One mans paranoia and preparedness is another mans silliness and unnecessary weight I suppose.