Living near military installations would be the big exception. I live probably about 20 miles from a massive radar facility that can track planes from across the Atlantic ocean, and doing anything within the area to set something like that off would probably have the MPs knocking on your door long before anybody else. I think even flying drones above a certain height isn’t allowed for miles around.