In Maycomb, if one went for a walk with no definite purpose in mind, it was correct to believe one's mind incapable of definite purpose.
Serving on a jury forces a man to make up his mind and declare himself about something. Men don't like to do that. Sometimes it's unpleasant.