What each man feared would happen to himself, did not...
What each man feared would happen to himself, did not trouble him when he saw that it would ruin another.
What each man feared would happen to himself, did not trouble him when he saw that it would ruin another.