You don't only worry about the people who hate or resent...

You don't only worry about the people who hate or resent you; in a way, you're more worried about the people who love you.