Guys think I'm staring them down, but they watch ME for...

Guys think I'm staring them down, but they watch ME for signs. Why can't I do the same to them?