It's very hard to tell successful people that their magic isn't working any more, and the fact that he is aware of that should inspire tremendous confidence. He's saying the board won't be afraid to act if they think he's losing his intellect.