There was a fly buzzing around my head and I brushed it...

There was a fly buzzing around my head and I brushed it away. When I looked down the ball had moved. I did not think I hit it and my playing partners did not see it.