Most medical physicists work in the physics of radiation oncology making sure that the desired dose is given to the cancer and the dose to normal tissues are minimized.
I found collaborating with congenial doctors about problems that physicists could help solve was very satisfying. I also like educating anybody who would listen!
Medical physicists work in cooperation with doctors. A few medical physicists devote their time to research and teaching. A few get involved with administrative duties.