The historical novelist has to consider what has actually happened, while the SF writer is dealing in possibilities, but they are both in the business of imagining a world unlike our own and yet connected to it.
Some people become passionate readers and fans of science fiction during childhood or adolescence. I picked up on SF somewhat later than that; my escape reading of choice during my youth was historical novels, and one of my favorite writers was Mary Renault.