Where is everybody? Humans could theoretically colonize the...

Where is everybody? Humans could theoretically colonize the galaxy in a million years or so, and if they could, astronauts from older civilizations could do the same. So why haven't they come to Earth?