I like the idea, and it would make a lot of sense if someone wants to play a realistic/more plausible game.
Just think about it: when humanity achieve interstellar travel, there will already be much older, larger and more advanced empires out there, and we will be just newcomers, with less advanced tech and no colonies. Civilizations don't simply spawn magically at the same time... Just think of Mass Effect, where the Alliance is the youngest of the races and therefore the weakest one, but still one of the majors.
Please, make this an option in the future.