The people come from the primary sponsor on your first starport this is your home planet
i assume on any other it will be the first planet you add
there is a major balance issue here i could send a constructor to the far edge of unexplored space build a starport add a high populace planet as primary sponsor and quick buy colony ships each turn "magically" transporting the colonists all the way across the galaxy
I am not 100% certain how the Colony Ships generate but once constructed, their initial contained population should degrade significantly the farther it is away it is from the main sponsor planet. Colony Ships constructed in deep space should start with a ridiculously bare bones amount of colonists. The world is claimed - but more people need to arrive from elsewhere or the production is going to be sloooooowwwww.
With this said, it seems new worlds should 'call' more colonists to the new planet from the nearest highly populated worlds in the form of population routes set up by the player (similar to trade routes). Colonist Transports/Liners (not Colony Ships as the colony is already settled) should then travel along these routes to populate the world automatically above and beyond the new planet's growing native population. The idea of them being magically transported is something I am not comfortable with. But again I am not sure how it is actually happening in game at the moment.