Adjacency, as it is, is a fun system. It's fun. That's all the justification I need. What's the point of something "making sense" if it's not fun? It's a game.
Anyways, about the Civ/Colony capitals - don't worry so much about them. They really aren't that good, and maximizing their bonuses is usually detrimental to your planet overall, since you're better off having large clumps of empty tiles, instead of empty tiles surrounding your capital. This is because the capital can't receive adjacency bonuses, whereas a factory surrounded by six factories not only gives +1 to each tile, but receives +6, making it at least twice as useful as the capital. The capital is best if used in a limited role, in my opinion.