Ambassadors get repelled from other empire borders like any other unit. Think they're not fully developed in the current builds.
Caravans are okay, but they really shouldn't be able to trade with other factions until trade agreements have been made. Right now they pretty much can be used for spying. You really shouldn't be able to see what units are in a city, or anything about that city without developing other Tech (like spies).