Once the road has been constructed (the caravan has reached the target city) it gives a % bonus to food production. Unfortunately, it is rather easy to exploit at the moment, if you send a caravan from a city to another city far away you'll get a large bonus. Even if the caravan is destroyed, the bonus remains.
After the caravan has done a certain amount of runs between the cities, the bonus gets stronger.