FYI, the tooltip says alliances require you to go to war to defend your ally if they are attacked. This is not the case, for some reason. You can make an alliance and remain uninvolved with an ally's wars.
Alliances are more permanent peace treaties, and can get you the diplomatic victory.
