Other factions get really upset when you build, or are able to build the Forge of the Overlord. This is understandable. Unless Spell of Making is not a winning condition. I think the diplomatic penalty for building it should be less, or non existent, if winning by Spell of Making is turned off.