Select the settlement. At the bottom left of the screen between the "Kingdom Info" and "Settlement Details" buttons there are tabs labeled "Training" and "Building". Selecting these shows the current queue; click the little X at the top right of an icon to cancel it. Note that these tabs will not exist if nothing is being built/trained.
