I agree about the screen not moving to where the quest goal point is and would add that it seems there is no look at distance in terms of walking from the quest given location.  For example, the "take the kid to the estate" quest.  The estate will randomly be somewhere relatively close on the map, but many times for me it is across the water and you have to go halfway up (large map) the map to get across, then back down to get to the estate, then of course back up and down to get back to the city.

I would ignore it but sometimes the quest given location is in my way of building my city. I know not really a big deal, but more annoying then anything.  If on a mainland it works, but near the coast sometimes it doesn't, it doesn't look at "land" distance.  Could be just your luck in the quest but seems to me more like a buggy type of thing than a strategy type of thing.

What I've noticed with this is that once I get a lvl 2 quest (often one of the potion ones) I can no longer visit other questgiving huts.  Moving on to lvl 3 quests works fine, it just doesn't allow other lvl 2 ones.