Place river tiles from the headwaters to the estuary linearly; it's the only way to get them to lay out correctly. As far as things that can't be deleted, it happens; you can save the map, restart FE, and reload it and things should be OK for awhile. You can also delete and place things like starting locations from the mapname.xml file if you can't get it to work through the app.
Yes it is buggy as hell but you can make the maps you want with a little ingenuity, at least until, if ever, it is fixed (It was exactly the same in WOM so don't expect a fix soon.