It is entirely possible I've missed it, but it doesn't appear as if there is a delete function for terrain in the map editor. So, if I put down a river, I cannot delete it. Even choosing a new terrain (such as water), simply makes the river appear over the water.