Very good idea 
. Another way would be the ability to plan out a building, but save the design & location instead of removing it or start building it - not as flexible (eg say you want planning mode for farms etc), but for structures at least it might serve the same function.
Agreed on the ability to destroy them. For transplanting… hmm. I think that for resource-producing plants, it might make sense if you had to have a farmer (or some future green-fingered class) to do that, if only to prevent people making things like wild silkweed farms that only ever need harvesting, and not replanting etc.
Upgrading some items from tier 1 to tier 2 etc (eg mean beds to comfy beds) would also go a long way towards this too. I’m in the same position WRT bed quality - my settlers all sleep on the ground until I have a nice pile of comfy beds made 
.
For other suggestions, see my thoughts here: