Placing ghost items

So it is a bit anoying when trying to place the campstandard or for example a wild silkweed on a building and the result will be that the item will forever be a ghost on that building. Either it should not be possible to even place those items on any builds, or they should have the ability to be placed in a stockpile?

A small thing, but something that really is annoying again and again…