Siege weapons to destroy and protect

Another idea
remove the options from your heartlings to destroy buildings .
But have them use a siege weapon (catapult, ballista, storming ram)
They could also be setup as town defense and be manned by the archer or militia if they ever come back