So I finally managed to complete my town hall. This was after several tries and reloads.
You’ll notice what’s special about it is that it has a third story within a second story making up the bell tower. Unfortunately after completion, the hearthlings won’t remove the ladders. Not only that but it seems that when I put a roof on the second story, the system capped the hole for the third story on the bell tower with roofing (see screenshot below).
Sucks since now the third story isn’t accessible. Destroying the ladders using the console command results in a permanent error each time I load the save. Lemme know if I should upload my save somewhere.