I’ve run into the same issues you did, see my post.
-What are you using for roads? The game has some serious issues if you use flooring material for roads, patios and decks. It considers these areas “buildings” and adds another task to the pathfinder.
-Two story buildings are also super buggy, and it seems like you used slabs for the roof? That’s another building as well.
-I’m at the same point with the goblins, except for me it’s been worse. I ran out of stone and now it’s impossible to get it from anywhere since quarrying it causes crashes. Going into areas I’ve previously discovered will spawn a massive gaggle of goblins.