@phector2004, throughout this game, did you get any error messages while playing? Have you enabled the new pathfinder in or cppai in experimental settings?
This sounds to me like a manifestation of the idle hearthling issue: [Dev Blog] IDLE MUSINGS.