Yeah, I think the safety banner should be a separate thing from militia banner, since you want the specialized townsfolk to retreat to a safe spot indoors usually.
To be honest, I liked the old party system. I love the new party systems for controlling footmen, but having a non-combatant party was super useful as well, since you can split your military/militia to cover multiple points at once.