We have tried but it doesn’t really seem to be something everyone agrees one. If you want to read some of the discussion about it check here:
You should definitely not have hit the limit yet? I don’t even think it is possible to reach 100+ hearthlings which is where the devs probably are going to put some kind of limit in.
I am not sure if this was stated or not, i just read a comment at the top and wanted to give an idea. I think the game should have a tool like the one for storage areas which is used to specify an area that will be used for whatever class(es) you wish. this will require a new feature to link areas of the same type (including content restrictions). this will allow us to use various class related objects merely for the looks and not turn a hearthlings home into a smithy.