If you remove the ladder the hearthling will fall and someone can rescue him.
I think hearthlings were having trouble rescuing when the rescued hearthling was on a narrow space of one block, because they needed another block to stand next to them (you can’t rescue someone by stepping on them, right?).