The character walks and navigates just fine. But after tripping over some old tires or another Puppet it loses it's navmesh collider. When the puppet gets up it slowly falls further away from the center and weird things start happening.
I tried fixing this by stopping all navagent movement when the state goes to BehaviourPuppet.State.Unpinned. But that only reduces the character's sliding around and rubberbanding that also happens a lot.