Trying to make an avatar with a follower, but need some help

Hi, I’ve am trying to make a model with a follower behind it. The meshes and armatures are merged, and it works, but my only issue it that the follower moves with the hips of the other character. As in, when I go prone or my hips tilt, the other character rotates as if it’s parented to the hips. I’m wondering, is there any way of fixing this? I was looking at constraints, but I’m don’t know if it is even useful. If possible I’d prefer a way that is quest compatible. Any help is appreciated