I think gorosei gave regen and immortality while HKS have regen only which will explain why Gorosei didn't age in over 200 years while Garling as Hk aged
If someone is powerful enough (or has enough haki) to beat those who were summoned, those who were summoned will disappear and come back to the original place where they were before.