Simply put, I respawned back at the temple next to the wall that gets destroyed after getting downed at the ruins almost next to the castle, where the second Grim is. There are two or three points of no return between the two spots, so even if my team wanted to trek aaaaaaaaall the way back for me, they couldn't.
This was in Legend by the way, in case it's relevant, somehow.