Ender pearl doesn't work properly in multiplayer

I was playing multiplayer on a computer joined with three players on the same Xbox, and when we would all die in a dungeon, the ender pearl in town would only send me back to the dungeon but would send the others on the Xbox to a seemingly random location on the outdoor map.  This happened 100% of the time when we were in the same dungeon.

I was not the host but joined their game.