I play in Xbox parties but I do not have party overlay on
Some players have reported success regarding disabling that overlay and it would have been my suggestion for you.
Please reach out to our Player Support for some best practices regarding crashes and to report details to them for further investigation from our teams. We are releasing stability fixes often and feedback helps.