Apple Music Xbox app won't remember where I left off after restart

Hi, I've recently switched from another music service to Apple Music and I've been quite often using it on an Xbox console. I've come to a problem where very often (not everytime) when the app closes when the console goes to sleep mode and I come back on, the app won't remember where I left my music playing, making me replay the entire shuffled queue, including songs I've already listened to before. Is there any way to fix this or is this a bug on Apple's part? Thanks for any answers.