Allow downloads while Vision Pro is off my head?

Large downloads stall after a while. It's extremely frustrating. Background tasks like downloads should continue even if the device itself is not on your head. Can this be fixed? What's worse is that often the download will not resume after the download stalls.