Apple Watch Ultra 3 calls are delayed

My Apple Watch Ultra 3 calls are being delayed. For instance, when I’m on a call and i speak the other person on the line does not hear what I say till a couple seconds after I have said it. This disrupts the flow of the conversation. I’ve tried repairing my Apple Watch, restarting both Apple Watch and my phone. The only thing that seems to fix it is resetting my network settings on my iPhone. But then after a couple days the issue persists. Is anyone having the same issue and know what I should do?