Airpods Pro 3 Sound Imbalance After Using Touch Controls

Bought my pair a couple of days ago. When I use the touch control on one of the earpieces (raising or lowering the volume, play, pause, toggling ANC etc.) the sound gets imbalanced with higher volume in the opposite earpiece. If I then use the touch control on that opposite earpiece, the balance are pushed back almost to the middle, but not quite.

If I use my connected phone to pause the audio that is playing and then resumes it, the imbalance is corrected.

After a factory reset of the Airpods the issue disappeared. The next day it was back.

I found one similar issue here, but otherwise I haven’t found this problem searching online. I will definitely return this pair, but am interested in hearing if this is a common issue or if I just got a bad pair and should take a chance on another.