Super latency on all recordings in GarageBand on Macbook Pro 16

Hi, I have tried to use Garageband to record som trumpet lines over a mp3 song. The only problem is that there is a 10-40ms latency on all recordings, which make them unusable. I have tried with 2 different kinds of bluetooth headsets and plugged in headset for monitoring, and tried both bluetooth headset, Iphone, and built in Macbook microphone as the recording device.

First I suspected the wireless headphones to be the culprit, but there even seemes to be a aprox 10-20ms lag when using the built in microphone and wired headphones (eg. no wireless delay). Do anyone have the same problem?

I thought GarageBand was able to record with small delay (rumors on the street), but can't get it to work.