Logic Pro Mac mini M1 crashing - "An Audio Unit plug-in reported a problem..." [RECOVER] or [QUIT] options.

This error has been bugging me for some time now and I have no idea why that is. Seemingly it happens at random times while using any 3rd party plugins. What is frustrating is that it does not say what plug-in caused it. I did a few tests and couldn't trace it.

It was happening in Ventura and keeps hapenning in Sonoma. I did a complete OS reinstall and a fresh install of all my sw from scratch (not a backup) and it didn't help.

Any ideas why this could be happening?