How can I get Siri to recognize "Hey Siri" with AirPods?

I have some issues with Siri. I just get a notification that person X is calling but not the question "Would you like to answer?". I also have problem to get my Iphone react on "Hey Siri" through my new Airpods 4.

[Re-Titled by Moderator]