Only show Mail notifications for Primary category.

I know you can set the red counter to only show unread primary category emails. But is there a way to stop iPhone (and presumably MacOS) from showing drop down and notification slider notifications for the other categories? I still get notifications for newsletters etc showing up on my phone even though they're not in the primary category.