Exchange Password Required

I have a work email account (Microsoft Exchange) that only connects when I am signed in to my work VPN. When not on the VPN, I receive constant reminders to enter my password for this account. There is no way to disable them without disabling all notifications on my Mac (Do Not Disturb) or completely disconnecting Microsoft Exchange in Internet Accounts. Both of these options are clumsy workarounds for this very annoying problem.