Turning off notifications will stop the notifications from appearing on your device.
Under Calendar, tap Time to Leave.
To change your notification setting for each email address for that device, toggle each account On or Off.
Note: Turning off notifications will not turn off Cortana. Go to Settings > Time to Leave > Advanced Settings, and see the FAQ entitled How do I turn off Cortana?