You can temporarily dismiss the notification by selecting the Close button. You can also toggle it on or off in Settings:
-
Open Outlook Mobile Settings.
-
Select Play My Emails.
-
Turn the toggle On or Off for each account as desired.