First, you need to delete the mail: Tap on an email or mark multiple emails, then click the Delete icon. This will send them to the Deleted folder.
To access the Deleted folder, expand the folder pane and then tap on the Deleted folder.
Individually delete or mark multiple and delete emails from here to permanently delete them.