Want to permanently delete an email message without sending it to the trash first? This tip is great for junk mail, so it stops wasting space in your deleted mail. In WebMail, check the box next to a message you want to delete, and from the Action menu choose Expunge. In Outlook Express or Thunderbird on Windows, you can permanently delete a message by holding the Shift key while deleting a message.