With addresses that have been previously added, you can delete it out of the system whenever you have the need for it.
Access Address Book
Go to the Address List and scroll to the last column with the title.
Click Delete.
Click Yes in the pop-up notification to finalize.