you mean like in Internet Explorer or Firefox? just go to 'Favorites' in IE and then 'Organise Favorites' and select the site and press 'DELETE'

in Firefox same thing, only different names