Sign on to Yahoo Messenger. Right Click on the friend you want to remove and hit delete. On the top of your messenger just above your friends list, is the address book. Click on it and select the entry you want to remove and right click and hit delete.
Hope that helps.
PS- Even if you delete them, they can still see when you come on Yahoo Messenger, if they have not deleted you as well.