I have been trying to do the same thing. At first it says" remove friend"--after you remove it, it says "add friend" . Then check your list, if the name no longer appears it is gone. The problem I keep having is that the name remains on the list, therefore it has not been correctly removed. I have to keep going back to my profile and start the process again.
We could use a better way....