The fastest way I found to do this is by going to your own profile, expand your friends section, click on their avatar, delete them and use the back arrow to return. The delay in getting to another profile doesn't seem to lag as bad.
BTW, 255 is the magic number if you want to see all of your friends. Anything more than that and you will only see the first 255.