And it's simple enough if you don't want to be part of the conversation to just delete the thread. Even better, you get removed from the friends list.