Well, in some cases, I find it hard to defriend someone if I know that the person will notice and feel hurt and rejected.

However, I do feel that most of the people that I have stopped following on Twitter, have so many followers that they probably have not even noticed that I have defriended them. Therefore, defriending this other group is not hard at all.