How to dispose of them? ("friends")?

you do have low self-esteem because you don't have the dain guts to tell them you want to go your separate ways from them.