Your logic here is flawed. If someone important wanted you out of this clan and/or Toribash, rest assured that you were at least going to be kicked a long time ago. We usually kick for stupidity, long periods of inactivity or serious offenses of our rules(or ignoring them). I don't think you qualify on these.
And if someone unimportant wanted you out of this clan and/or Toribash, why do you care ? What, getting bullied over the internet? I admire that you want whoever is being stupid to come out and talk trash in front of everyone, but you surely understand that cowards/trolls/flamers don't do that.
Bottom line, other people's opinions should have zero influence on what you do, provided you're willing to accept the consequences of your actions. If don't want to quit Toribash or this clan, you don't have to, as long as you adhere to the rules. If you do and you're just looking for a reason, this is the wrong way to do it.
And about this little birdy or whatever, I doubt it's that trustworthy. Why believe it if it has no evidence? Post one screenshot or tangible evidence of any of us talking shit about you, and then you may have a valid argument. Until then it just seems like someone wants to start a conflict in the clan.