The problem with a general vote on the suitability of someone via a poll is that not everyone who might vote has probably read every post made by the "accused". One way of ensuring the relevant facts are presented would be to post a copy of any offending submission which defeats the purpose of moderating forums. Imagine if I used inappropriate language and that is the reason for my exclusion, the posts containing such language would have to be read by those voting. It just doesn't work that well.
The present system of having a select few who monitor the forums is the most effective way of maintaining a semblance of order.
A solution to a problem that may arise with the decisions made by this group of people is that they are 'voted' into these moderators positions. But though this is a more practical way of controlling forums it also has its down side, just look at the different political issues arising worldwide and how some are trying to solve them. Humans are not infallible, we all push some sort of barrow and try to get others to agree with our point of view. Rather than have a chorus of thousands making noise about a subject we elect one that speaks for the majority of us.
I love being Libran, sitting on the fence getting splinters in my *** and pontificating about issues that really don't have an answer that satisfies everybody. I'll shut up now.