What was wrong with your previous option where you simply added the people you intended to ban to your member list and then banned them? It made more sense than inviting them to your board in order to ban them.