To unban all IP's just write this rule it will ban them for 1 second and then unban.
fail2ban-client set JailName bantime 1 I.e.: fail2ban-client set dovecot bantime 1
