You can remove votes at any time by clicking on one of the voting counters. This will bring up a list of all the votes in the poll.

For each user, there is a remove icon on the right: