You can remove checkmarks at any time by clicking one of the checkmark counters. A list of all checkmarks for the entry will then appear.

For the respective user, there is a remove icon on the right: