Votes are anonymous. You can tell who voted, but not what they voted for. It’s crucial for the fairness of elections that a vote cannot be definitively connected to the individual who cast it; if you could, you could coerce or retaliate.
And all of the things you mention are the trust OP is talking about. You were a trusted person in that situation. The process increases and validates trust.
It’s not really restraining them at the moment.