Is it possible? If not, why not?
It's not, you get:
You can post a feature request on the main meta and it might be changed
the question was: "Why not?" which there seems to be hesitance to answer this. If people could retract votes, which technically is possible, they could have themselves represented better, but they may not know best themselves.