How many 'points' you have is mostly a function of how much time you spent here.
If you really crave downvoting that much you have to wonder why, it's the least positive element of a HN presence. Think about it: you want the power to take points away from others in the same sentence that you want to get points enough to have that power!
It's more that those of us without down-vote capability feel neutered to know that we don't have power that others do. It feels better to have power and not use it than to simply not have it to begin with. ;)
