This is not a weird thought at all. Also, don’t forget that you can store your preset voltages in custom voltage tables also.
An idea from p32 of the ER-101 manual:
Your voltage tables don’t have to be monotonically-increasing. There is nothing stopping you from assigning CV index 80 to output 0V and CV index 10 to output 5V. Why would this be useful? Well suppose you are using CV to control accent in a drum beat. You could assign CV indices in the following manner: 1,2,3,4,1,2,3,4,1,2,3,4,… or any pattern that uses a small(ish) number of indices repeatedly. Now by adjusting the assigned voltage for say CV index 3, you can globally change the accent for all steps that have been assigned the CV index 3! You could set the output voltage for CV index 2 to 0V and turn all those notes off with one turn of the knob. The possibilities are endless.