I'll rip them off...a little sting is a lot better than a slow hurt.
These days I usually just have to use them on my fingers every now and then and they end up getting wet from hand-washing, dish rinsing, whatever...they come off almost by themselves with no pain at all.