Most of the dye will be in the dead layer of skin and will naturally come off in a few days. Scrubbing will accelerate it but can also make the skin raw.

Source: got silver nitrate on my hand when I was in high school chemistry.