Research has shown that semi-permanent dyes usually coat the outside layer of your hair, unless your hair is porous and damaged, in which case, the semi-permanent color will be absorbed into your hair just like a permanent dye. So, instead of washing out after 4 to 12 shampoos, semi-permanent dye will stay in your hair making it very difficult to completely wash out.
