Avoid setting the source colour when it is set already.