Kilmarnock boss Alex Dyer says he felt he had to work harder in his career because of the lack of opportunities for black people.