Garry Monk was disappointed with how long it took referee Phil Dowd to send off Chico Flores in Swansea City's 1-0 defeat at home by Chelsea.