McCarthy fears Doyle exit