The Saddlers forward has been on loan at Huish Park, scoring twice but injuries have now cut short his stay.
"Unfortunately I have had to send Andy back because he's had a couple of niggling injuries that have affected his performance and these will need to be put right before he plays again," said Town boss Gary Johnson.
"At this stage of the season we cannot afford to have loan players that are not fully fit. We will continue to monitor his progress."
