Gregory never thought of Villa exit
Gregory and Ellis have been publicly at odds over the financial situation at Villa, with Gregory becoming increasingly frustrated at the lack of funds available to strengthen his squad.
The Villa boss had been looking to bring in Muzzy Izzet and Andy Cole, amongst others, but was shot down by the board's refusal to give him the cash to spend.
Despite all the troubles, Gregory has insisted that he has never thought of walking out of the club and is determined to stay and build a successful side.
"We went top on October 27 and on the following Monday I asked if I could enhance the team and the answer was 'no', which was fair enough," said Gregory.
"I do know that from that particular day we could have got stronger. The lads were flat out to get us to the top of the league.
"If we had maybe gone out and speculated a bit and bought two or three players, it would have kept us up there in that top group without any question.
"But the club's policy at that time is still evident now, that we have to sell before we can add to the squad.
"It does frustrate you when you see other clubs in The Premiership that have spent enormous amounts of money without having to sell a player, but that's the way they run their clubs.
"We don't run ours in the same manner and I do find it very difficult at times that we haven't looked to add to the squad even if it meant going into the red a little bit.
"Have I ever been tempted to walk away in frustration? No, never. It's a thing I'd never do. I wouldn't turn my back on the lads because they are still a fantastic bunch to work for."
It has been widely reported that Gregory may have to offload one of his star players in order to add to his squad, and Juan Pablo Angel is the main name touted as a possible departure from the club.
The Colombian international has shone so far this season after a difficult start to his Villa career, and Gregory says that he has been happy with the way he has improved this term.
"The fans love him and he has become the hero of the Holte End," said Gregory.
"He has worked so hard and his record stands up there to be examined.
"He was disappointed not to get a hat-trick against Derby but he is contributing as well with his all round game and his touch."
Gregory would be loathed to see his star striker leave Villa Park but he knows that if he wants to strengthen the side in other areas, he must sell to raise the cash first.