Former Rangers chief executive Charles Green has revealed he may still be at the Ibrox helm had he not "been driven out of the club".