I am sorry to hear you are having issues with your pony. As this is a new habit I would say it sounds like a pain response and it is possible something is physically hurting when ridden or tacked.
I would get an equine dentist out to check teeth, also a saddler out to check your saddle and then if he is still doing it to contact your vet for their advise.
Good luck Bertie
