That’s correct. Using an evri label on a Royal Mail service is not a valid service so Royal Mail we within their rights to do this.
Your option should have been not to pay the grey card and opened an inr. The matter is now purely between you and the seller.