You can't change it, but the buyer would not have known who they were choosing unless they took several steps that they are highly unlikely to know about.
It's a faff bit you could cancel, and relist with just RM as the option for the buyer to buy again, but I think this will impact any other listings you have.