As a private seller you can refuse change of mind returns, but selling New means you are not a private seller, and buyers would be put off by abuse of the selling procedure.
Registered as a business seller with a proper returns policy would make your selling legal, and might improve sales.