Of course you are responsible, buyer may have paid for label, but it is based on the postage put on the listing. You are responsible for the listing not the buyer.
It is up to you as seller to see that postage quoted is accurate, not just a wild guess by ebay. Simple postage is just that “simple”, it can only use the information supplied by you on which it bases the cost and method of postage.