Well I suppose you could agree if he then refunded in cash on pick up, but it would not show on ebay as returned or refunded.
Your return case would then run out of time and close.
I think you would be well advised to use the ebay method, as once proof of delivery if seller does not refund you can escalate to ebay who will refund at seller’s expense.