Did you cancel using reason buyer did not pay, as that stops buyer leaving feedback. If you did not use this reason he could still leave a negative, and ebay would not be asking you to leave fb.
Look at Communication Preferences, and stop being reminded to leave feedback.