I think there's a better explanation. His bread was so good that he didn't want the cheese. Maybe @apsu himself was the baker.